RoboGen Free but Limited Edition

This is a free edition of the RoboGen software for Windows 95 and 98. It can be used to generate new robot exclusion files but does not contain as many features as the Standard Edition.

http://www.rietta.com

http://www.rietta.com/robogen/downloadle.shtml

http://www.rietta.com/downloads/robogen_le_setup.exe



Use this cool and usefull tool to build the robots.txt file for search engines.
The robots.txt can also help optimizing the search engines rank because it's the best way to tell the se's what5 they can index and what they can not.

If you don't no exactly what robots.txt is, say so here, and then i'll help you with that.

This is great for restricting access for search engine bots, this is also great for noobs. Great tool.

I might give it a try. I hate search engines trying to snoop into Members Only sections of my sites... and i'm too lazy to make my own robots.txt.

Good find!

Thanks guys, i guess people don't see how good this tool is, it's an excellent tool to build robots.txt and you can also add more user-agent robots that aren't in the list.

I Guess i shouldn't insert the name "Limited" in the topic title, well, i hope people at least try this tool because i know they'll love it.