|
Program name:
|
Robots.txt |
|
Version:
|
2.0 |
|
File Size:
|
2.8 MB |
Robots.txt
Free Download |
|
OS Support:
|
Win98,WinME,WinNT 4.x,Windows2000,WinXP,Windows2003 |
|
Limitations:
|
Free to try |
|
Date Added:
|
2004-05-01 |
|
Author:
|
http://net-promoter.com/robots-txt/index.htm |
|
Robots.txt
Description:
|
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions
|
|
