Files Repository
Robots.txt editor 2 Full Description:
This program is a visual editor for Robot Exclusion Files and log analyzer software. It allows the user to quickly and easily create the robots.txt files required to instruct web search engines which parts of a web site are not to be indexed and made searchable by the general web public and then to identify spiders, which do not keep to those instructions. The program does this by providing the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.
Keywords: spider visits, robot exclusion, search engines, ftp, netpromoter, spider instructions, spiders, site optimization, web search engines, robots txt editor, robot exclusion files, txt files, exclusion files, txt editor, robots txt, log file analysis
Release Date :
2004-05-01
Program Cost :
99.90$
Operating System :
windows2003, winme, winnt 4 x, winxp, windows2000, win98
Company :
Company Web Site :
http://pagepromoter.com
Language :
russian, english
Requirements :
Windows 9x, NT,ME,2000/XP