5 people following this project (follow)

Description

net.png

.Net framework don't provide function for robots.txt support. This library provide robots.txt as define in rfc http://www.robotstxt.org/wc/norobots-rfc.txt

Last edited Jan 30 at 8:47 PM by vodevil, version 20