4.11.2008

ok... it looks like slurp is obeying the robots.txt file now... but it looks like it took about 7 hours to take effect.

No comments: