.. Google crawls FTP?

August 23rd, 2005 by Josh Houghtelin

I'm not sure what to think. I don't provide anonymous FTP. Does google just randomly crawl FTPs?

It kept popping up for a while but I lost count since cron keyed in webalizer spam. I need to get another IP, give it a name like crawl_532432.burnmytime.com and let it run rampant randomly archiving everything in a “I want to mirror where everything is on the net” manner.
—-
Note: After the webalizer spam subsided, google bot continued spamming ftp.

Posted in Websites


(comments are closed).