I upgraded my site the other day and I forgot to check my robots.txt file afterwards. Of course, the new upgrade overwrote the old file, which meant the rule that says "Piss off Search Engines" was overwritten with one that said "Welcome, please scan my whole diary and make it searchable!"
I just wish there was some way to tell search engines "Piss off" without having to remember to keep a stupid file updated.
Add new comment