Preventing your site from being indexed, the right way
(JoostdeValk) It keeps amazing me that I keep seeing people use robots.txt files to prevent sites from being indexed and thus showing up in the search engines. You know why it keeps amazing me? Because robots.txt doesn't actually do the latter, even though it does
Update update feed set failed_fetches=0, fetched=current_timestamp() where feed_id = 3489 failed: 1142 [UPDATE command denied to user '334187_hdlns_ms5'@'10.187.248.89' for table 'feed'] in [update feed set failed_fetches=0, fetched=current_timestamp() where feed_id = 3489]
updated 3489 (Joost de Valk), inserted 3, updated 0, at 2012-05-29 02:26:36
