Search This Blog

Loading...

Amazon Super Saver

Monday, August 22, 2011

How to Stop Baidu spider bot?

here are few links that helps you to stop baiduspider and others too...

One of the websites I manage had been experiencing tremendous use in bandwidth. “Sweet!” we thought, a solid boost in traffic is a good thing. But as time went by, it kept going up and up in an unreal way - something was awry. After checking the log files, I saw that the 3 bots mentioned above seemed to be literally attacking the website. After some Googling, I found that some or all of these robots have run amuck on other websites too, and are generally worthless as far as supplying any valuable traffic - so I just blocked them all by placing the following in my .htaccess file:

Stop unwanted Spiderbots
2nd Link to stop spiderbots

If your site is on an Apache server, you can block using mod_rewrite via .htaccess:
[code]
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Baiduspider [NC]
RewriteRule .* - [F]
[/code]

----------------------------------------------------------------
We have launched Taxi Website Designer.com in North America

0 comments:

Post a Comment