Search This Blog

Monday, August 22, 2011

How to Stop Baidu spider bot?

here are few links that helps you to stop baiduspider and others too...

One of the websites I manage had been experiencing tremendous use in bandwidth. “Sweet!” we thought, a solid boost in traffic is a good thing. But as time went by, it kept going up and up in an unreal way - something was awry. After checking the log files, I saw that the 3 bots mentioned above seemed to be literally attacking the website. After some Googling, I found that some or all of these robots have run amuck on other websites too, and are generally worthless as far as supplying any valuable traffic - so I just blocked them all by placing the following in my .htaccess file:

Stop unwanted Spiderbots
2nd Link to stop spiderbots

If your site is on an Apache server, you can block using mod_rewrite via .htaccess:
[code]
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} ^Baiduspider [NC]
RewriteRule .* - [F]
[/code]

----------------------------------------------------------------
We have launched Taxi Website Designer.com in North America

No comments:

Post a Comment

content-wide advt