Home

What is a Web Crawler

2013 data:

Name           % of Sites   Type
--------------------------------------------------------
Googlebot         96%       Search Bot
Baidu Spider      89%       Search Bot
MSN Bot/BingBot   82%       Search Bot
Yandex Bot        73%       Search Bot
Soso Spider       61%       Search Bot
ExaBot            35%       Search Bot
Sogou Spider      31%       Search Bot
Google+ Share     24%       Crawler
Facebook          24%       Crawler
Feedfetcher       22%       Feed Fetcher (Google Reader)

Source: Top 10 Bots