Googlebot (Deepbot and Freshbot)
1. Google call its spider "Googlebot"
2. crawler.googlebot.com – FreshBot
3. crawl.googlebot.com – DeepBot
4. The FreshBot updates existing pages in the Google database for recent changes, while the DeepBot crawls and analyses pages and links from the pages discovered.
5. The FreshBot has temporary results (do not affect the PR of a page or it's general position) while the DeepBot crawls the sites,and after it's work is done new PR are calculated and the dance begins.
6. The deepbot is sent out after each update, it normally takes a few days before it appears.
Sitemap
Ecommerce
Financial
B2B
Free Evaluation
1. Google call its spider "Googlebot"
2. crawler.googlebot.com – FreshBot
3. crawl.googlebot.com – DeepBot
4. The FreshBot updates existing pages in the Google database for recent changes, while the DeepBot crawls and analyses pages and links from the pages discovered.
5. The FreshBot has temporary results (do not affect the PR of a page or it's general position) while the DeepBot crawls the sites,and after it's work is done new PR are calculated and the dance begins.
6. The deepbot is sent out after each update, it normally takes a few days before it appears.
Sitemap
Ecommerce
Financial
B2B
Free Evaluation
0 Comments:
Post a Comment
<< Home