news

Yahoo! Launches New Crawler

Yahoo! launched a new Yahoo! Search Crawler, Yahoo! Slurp earlier this week. In addition to crawling the Internet faster, the new crawler promises to be more efficient at visiting websites. As a result, site owners should notice as much as a 25% reduction in the number of requests and bandwidth consumed by the crawler.

While transitioning to the new crawler over the past few weeks, Yahoo! had been running both crawlers in tandem. In some cases, this increased the frequency of Yahoo Search requests to websites. Now, with the new crawler in full production, Yahoo! has turned off the old crawler and site owners should see a much lower crawl load without a loss in content coverage.

Yahoo! says with this change of behavior in the crawler, website owners may see some shuffling of the pages that are included in the index and some changes in ranking as well.

industry news

The latest search engine market share report is out. See how the search engines rank. (full story)

Yahoo! launches a new web crawler called Yahoo! Slurp promising faster, more efficient crawling. (full story)

Click fraud rate up slightly in the second quarter, especially among high-priced search terms. (full story)



news Yahoo! Launches New Crawler Yahoo! launched a new Yahoo! Search Crawler, Yahoo! Slurp earlier this week. In addition to crawling the Internet faster, the new crawler promises to be more efficient at visiting websites. As a result, site owners should notice as much as a 25% reduction in the number of requests and bandwidth consumed by the crawler. While transitioning to the new crawler over the past few weeks, Yahoo! had been running both crawlers in tandem. In some cases, this increased the frequency of Yahoo Search requests to websites. Now, with the new crawler in full production, Yahoo! has turned off the old crawler and site owners should see a much lower crawl load without a loss in content coverage. Yahoo! says with this change of behavior in the crawler, website owners may see some shuffling of the pages that are included in the index and some changes in ranking as well.	industry news The latest search engine market share report is out. See how the search engines rank. (full story) Yahoo! launches a new web crawler called Yahoo! Slurp promising faster, more efficient crawling. (full story) Click fraud rate up slightly in the second quarter, especially among high-priced search terms. (full story)