Results 1 to 6 of 6

Thread: Bing's crawler still slow?

  1. #1
    tmongy's Avatar
    tmongy is offline Net Builder
    Join Date
    Dec 2008
    Location
    Cairo, Egypt
    Posts
    299
    Thanks
    153
    Thanked 102 Times in 68 Posts

    Bing's crawler still slow?

    I've always been convinced that one of the main flaws of Microsoft's search engine, aside from its crappy results, was how slow the crawler was in searching and indexing new sites.

    Although I can definitely see that Bing is a big improvement over Live search, I am still not impressed with the crawler's speed. I wonder if Microsoft has worked on it or if they focused solely on the search interface and algorithm?

    Do you notice anything different with Bing's crawler? Would you say it has improved or not?

  2. #2
    Aquarezz's Avatar
    Aquarezz is offline Master Net Builder
    Join Date
    Dec 2008
    Location
    Belgium
    Posts
    3,853
    Blog Entries
    4
    Thanks
    683
    Thanked 591 Times in 463 Posts
    Hmmm.. I haven't really analyzed it, but it's a fact that when I create new websites/blogs they're listed faster in Google than in Bing. I don't know about the crawls after the site has been listed though..
    |Nico Lawsons

  3. #3
    Keldorn's Avatar
    Keldorn is offline Net Builder
    Join Date
    Dec 2008
    Location
    Canada
    Posts
    400
    Thanks
    21
    Thanked 60 Times in 52 Posts
    I feel the same way. LiveSearch bot never indexed anything new.
    But Bing to catch up too Google now would require much bandwidth. In fact, it probably would have to like rape (i.e Super Abusively Crawl) the entire internet to make up for Years of non-crawling. If it were get everything update within a reasonable time frame. I guess its just something they'll have to figure out, but its really Microsoft's fault for slacking off with their bots all these years.
    Submit new proxies -

  4. #4
    Digital's Avatar
    Digital is offline Unites States of America
    Join Date
    May 2009
    Location
    Mars
    Posts
    456
    Blog Entries
    2
    Thanks
    54
    Thanked 71 Times in 59 Posts
    And I feel like the products of Microsoft get indexed fast in Bing !
    When once I used a post regarding Microsoft I got many searches in Bing.

    - Digital -

  5. #5
    Keldorn's Avatar
    Keldorn is offline Net Builder
    Join Date
    Dec 2008
    Location
    Canada
    Posts
    400
    Thanks
    21
    Thanked 60 Times in 52 Posts

    Wink

    I came across this post by the owner of Digitalpoint saying the Bing Bot is being too aggressive trying index his site.
    [ame="http://forums.digitalpoint.com/showthread.php?t=1439427"]MSNBot being too aggressive?[/ame]

    Quote Originally Posted by Digitalpoint Owner
    MSNBot was crawling at a rate of 1,287,360 pages per day
    I was right that Bing is going to have abusively crawl the entire internet.
    Submit new proxies -

  6. #6
    tmongy's Avatar
    tmongy is offline Net Builder
    Join Date
    Dec 2008
    Location
    Cairo, Egypt
    Posts
    299
    Thanks
    153
    Thanked 102 Times in 68 Posts
    Seems DP are having the opposite problem with MSNBot!

    Microsoft really need to improve their crawler in a big way before they can ever hope to compete with google.

    Hopefully they will be replacing their own bot with Yahoo's slurp as it is definitely the superior crawler.

Similar Threads

  1. [Bug] Getting slow.
    By Mike30 in forum Announcements and Suggestions
    Replies: 10
    Last Post: 16 May, 2011, 11:14 AM
  2. Need a Website Crawler
    By bhartzer in forum On-Site SEO
    Replies: 4
    Last Post: 3 January, 2011, 02:12 AM
  3. Search Engine Crawler and Spider
    By joy1986joy in forum Promoting
    Replies: 4
    Last Post: 20 July, 2010, 14:20 PM
  4. How Slow is Your Web Site?
    By Will.Spencer in forum Managing
    Replies: 21
    Last Post: 31 March, 2010, 08:27 AM
  5. Microsoft Bing Sued by Bing LLC
    By ruben in forum Search Engine News
    Replies: 7
    Last Post: 26 December, 2009, 10:05 AM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •