Results 1 to 4 of 4

Thread: Microsoft Bot pretending to be Google Bot ?

  1. #1
    Mike-XS's Avatar
    Mike-XS is offline XeroAgent
    Join Date
    Sep 2009
    Location
    OZ
    Posts
    209
    Thanks
    30
    Thanked 109 Times in 71 Posts

    Microsoft Bot pretending to be Google Bot ?

    I can only guess why Microsoft keeps sending out the MSN bot as Googlebot [ apparently Mediapartners-Google is the Adsense bot ]..

    This has being going on for a while. This is from today.

    403 User-Agent claimed to be Googlebot- claim appears to be false.
    Agent: Mediapartners-Google
    207.46.204.103 msnbot-207-46-204-103.search.msn.com

    403 User-Agent claimed to be Googlebot- claim appears to be false.
    Agent: Mediapartners-Google
    207.46.204.53 msnbot-207-46-204-53.search.msn.com

    403 User-Agent claimed to be Googlebot- claim appears to be false.
    Agent: Mediapartners-Google
    207.46.204.96 msnbot-207-46-204-96.search.msn.com

    403 User-Agent claimed to be Googlebot- claim appears to be false.
    Agent: Mediapartners-Google
    207.46.204.103 msnbot-207-46-204-103.search.msn.com
    I'll keep blocking that confused Msnbot until those guys at Microsoft who are running it remember who they work for..

    I can only guess at the reasons behind it..

    Maybe because Microsoft just doesn't have the same access to sites that people extend to the googlebot, they are jealous of that, so someone decided to switch over the MSNbot useragent to something more successful. eg: googlebot.

    This would be a perfect example of that old saying, "if you can't beat them, join them".

    Possibly Microsoft has been hacked into again and their Msnbot has been hijacked, now being run by hackers to collect data..

    Is it some advertising deal with Google or just a useragent ripoff. ?

    Can anyone think of other reasons why Microsoft would need or want to do this with the poor old msnbot ?


  2. #2
    Andy101's Avatar
    Andy101 is offline Code Otaku
    Join Date
    Aug 2009
    Location
    Kanazawa
    Posts
    1,314
    Thanks
    178
    Thanked 309 Times in 236 Posts
    Maybe the ip address that suggests that it is the msnbot initially is not trustworthy and is set up to trick the bad bot tracker?
    Otaku CMS - Import a WordPress blog and manage your site using single-page App technology
    Angular Skills - new site about Front-end App. programming

  3. #3
    TopDogger's Avatar
    TopDogger is online now Über Hund
    Join Date
    Jan 2009
    Location
    Hellfire, AZ
    Posts
    3,107
    Thanks
    350
    Thanked 919 Times in 703 Posts
    I checked the IP addresses. They are assigned to Microsoft.

    Mike, what tool are you using that is snagging those bots and displaying the messages?

    I use bot-trap on several of my sites. Microsoft spiders frequently ignore the robots.txt file and get banned by bot-trap. I have never had a problem with Google or Yahoo spiders.

    I wonder if they licensed the use of an ad spider from Google and did not change the user agent.
    "Democracy is two wolves and a lamb voting on what to have for lunch. Liberty is a well-armed lamb contesting the vote." -- Benjamin Franklin


  4. #4
    Mike-XS's Avatar
    Mike-XS is offline XeroAgent
    Join Date
    Sep 2009
    Location
    OZ
    Posts
    209
    Thanks
    30
    Thanked 109 Times in 71 Posts
    Those bots are being caught by BadBehavior.

    Here's what it looks like in the logs:

    msnbot-207-46-204-102.search.msn.com - - [06/Nov/2010:00:41:40 -0500] "GET /index.php HTTP/1.1" 403 1693 "-" "Mediapartners-Google"
    msnbot-207-46-204-96.search.msn.com - - [06/Nov/2010:00:41:48 -0500] "GET / HTTP/1.1" 200 15963 "-" "Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)"
    msnbot-207-46-204-96.search.msn.com - - [06/Nov/2010:00:43:04 -0500] "GET / HTTP/1.1" 403 1683 "-" "Mediapartners-Google"
    msnbot-207-46-204-139.search.msn.com - - [06/Nov/2010:00:44:07 -0500] "GET /index.php HTTP/1.1" 403 1693 "-" "Mediapartners-Google"
    msnbot-207-46-204-53.search.msn.com - - [06/Nov/2010:00:46:45 -0500] "GET /index.php HTTP/1.1" 403 1692 "-" "Mediapartners-Google"
    Found some more about cloaked msnbots here:
    MSN's many cloaked bots. Again. Search Engine Spider and User Agent Identification forum at WebmasterWorld

Similar Threads

  1. Microsoft Ad Intelligence
    By Will.Spencer in forum Keyword Research
    Replies: 1
    Last Post: 16 April, 2010, 05:35 AM
  2. Microsoft adCenter??
    By ivan in forum Monetizing
    Replies: 6
    Last Post: 29 December, 2009, 21:25 PM
  3. Microsoft Skewers Google
    By Will.Spencer in forum Search Engine News
    Replies: 2
    Last Post: 30 March, 2009, 12:13 PM
  4. Microsoft adCenter
    By Shenron in forum Monetizing
    Replies: 3
    Last Post: 25 March, 2009, 13:58 PM
  5. Replies: 13
    Last Post: 1 March, 2009, 14:22 PM

Tags for this Thread

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •