Most Googlebots Are Fake

6 points | by bobbiechen 2 hours ago

2 comments

  • KomoD an hour ago

    > Chris Siebenmann theorizes that “it’s a large scale campaign by a single abusive crawler by people who can afford to obtain a lot of servers at a lot of different hosting providers”, rather than a widespread rise in popularity for an old trick.

    And apparently also thinks every person using an older browser version is a bot, I guess.

    https://utcc.utoronto.ca/~cks/cspace-bad/cspace-old-browser....

    I don't understand why the page even links to other stuff... I can't access those either because they just redirect back to that page

      bobbiechen 11 minutes ago

      That's a shame, I wonder where he draws the line.

      While herding to the majority of latest Chrome makes his life easier, there really is a very long tail of real users who are not there. I get way too many challenges on my personal laptop running Firefox on Ubuntu (including infinite redirect loops).