Who Does Anubis Stop?

6 points | by ingve 2 hours ago

2 comments

  • bediger4000 8 minutes ago

    Collectively we are wasting an impressive amount of time waiting for access to websites; time we didn’t spend before the AI era. As a human, time is precious and finite to me, whereas to a robot it is not.

    Another sad side-effect of the abysmal ethics of the folks who wrote and run AI-crawlers. They ignored robots.txt, and didn't do any kind of rate limiting, and weren't very good about acknowledging that they were using copyright inputs, so people (justifiably!) implemented some barriers like Anubis. Now we all have to wait for proof-of-work to happen.

    If only "AI" people had taken a clue from existing crawlers, we wouldn't all suffer. But since the entire point of "AI" is to render most people obsolete or inefficient, I suppose the imperative is to just go ahead and vacuum up all the text every written 3 or 4 times a day.

  • 26 minutes ago
    [deleted]