• Fighting Malicious AI Scrapers With More AI - My thoughts

    From 6R1MR34P3R@6r1mr34p3r@yourtimehascome.sbs to hispagatos.talk,alt.2600 on Friday, March 28, 2025 05:02:44
    From Newsgroup: alt.2600

    Fighting Malicious AI Scrapers With More AI https://invidious.privacyredirect.com/watch?v=P4DmdXXISz4

    You've probably heard of FOSS platforms being attacked by AI scrapers
    and there being mitigations in place to stop them but how do these
    mitigations actually work.

    ==========Resources==========
    Nicco Video: https://invidious.privacyredirect.com/watch?v=cQk2mPcAAWo LibreNews Article: thelibre.news/foss-infrastructure-is-under-attack-by-ai-companies
    Anubis: github.com/TecharoHQ/anubis
    Haproxy-protection: gitgud.io/fatchan/haproxy-protection
    Anubis Docs: anubis.techaro.lol/docs/design/why-proof-of-work
    Ai Robots Txt: github.com/ai-robots-txt/ai.robots.txt
    AI Labyrinth: blog.cloudflare.com/ai-labyrinth
    Nepenthes: zadzmo.org/code/nepenthes

    ================================================================================
    here we go again with another AI post, but don’t get me wrong, i don’t hate AI.
    i hate proprietary AIs and lazy people who rely on them for coding
    instead of learning how to code themselves.

    the whole scraping thing? it’s beyond dystopian.
    these bots aren’t even bothering to respect robots.txt or ai.robots.txt, even though these standards exist.
    it’s like they don’t care at all.

    maybe we should try and force our governments to create some kind of
    lawsuit to make these bots listen to the standards.
    i’m no fan of governments either, but honestly, it seems like the only "simple" solution that comes to mind.
    this tech is only going to get better over time, and no matter what we
    do, these bots will keep infringing on and making a mess of the
    open-source ecosystem.

    it’s frustrating as hell, but if we don’t stop this, we’ll see more and more damage done to libre software.
    as of now we can mitigate this but what about the future?

    Fuck Sam Altman BTW
    --- Synchronet 3.20a-Win32 NewsLink 1.114