• Brewchin@lemmy.world
    link
    fedilink
    English
    arrow-up
    0
    ·
    17 hours ago

    FTA: After being told no, Anthropic are suggesting, with a straight face, use of robots.txt to let them know what they can and cannot slurp for free. The same file that has existed for many years and which, famously, has been ignored by their crawlers from the very beginning.

    “Okay, so your front door is locked. But have you considered leaving a key under the mat? Just in case…” 🙄