Artificial intelligence labs are in a new arms race to buy up millions of rare books, slicing them open, scanning the pages and pulping the remains — sparking concerns that the last remaining copies of out-of-print texts are being destroyed on an industrial scale.

ISBNdb notes that “print books from the pre-LLM era are structurally guaranteed to be free of this contamination”.

“Millions of the most valuable books have never been digitised. They exist only in physical form, scattered across library shelves, used bookstores, and out-of-print catalogues. We get them to you at scale.”

  • whereitsat@lemmy.zip
    link
    fedilink
    English
    arrow-up
    4
    ·
    edit-2
    6 hours ago

    doubt many ‘of the most valuable’ books haven’t been digitized or aren’t available on amazon or ebay for a pittance. when i need to find something on anna’s archive, it’s usually because it’s some bullshit, tween pulp romance novel from the late 70’s.

  • ranzispa@mander.xyz
    link
    fedilink
    English
    arrow-up
    3
    ·
    9 hours ago

    But then they upload them to Anna’s archive, right?

    This could actually be a great initiative if they made them public or at least gave the scans to some Library.

  • RememberTheApollo_@lemmy.world
    link
    fedilink
    English
    arrow-up
    27
    ·
    edit-2
    24 hours ago

    Because when you destroy the publicly available source you become the only available source. Paid, of course.

    The final nail in the coffin for humanity, locking knowledge behind digital sources that are inaccessible in event of catastrophe.

    • motruck@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      7 hours ago

      Crazy how we had all this information available and all we did was lock it up and make it for sale. The internet was an awesome place we shared ideas easily and without massive corporate “sponsors” now the owners of the internet are the corporations and they are just riding t till the wheels fall off.

  • Psythik@lemmy.world
    link
    fedilink
    English
    arrow-up
    39
    arrow-down
    3
    ·
    edit-2
    1 day ago

    “I personally have mixed feelings about all of this,” one small bookseller told tech news website 404 Media last week.

    The bookseller explained that in April, he suddenly went from selling around 20 books per week to hundreds — including obscure and out-of-print works.

    “It benefits me financially as well as by clearing out old inventory that is otherwise unlikely to sell,” he said. “I’ve been well suited for these sales with inventory from overseas and foreign language books. On the other hand, I don’t like the end-use, and I don’t like that uncommon books are being pulped.”

    Then stop selling rare and out of print books to an AI company, you fucking doorknob.

    Greed knows no bounds.

    • notgold@aussie.zone
      link
      fedilink
      English
      arrow-up
      6
      ·
      12 hours ago

      How would a book seller know? Orders increase and you find out afterwards why. Bit hard to know ahead of time

  • bthest@lemmy.world
    link
    fedilink
    English
    arrow-up
    22
    ·
    edit-2
    1 day ago

    Combine this mass burning of humanity’s canon with the onslaught of AI generated nonsense and think about what is doing to do our history and knowledge going forward.

    Humanity is being dragged into a black hole by tech-fetishist demons.

    • benjirenji@slrpnk.net
      link
      fedilink
      English
      arrow-up
      3
      ·
      14 hours ago

      It’s a second dark age approaching. It’s slow, maybe not in our lifetime but with the enormous pressure of climate and demographic crisis add the regression of human cognition and destruction of researchable truth and you will get a collapse of the global economy and a shift in priorities (survival first) that will bring a dark age.

      • JcbAzPx@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        6 hours ago

        If they are successful in destroying all print sources of knowledge, technically we are already in the dark age.

    • JcbAzPx@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      6 hours ago

      They want to be the sole arbiter of all knowledge. Kind of hard to do that when the books they stole from still exist.

  • unwarlikeExtortion@lemmy.ml
    link
    fedilink
    English
    arrow-up
    15
    ·
    1 day ago

    To be honest, I’d be MUCH less against this practice if this shredding at the very least included saving the original scans at at least 300 dpi for everyone to access, freely.

    Ideally, they wouldn’t cut them by the spine, but even giving the despined ones to an archive/library would be just above the unpermissible line.

    Despining, scanning and public access archiving is borderline permissible.

    • JackbyDev@programming.dev
      link
      fedilink
      English
      arrow-up
      9
      ·
      24 hours ago

      Also, if every AI company does this, then it’s more books gone. If they cooperated they’d only need to do it once. Good scans of all books in the public domain would be so useful for us all as society.

      • Armok_the_bunny@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        8 hours ago

        While that would be nice, unfortunately it would almost certainly run into the very same legal issues that are also causing them to pulp the books after scanning them.

          • Armok_the_bunny@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            4 hours ago

            IIRC destruction of the physical copy to prevent resale while still possessing a copy is required for book scanning to be free use, or otherwise not encounter problems with copyright law. Proceeding to share/distribute those scans, or especially trying to charge money for them, would encounter those exact same copyright barriers.

            • JackbyDev@programming.dev
              link
              fedilink
              English
              arrow-up
              2
              ·
              4 hours ago

              Oh, maybe. Even then, for things in the public domain this shouldn’t matter. I know that’s probably not the majority of what they’re scanning though.

              • Armok_the_bunny@lemmy.world
                link
                fedilink
                English
                arrow-up
                1
                ·
                52 minutes ago

                I would assume they aren’t bothering to scan it if it’s in the public domain. Much easier to just grab a copy off archive.org or any other website hosting such things, and that’s assuming the entirety of the public domain isn’t already in the training set.

  • Elrecoal@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    edit-2
    24 hours ago

    Drive up demand for the info in those books while being the only ones with the info…

  • Seth Taylor@lemmy.world
    link
    fedilink
    English
    arrow-up
    51
    arrow-down
    3
    ·
    2 days ago

    You have got to be fucking kidding me

    You people have no idea how much I want AI banned all across everything. I don’t care about anything at this point. These people are EVIL EVIL EVIL EVIL. Pure breed CRIMINALS

    Fucking 90% of the books I read are “rare”

    “Oh, but there’s SOME benefits to having AI”, says some person on the internet that had it shoved down their throat by their boss. No. Fuck you. Fuuuuuuck you all the way.

    • UnderpantsWeevil@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      23
      ·
      1 day ago

      Fucking 90% of the books I read are “rare”

      That’s sort of the joke. These aren’t treasured first editions. They’re not shredding the Guttenburg Bible. These are single prints sitting in warehouses and abandoned libraries or dumps that nobody has read or carried about in decades. They’re rare because they never got a second edition.

      And the process of digitizing the book means disassembling it. So the copy (that nobody wanted) is destroyed as a result.

      The article is pure clickbait. These books aren’t valuable, save that they were produced pre-AI. That’s why you can get them in bulk on the cheap.

      • MinnesotaGoddam@lemmy.world
        link
        fedilink
        English
        arrow-up
        11
        ·
        edit-2
        1 day ago

        idk dude. i have a rare first edition that i absolutely treasure. single run, too. it’s a local therapist’s little comic book he drew. he gave a copy to my mother when her parents were divorcing. really effective at explaining masking, just uses different words.

        if someone took my copy and pulped it, i’d [disproportionate response. very disproportionate response]

        • UnderpantsWeevil@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          4
          ·
          1 day ago

          i have a rare first edition that i absolutely treasure. single run, too. it’s a local therapist’s little comic book he drew.

          Cool, I guess. How many of these did the AI company destroy?

          My niece wrote a ten page short story, had it bound, and added it to her school’s library - a project every kid in her grade level did. If she doesn’t claim it before she graduates, it goes into an archive. And eventually on to a dump.

          if someone took my copy and pulped it

          If they snuck into your room at night, sure. If they walked off with it from a yard sale, idk if you get to complain.

          • MinnesotaGoddam@lemmy.world
            link
            fedilink
            English
            arrow-up
            5
            arrow-down
            1
            ·
            1 day ago

            Okay, now consider my nonexistent idiot sister (my sisters are all cool as fuck) stole my copy, how family does. And I ran the first search in a decade for this book, and the rare bookshop that got pulped last week has (had) the only other extant copy. And then my nonexistent idiot sister died in a fire with my book. See why I might be mad at this straw man?

        • Rekorse@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          3
          arrow-down
          3
          ·
          1 day ago

          Presumably everyone who would have a personal connection to these destroyed books, already has one.

          I dont think AI companies are stealing peoples personal collections while they sleep.

          Just to be clear though, fuck AI and those involved.

            • Rekorse@sh.itjust.works
              link
              fedilink
              English
              arrow-up
              4
              arrow-down
              4
              ·
              1 day ago

              That’s how life works, people come and go. We can’t remember every single person that’s ever lived forever, but people can have keepsakes of those important to them in their lives.

              Its not sad that more people didnt get to make that specific connection, because there are countless opportunities to connect with people now.

              • lightnsfw@reddthat.com
                link
                fedilink
                English
                arrow-up
                6
                arrow-down
                1
                ·
                1 day ago

                Books aren’t people. They can last a lot longer if properly cared for and not burnt to feed a slop machine.

                • Rekorse@sh.itjust.works
                  link
                  fedilink
                  English
                  arrow-up
                  2
                  arrow-down
                  3
                  ·
                  1 day ago

                  Books are important because of their human connection. If there is none left to have then its functionally worthless.

                  I think its a bit egocentric to think our thoughts will be important forever

      • Jason2357@lemmy.ca
        link
        fedilink
        English
        arrow-up
        21
        ·
        1 day ago

        They are buying up used books at rates that push up the cost of used books. That is enough to piss off people legitimately.

        We also are fully aware they are not careful. Yes, they will occasionally shred the last few examples of a book that might have otherwise become useful in the future, and there’s no indication that they are archivists. They will eventually destroy or loose this training data and the book contents will be gone to future generations.

        • UnderpantsWeevil@lemmy.world
          link
          fedilink
          English
          arrow-up
          4
          arrow-down
          11
          ·
          1 day ago

          They are buying up used books at rates that push up the cost of used books.

          Used books are practically free to begin with. Libraries will often give away whole storage containers of books that they don’t want anymore. Bookstores will sell books for pennies on the wholesale market.

          Half-Price offers Books By The Yard to be used entirely for decorative purposes. $50 for 40-60 books, largely organized by color and binding style.

          a book that might have otherwise become useful in the future

          We have vastly overproduced the physical reading material relative to consumer reading habits. We have vastly overproduced certain genres and subject matter material. We have overproduced individual volumes. These books are not useful in any material sense. No more than the clothes we overproduce or the snacks we overproduce or the automobiles and electronics we overproduce.

          We are swimming in trash. We produce mountains of it. We fill ravines with it. Stop treating hording as a virtue.

          • MinnesotaGoddam@lemmy.world
            link
            fedilink
            English
            arrow-up
            7
            arrow-down
            1
            ·
            1 day ago

            Used books are practically free to begin with

            if you want any old used book, sure. if you want a specific used book, maybe you might have to spend ten to twenty to a thousand (i have needed some rare texts over the years).

            • UnderpantsWeevil@lemmy.world
              link
              fedilink
              English
              arrow-up
              2
              arrow-down
              4
              ·
              1 day ago

              you want a specific used book, maybe you might have to spend ten to twenty to a thousand

              Show me the thousand dollar copy that an AI company destroyed and we can revisit this.

              Nothing in the article identities an actual valuable work being destroyed. They’re just “rare”, which can be anything from unpublished manuscripts of failed writers to drafts of screenplays that never got produced to limited run publications that never sold a copy.

              • MinnesotaGoddam@lemmy.world
                link
                fedilink
                English
                arrow-up
                5
                arrow-down
                2
                ·
                1 day ago

                Show me the thousand dollar copy that an AI company destroyed and we can revisit this.

                Now you’re just being argumentative. It’s destroyed. How can I do that?

  • Uriel238 [all pronouns]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    63
    ·
    2 days ago

    Does anyone remember circa 2014 that radical jihadists in the middle east were destroying ancient and medieval artifacts, including stone heads? And I remember here in the liberal west we thought that was awful.

    This is not the only thing that makes me think of that. Also Trump’s recent calls to reduce the size of US national parks and open them up to oil and uranium mining exploitation.

    • FinishingDutch@lemmy.world
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      5
      ·
      2 days ago

      Yeah we remember. Because that’s a literal fucking warcrime. You’re not allowed to destroy historical sites.

      While I agree that destroying books is bad - even common ones - it’s also not technically illegal. If I want to burn a first edition of whatever book worth thousands of dollars… I’m legally allowed to do that.

      I can also see the benefit of having a digital version of a rare book that can be enjoyed by thousands as opposed to sitting on a shelf. But yeah, definitely hold companies accountable for destroying them. There has to be a better way to do that work and still have a useable book afterwards.

      • altkey (he\him)@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        11
        ·
        2 days ago

        The point of bookburning is that it would only be accessible to AI, bringing forth it’s monopoly on said first edition. No one would upload it to IA in the process. It is deleting one source of knowledge out of existence.

      • WaxRhetorical@lemmy.world
        link
        fedilink
        English
        arrow-up
        12
        ·
        2 days ago

        I don’t trust AI companies to not alter the texts of those books if there’s something in them that does not align with their worldview.
        So any book added to the online archive(s) by these companies is suspect.

      • Jason2357@lemmy.ca
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 day ago

        If they were archiving digital versions so they could be read by thousands in the future, this would be a totally different conversation.

        They don’t even need to be as selfless as the internet archive - just follow Googles lead and allow people to search and view selections the archive, with automatic opening of the archive when you are confident copyright is expired. Even a closed archive owned by a third party with a dead mans switch to open it in the future when the business model is done would be something.

        • boonhet@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          1
          ·
          1 day ago

          If they were archiving digital versions so they could be read by thousands in the future, this would be a totally different conversation.

          Unfortunately that would be illegal.

        • Jason2357@lemmy.ca
          link
          fedilink
          English
          arrow-up
          1
          arrow-down
          1
          ·
          1 day ago

          That is the justification and not the reason. Its faster and cheaper to cut the bindings, and they would have to store the books while they are using the digital copies to comply with copyright.

    • Kairos@lemmy.today
      link
      fedilink
      English
      arrow-up
      1
      arrow-down
      14
      ·
      2 days ago

      Random bulk rate books aren’t artifacts. The vast majority of them probably have a copy in Anna’s Archive.

      • mirshafie@europe.pub
        link
        fedilink
        English
        arrow-up
        29
        ·
        2 days ago

        If they did have a copy in Anna’s Archive, why the fuck would AI companies find physical copies, buy them, rip them apart, scan them, and then digitize them before destroying them?

        Remember, you don’t get the digital copy. It’s only used to train their models.

        • Jason2357@lemmy.ca
          link
          fedilink
          English
          arrow-up
          5
          ·
          1 day ago

          Absolutely. Every AI company has Anna’s Archive in their training data already. They want to differentiate their models by having more training data than their competitors. There are way more books out there that have never been scanned than those that have.

          • Kairos@lemmy.today
            link
            fedilink
            English
            arrow-up
            2
            ·
            1 day ago

            OpenAI just settled out of court for $1.5 Billion perhaps some see this as a way to avoid that legal exposure. But IDK.

      • stoy@lemmy.zip
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        2 days ago

        The use of the word “rare” implies that they are not bought in bulk…

        • BassetHound@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          2
          arrow-down
          8
          ·
          2 days ago

          Rare doesn’t necessarily mean culturally valuable. How many of these rare books are actually just old instruction manuals, travel guides, training materials, phone books, and dictionaries?

          • stoy@lemmy.zip
            link
            fedilink
            English
            arrow-up
            10
            arrow-down
            2
            ·
            2 days ago

            The issue with that is that we don’t yet know what is culturally valuable or not.

            Just because we don’t see a need for the specific book now, doesn’t mean it won’t change tomorrow.

          • Leon@pawb.social
            link
            fedilink
            English
            arrow-up
            6
            arrow-down
            1
            ·
            edit-2
            2 days ago

            Why are you so intent on riding big corpo cock? Do you think daddy Altman is going to praise you, call you his good girl?

            You don’t actually need to play devil’s advocate, you know.