• Mongostein@lemmy.ca
    link
    fedilink
    English
    arrow-up
    31
    arrow-down
    4
    ·
    21 hours ago

    What do you think it was trained on to be able to create child porn? Yes, children were harmed and will continue to be harmed to “improve the model”

    • gagcar@lemmus.org
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      2
      ·
      5 hours ago

      The model knows what kids looks like and it knows what porn looks like. It is now more complex than the thought experiment, “the Chinese Room” because it can interpolate between two things it knows rather than basic request and response.

    • JohnEdwa@sopuli.xyz
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      5
      ·
      edit-2
      9 hours ago

      Were they also trained on the vast quantity of media of gymnasts made out of pasta for them to be able to create videos of that?

      One of the main points of GenAI is the ability to smush multiple concepts together. There are plenty of training data of children that are in swimwear, or just literally naked that has nothing to do with CP, and there’s boatloads naked adults and of course, porn, it can successfully combine them together even if there was no actual CP in there whatsoever.

      • Omgpwnies@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        arrow-down
        1
        ·
        4 hours ago

        And given the internet’s proclivity toward legal “teen/jailbait” porn where the models are of age but focus heavily on child-like features/poses/clothing/etc, there’s literally millions of high-resolution photos that an inference machine could easily stitch together a CSAM image using nothing but legal source images.

    • foggenbooty@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      5
      ·
      7 hours ago

      What? Even if you’re right that CSAM was included in training data (and that’s highly debated), it would absolutely have been inadvertent and due to the Internet dragnet style of training. I don’t know where you get the idea that AI companies would ask for more CSAM and drive up demand to “improve” their model.

    • BrianTheeBiscuiteer@lemmy.world
      link
      fedilink
      English
      arrow-up
      6
      arrow-down
      3
      ·
      20 hours ago

      And use of the model drives demand for it, just like purchasing real CSAM. Even if the subject is now 50 years old, it incentivizes abusers to make new material from people that are currently underage.