• MagicShel@lemmy.zip
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 days ago

    I didn’t downvote, as I don’t do that to comments that show thoughtful effort, whether I disagree or not. And I’m certainly not in lockstep with Lemmy on AI, so I can’t speak for anyone but me.

    There are some places I agree, and some I don’t. First, I agree that the three laws are a good idea. However, they are compressed in human language and it is unsurprisingly ambiguous as to the meaning of harm. While harm is often unambiguous, I have a feeling if you could somehow survey the world on all possible actions, no two people would completely agree on what is harmful. If we can’t clearly define it for ourselves, we certainly can’t choose to it or create an AI that agrees. So as nice as the idea of the three laws is, they are not feasible.

    I think you are spot on about trust and AI. My computer has prompted me a thousand times for approval of some innocuous text expansion in a cli command. It has never attempted something I didn’t want. I do often have to go back and change how it has done something. And I run frequent scans for alignment of documentation so that I can be sure someone looking at the acceptance criteria doesn’t come away with a different idea than someone who looks at the diagrams.

    But we diverge on matters of responsibility. I think it must be incumbent upon the person using the AI to understand the fundamental flaws of such systems. And I think a company that provides unreviewed AI output must ensure users are aware that output can be harmful or incorrect. Ultimately the nature of these systems can only approximately comply with lack of harm.

    I think responsibility comes once you present AI output to something who doesn’t consent or understand AI. (Side note: making it a requirement that a user must be 18 to be provided AI output might fix a lot of issues because for example customer service bots can’t guarantee a caller is over 18.)

    The ways to use AI are myriad and it’s impossible to know how “come home to me” (the text which encouraged one of the suicides) is going to be taken by the user. In fact, I’d interpret that phrase as imploring the user to stay alive.

    Ultimately, “no harm” can never be guaranteed because life is subjective. And no AI can be rendered harmless yet still do anything useful. That’s why human judgment and skepticism is needed on the output. I am hopeful AI can be fully democratized, but critical thinking is always required, just like the time I had a high school teacher tell me blind people can see through a sort of third eye.

    That doesn’t obviate the AI company of any responsibility whatsoever, but I think it’s fine to hold them to standards of reasonable effort to mitigate foreseeable harms.

    • Buffalox@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      edit-2
      2 days ago

      Thanks for the good constructive response. 👍

      a company that provides unreviewed AI output must ensure users are aware that output can be harmful or incorrect.

      I agree, and then we should require such warnings for every AI response, kind of like we have on cigarettes.
      Meaning the responsibility to warn about harmful effects is up to the company offering the service, not for the user to assume.

      I think responsibility comes once you present AI output to something who doesn’t consent or understand AI.

      Which means 99.9% of the users currently using AI, or unknowingly exposed to it through services that use AI without it being clear.

      • MagicShel@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        2 days ago

        Which means 99.9% of the users currently using AI, or unknowingly exposed to it through services that use AI without it being clear.

        It’s tricky, you know? IMO, you can’t democratize AI (which IMO we must do) if you need some sort of IQ test to be allowed to use it. A checkbox acknowledging risk acceptance is insufficient. But also, yes, you have to have some awareness of what AI even is or you are at risk of being harmed.

        • Buffalox@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          2 days ago

          you have to have some awareness of what AI even is or you are at risk of being harmed.

          Yes that’s how it is, but that should not be the case, AI should legally be considered like asking expert advice, like asking a lawyer or a doctor, those are not considered risks, because they have legal responsibility for their advice. The same must be the case for AI, AI must have similar legal responsibility covered by the company offering the AI service.

          If AI responses can’t be trusted and are false information, it’s not a service but a disservice. It can never be the case that normal users should have particular skills to use an AI service. That’s legally a slippery slope we should absolutely refuse to allow.

          • MagicShel@lemmy.zip
            link
            fedilink
            English
            arrow-up
            2
            ·
            2 days ago

            AI should legally be considered like asking expert advice, like asking a lawyer or a doctor

            That is impossible. AI has no consciousness or ability to reason about the answers it is giving. Without a thinking domain expert between the user and the AI, this simply cannot be done.

            If AI responses can’t be trusted and are false information

            AI response can’t be trusted. Everyone should know that. There is no possible way to design a system where AI can be trusted. Hell, you can’t even design a system where a human can be trusted to be infallible.

            You don’t need a particular skill to use AI as a service — which isn’t to say the results are going to be worth a crap if you aren’t a domain expert. Anyone can ask AI to build a web service and get it approximately correct, but you need someone who knows how to build a web service to tell the AI what it needs to build it correctly.

            But one does need to understand that the output from AI should only be used when the marginal cost of failure is near-zero.