• THB@lemmy.world
    link
    fedilink
    English
    arrow-up
    8
    ·
    4 hours ago

    This appears to be impossible with current LLMs. You would need an actual human to verify every possible search result as the LLM is incapable of doing that for itself

    • [deleted]@piefed.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      1 hour ago

      Then LLMs are defective and should not be used as a replacement for web indexes or anything useful.

    • Zwuzelmaus@feddit.org
      link
      fedilink
      English
      arrow-up
      21
      ·
      4 hours ago

      appears to be impossible with current LLMs

      Not the court’s problem.

      “Sorry, your honor, my weapon is that faulty so I can never know who it is who will be killed, but I just had to shoot because that’s how I make my money…”

      • THB@lemmy.world
        link
        fedilink
        English
        arrow-up
        10
        ·
        edit-2
        3 hours ago

        That’s my point, the problem is the LLM itself shouldn’t even be being used to begin with. I’m not defending AI bullshit by any means. I’m saying “truth” or “quality” are not qualities that an LLM will ever possess by its own nature. The ultimate solution for truth or quality is no LLMs, but I guess that ship has sailed.

        • Zwuzelmaus@feddit.org
          link
          fedilink
          English
          arrow-up
          6
          ·
          3 hours ago

          Sometimes it does not even matter if it is truth or not.

          That may actually be such a case here: Factual statements that can create bad reputation for somebody (or some company).

    • benjirenji@slrpnk.net
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 hour ago

      You just need to be able to reduce the risk. They all operate like this. You can’t have complete certainty, even pre-LLMs. If the answers are wrong in only 0.001% cases and gravely wrong in 0.00001% cases it may be worth the risk. You gotta be able to sue for damages after all.