Opper
opper.ai
The developer platform for reliable agents

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

    • FaceDeer@fedia.io
      23·
      4 hours ago

      And yet the best models outdid humans at this “car wash test.” Humans got it right only 71.5% of the time.

      • CileTheSane@lemmy.caEnglish
        1·
        2 hours ago

        That 71.5% is still a higher success rate than 48 out of 53 models tested. Only the five 10/10 models and the two 8/10 models outperform the average human. Everything below GPT-5 performs worse than 10,000 people given two buttons and no time to think.