Opper
opper.ai
The developer platform for reliable agents

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • FaceDeer@fedia.io
    23·
    4 hours ago

    And yet the best models outdid humans at this “car wash test.” Humans got it right only 71.5% of the time.

    • CileTheSane@lemmy.caEnglish
      1·
      2 hours ago

      That 71.5% is still a higher success rate than 48 out of 53 models tested. Only the five 10/10 models and the two 8/10 models outperform the average human. Everything below GPT-5 performs worse than 10,000 people given two buttons and no time to think.