Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there.

Also includes outtakes on the ‘reasoning’ models.

  • masterofn001@lemmy.ca
    link
    fedilink
    English
    arrow-up
    14
    arrow-down
    11
    ·
    edit-2
    32 minutes ago

    Without reading the article, the title just says wash the car.

    I could go for a walk and wash my car in my driveway.

    Reading the article… That is exactly the question asked. It is a very ambiguous question.

    *I do understand the intent of the question, but it could be phrased more clearly.

    • bluesheep@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      14
      arrow-down
      1
      ·
      10 hours ago

      Without reading the article, the title just says wash the car.

      No it doesn’t? It says:

      I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

      In which world is that an ambiguous question?

      • NewNewAugustEast@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        arrow-down
        1
        ·
        4 hours ago

        Where is the car?

        This is the exact question a person would ask when they to have a gotcha answer. Nobody would ask this question, which makes it suspect to a straight forward answer.

    • Geth@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      4
      arrow-down
      1
      ·
      9 hours ago

      Mentioning the car wash and washing the car plus the possibility of driving the car in the same context pretty much eliminates any ambiguity. All of the puzzle pieces are there already.

      I guess this is an uninteded autism test as well if this is not enough context for someone to understand the question.

      • masterofn001@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        18 minutes ago

        Understanding the intent of the question *and understanding why it could be interpreted differently *\and understanding why is it is a poorly phrased question are not related to autism. (In my case)

        I want to wash my car. No location or method is specified. No ‘at the car wash’. No ‘take my car to the car wash’ . No ‘take the car through the car wash’

        A car wash is this far. Is this an option? A question. A suggestion. A demand?

        Should I walk or drive? To do what? Wash the car? Ok. If the car wash is an option, that seems very far. But walking there seems silly. Since no method or location for washing the car was mentioned I could wash my own car.

        Do you see how this works?

        Yes, you can infer what was implied, but the question itself offers no certainty that what you infer is what it is actually implying.

      • masterofn001@lemmy.ca
        link
        fedilink
        English
        arrow-up
        1
        ·
        edit-2
        19 minutes ago

        Understanding the intent of the question *and understanding why it could be interpreted differently *\and understanding why is it is a poorly phrased question:

        There are 3 sentences.

        I want to wash my car. No location or method is specified. No ‘at the car wash’. No ‘take my car to the car wash’ . No ‘take the car through the car wash’

        A car wash is this far. Is this an option? A question. A suggestion. A demand?

        Should I walk or drive? To do what? Wash the car? Ok. If the car wash is an option, that seems very far. But walking there seems silly. Since no method or location for washing the car was mentioned I could wash my own car.

        Do you see how this works?

        Yes, you can infer what was implied, but the question itself offers no certainty that what you infer is what it is actually implying.