Close encounters of the AI kind - Imagining the Digital Future Center
imaginingthedigitalfuture.org
The increasingly human-like way people are engaging with language models Read the full report | Download this report (PDF) | Survey methdology and topline (PDF) March 12, 2025 Half of...

Half of LLM users (49%) think the models they use are smarter than they are, including 26% who think their LLMs are “a lot smarter.” Another 18% think LLMs are as smart as they are. Here are some of the other attributes they see:

  • Confident: 57% say the main LLM they use seems to act in a confident way.
  • Reasoning: 39% say the main LLM they use shows the capacity to think and reason at least some of the time.
  • Sense of humor: 32% say their main LLM seems to have a sense of humor.
  • Morals: 25% say their main model acts like it makes moral judgments about right and wrong at least sometimes. Sarcasm: 17% say their prime LLM seems to respond sarcastically.
  • Sad: 11% say the main model they use seems to express sadness, while 24% say that model also expresses hope.
  • blady_blah@lemmy.worldEnglish
    185·
    9 hours ago

    You say this like this is wrong.

    Think of a question that you would ask an average person and then think of what the LLM would respond with. The vast majority of the time the llm would be more correct than most people.

      • blady_blah@lemmy.worldEnglish
        21·
        3 hours ago

        Then asking it a logic question. What question are you asking that the llms are getting wrong and your average person is getting right? How are you proving intelligence here?

    • LifeInMultipleChoice@lemmy.dbzer0.comEnglish
      172·
      9 hours ago

      A good example is the post on here about tax brackets. Far more Republicans didn’t know how tax brackets worked than Democrats. But every mainstream language model would have gotten the answer right.