Source
edit: The full study PDF is a lot more detailed too and worth checking out...
Participants were divided into three groups: LLM, Search Engine, and Brain-only (no tools). Each completed three sessions under the same condition. In a fourth session, LLM users were reassigned to Brain-only group (LLM-to-Brain), and Brain-only users were reassigned to LLM condition (Brain-to-LLM). A total of 54 participants took part in Sessions 1-3, with 18 completing session 4. We used electroencephalography (EEG) to assess cognitive load during essay writing, and analyzed essays using NLP, as well as scoring essays with the help from human teachers and an AI judge.
EEG revealed significant differences in brain connectivity: Brain-only participants exhibited the strongest, most distributed networks; Search Engine users showed moderate engagement; and LLM users displayed the weakest connectivity. Cognitive activity scaled down in relation to external tool use. In session 4, LLM-to-Brain participants showed reduced alpha and beta connectivity, indicating under-engagement.
So not only do we have peoples attention spans shot to shit thanks to the likes of TikTok, etc, but now thanks to AI we're also lowering our own cognitive activity! We're heading for the WALL-E timeline.Self-reported ownership of essays was the lowest in the LLM group and the highest in the Brain-only group. LLM users also struggled to accurately quote their own work. While LLMs offer immediate convenience, our findings highlight potential cognitive costs. Over four months, LLM users consistently underperformed at neural, linguistic, and behavioral levels.
edit: The full study PDF is a lot more detailed too and worth checking out...
However, this convenience came at a cognitive cost, diminishing users'inclination to critically evaluate the LLM's output or "opinions" (probabilistic answers based onthe training datasets). This highlights a concerning evolution of the 'echo chamber' effect: ratherthan disappearing, it has adapted to shape user exposure through algorithmically curatedcontent. What is ranked as "top" is ultimately influenced by the priorities of the LLM'sshareholders
Last edited: