English
Related papers

Related papers: Beyond Behavior: Why AI Evaluation Needs a Cogniti…

200 papers

People supported by AI-powered decision support tools frequently overrely on the AI: they accept an AI's suggestion even when that suggestion is wrong. Adding explanations to the AI decisions does not appear to reduce the overreliance and…

Human-Computer Interaction · Computer Science 2021-02-22 Zana Buçinca , Maja Barbara Malaya , Krzysztof Z. Gajos

In 1950, Alan Turing proposed an imitation game as the ultimate test of whether a machine was intelligent: could a machine imitate a human so well that its answers to questions indistinguishable from a human. Ever since, creating…

General Economics · Economics 2022-01-13 Erik Brynjolfsson

Neuroscience has long been an essential driver of progress in artificial intelligence (AI). We propose that to accelerate progress in AI, we must invest in fundamental research in NeuroAI. A core component of this is the embodied Turing…

Advances in artificial intelligence (AI) raise important questions about whether people view moral evaluations by AI systems similarly to human-generated moral evaluations. We conducted a modified Moral Turing Test (m-MTT), inspired by…

The Turing Test (TT) checks for human intelligence, rather than any putative general intelligence. It involves repeated interaction requiring learning in the form of adaption to the human conversation partner. It is a macro-level post-hoc…

Artificial Intelligence · Computer Science 2012-10-10 Bruce Edmonds , Carlos Gershenson

As artificial intelligence systems become increasingly prevalent in education, a fundamental challenge emerges: how can we verify if an AI truly understands how students think and reason? Traditional evaluation methods like measuring…

Artificial Intelligence · Computer Science 2025-02-24 Shashank Sonkar , Naiming Liu , Xinghe Chen , Richard G. Baraniuk

We propose an approach to test embodied AI agents for interaction awareness and believability, particularly in scenarios where humans push them to their limits. Turing introduced the Imitation Game as a way to explore the question: "Can…

Human-Computer Interaction · Computer Science 2025-07-16 Chuxuan Zhang , Yasaman Etesam , Angelica Lim

We paraphrase Descartes' famous dictum in the area of AI ethics where the "I doubt and therefore I am" is suggested as a necessary aspect of morality. Therefore AI, which cannot doubt itself, cannot possess moral agency. Of course, this is…

Artificial Intelligence · Computer Science 2025-03-13 Viktor Dorfler , Giles Cuthbert

Reliable human-machine discrimination is becoming increasingly important as large language models and autonomous agents are deployed in online settings. Existing approaches evaluate whether a system can produce behavior or responses…

Artificial Intelligence · Computer Science 2026-05-12 Milena Rmus , Mathew D. Hardy , Thomas L. Griffiths , Mayank Agrawal

The world has seen the emergence of machines based on pretrained models, transformers, also known as generative artificial intelligences for their ability to produce various types of content, including text, images, audio, and synthetic…

Artificial Intelligence · Computer Science 2024-10-10 Bernardo Gonçalves

Developments in machine learning and computing power suggest that artificial general intelligence is within reach. This raises the question of artificial consciousness: if a computer were to be functionally equivalent to a human, being able…

Artificial Intelligence · Computer Science 2025-03-04 Graham Findlay , William Marshall , Larissa Albantakis , Isaac David , William GP Mayner , Christof Koch , Giulio Tononi

There is much to learn from what Turing hastily dismissed as Lady Lovelace s objection. Digital computers can indeed surprise us. Just like a piece of art, algorithms can be designed in such a way as to lead us to question our understanding…

Computers and Society · Computer Science 2018-03-14 Sylvie Delacroix

Can machines think? This is a central question in artificial intelligence research. However, there is a substantial divergence of views on the answer to this question. Why do people have such significant differences of opinion, even when…

Artificial Intelligence · Computer Science 2025-12-01 Xi Cun , Jifan Ren , Asha Huang , Siyu Li , Ruzhen Song

With state-of-the-art models achieving high performance on standard benchmarks, contemporary research paradigms continue to emphasize general intelligence as an enduring objective. However, this pursuit overlooks the fundamental disparities…

Artificial Intelligence · Computer Science 2023-10-03 Nick DiSanto

The ability of a machine to communicate with humans has long been associated with the general success of AI. This dates back to Alan Turing's epoch-making work in the early 1950s, which proposes that a machine's intelligence can be tested…

Computation and Language · Computer Science 2020-02-03 Jiwei Li

This paper proposes to revisit the Turing test through the concept of normality. Its core argument is that the Turing test is a test of normal intelligence as assessed by a normal judge. First, in the sense that the Turing test targets…

Computation and Language · Computer Science 2025-11-11 Alexandre Kabbach

The current cycle of hype and anxiety concerning the benefits and risks to human society of Artificial Intelligence is fuelled, not only by the increasing use of generative AI and other AI tools by the general public, but also by claims…

Human-Computer Interaction · Computer Science 2025-01-30 Sharon Temtsin , Diane Proudfoot , David Kaber , Christoph Bartneck

In the wake of the latest trends of artificial intelligence (AI), there has been a resurgence of claims and questions about the Turing test and its value, which are reminiscent of decades of practical "Turing" tests. If AI were quantum…

Artificial Intelligence · Computer Science 2024-07-23 Bernardo Gonçalves

What does it mean to claim that a physical or natural system computes? One answer, endorsed here, is that computing is about programming a system to behave in different ways. This paper offers an account of what it means for a physical…

Information Theory · Computer Science 2013-06-18 Hector Zenil

From the point of view of a programmer, the robopsychology is a synonym for the activity is done by developers to implement their machine learning applications. This robopsychological approach raises some fundamental theoretical questions…

Artificial Intelligence · Computer Science 2016-06-24 Norbert Bátfai