English
Related papers

Related papers: Hi-Phy: A Benchmark for Hierarchical Physical Reas…

200 papers

Preference-based Reinforcement Learning (PbRL) has made significant strides in single-agent settings, but has not been studied for multi-agent frameworks. On the other hand, modeling cooperation between multiple agents, specifically,…

Artificial Intelligence · Computer Science 2024-09-26 Siddhant Bhambri , Mudit Verma , Upasana Biswas , Anil Murthy , Subbarao Kambhampati

Deeply understanding sports requires an intricate blend of fine-grained visual perception and rule-based reasoning - a challenge that pushes the limits of current multimodal models. To succeed, models must master three critical…

People frequently face challenging decision-making problems in which outcomes are uncertain or unknown. Artificial intelligence (AI) algorithms exist that can outperform humans at learning such tasks. Thus, there is an opportunity for AI…

Artificial Intelligence · Computer Science 2018-12-27 Ravi Pandya , Sandy H. Huang , Dylan Hadfield-Menell , Anca D. Dragan

We seek measurable properties of AI agents that make them better or worse teammates from the subjective perspective of human collaborators. Our experiments use the cooperative card game Hanabi -- a common benchmark for AI-teaming research.…

Human-Computer Interaction · Computer Science 2025-03-21 Ho Chit Siu , Jaime D. Peña , Yutai Zhou , Ross E. Allen

The recent shift toward the Health Level Seven Fast Healthcare Interoperability Resources (HL7 FHIR) standard opens a new frontier for clinical AI, demanding LLM agents to navigate complex, resource-based data models instead of conventional…

Computation and Language · Computer Science 2025-11-14 Gyubok Lee , Elea Bach , Eric Yang , Tom Pollard , Alistair Johnson , Edward Choi , Yugang jia , Jong Ha Lee

Reinforcement learning is a machine learning approach based on behavioral psychology. It is focused on learning agents that can acquire knowledge and learn to carry out new tasks by interacting with the environment. However, a problem…

Artificial Intelligence · Computer Science 2022-12-15 Hugo Muñoz , Ernesto Portugal , Angel Ayala , Bruno Fernandes , Francisco Cruz

Optimizing human-AI interaction requires users to reflect on their own performance critically. Our paper examines whether people using AI to complete tasks can accurately monitor how well they perform. In Study 1, participants (N = 246)…

Human-Computer Interaction · Computer Science 2025-10-31 Daniela Fernandes , Steeven Villa , Salla Nicholls , Otso Haavisto , Daniel Buschek , Albrecht Schmidt , Thomas Kosch , Chenxinran Shen , Robin Welsch

We propose Perceptual Taxonomy, a structured process of scene understanding that first recognizes objects and their spatial configurations, then infers task-relevant properties such as material, affordance, function, and physical attributes…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Jonathan Lee , Xingrui Wang , Jiawei Peng , Luoxin Ye , Zehan Zheng , Tiezheng Zhang , Tao Wang , Wufei Ma , Siyi Chen , Yu-Cheng Chou , Prakhar Kaushik , Alan Yuille

When encountering novel objects, humans are able to infer a wide range of physical properties such as mass, friction and deformability by interacting with them in a goal driven way. This process of active interaction is in the same spirit…

Machine Learning · Statistics 2017-08-21 Misha Denil , Pulkit Agrawal , Tejas D Kulkarni , Tom Erez , Peter Battaglia , Nando de Freitas

Evaluating human actions with clear and detailed feedback is important in areas such as sports, healthcare, and robotics, where decisions rely not only on final outcomes but also on interpretable reasoning. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Junhao Wu , Xiuer Gu , Zhiying Li , Yeying Jin , Yunfeng Diao , Zhiyu Li , Zhenbo Song , Xiaomei Zhang , Zhaoxin Fan

Effective financial reasoning demands not only textual understanding but also the ability to interpret complex visual data such as charts, tables, and trend graphs. This paper introduces a new benchmark designed to evaluate how well AI…

Artificial Intelligence · Computer Science 2025-06-10 Shuangyan Deng , Haizhou Peng , Jiachen Xu , Chunhou Liu , Ciprian Doru Giurcuaneanu , Jiamou Liu

Evaluation of reasoning language models gained importance after it was observed that they can combine their existing capabilities into novel traces of intermediate steps before task completion and that the traces can sometimes help them to…

Machine Learning · Computer Science 2025-08-15 Petr Spelda , Vit Stritecky

The rapid growth of AI agent ecosystems is transforming how complex tasks are delegated and executed, creating a new challenge of identifying suitable agents for a given task. Unlike traditional tools, agent capabilities are often…

Artificial Intelligence · Computer Science 2026-04-27 Bin Wu , Arastun Mammadli , Xiaoyu Zhang , Emine Yilmaz

Accurately modeling pedestrian intention and understanding driver decision-making processes are critical for the development of safe and socially aware autonomous driving systems. We introduce PSI, a benchmark dataset that captures the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-27 Taotao Jing , Tina Chen , Renran Tian , Yaobin Chen , Joshua Domeyer , Heishiro Toyoda , Rini Sherony , Zhengming Ding

Building machines capable of efficiently collaborating with humans has been a longstanding goal in artificial intelligence. Especially in the presence of uncertainties, optimal cooperation often requires that humans and artificial agents…

Machine Learning · Computer Science 2024-01-10 Oskar Keurulainen , Gokhan Alcan , Ville Kyrki

Spatial perception and reasoning are core components of human cognition, encompassing object recognition, spatial relational understanding, and dynamic reasoning. Despite progress in computer vision, existing benchmarks reveal significant…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Chonghan Liu , Haoran Wang , Felix Henry , Pu Miao , Yajie Zhang , Yu Zhao , Peiran Wu

Building AI systems that can plan, act, and create in the physical world requires more than pattern recognition. Such systems must understand the causal mechanisms and constraints governing physical processes in order to guide sequential…

While reinforcement learning agents can achieve superhuman performance in many complex tasks, they typically do not become more computationally efficient as they improve. In contrast, humans gradually require less cognitive effort as they…

Artificial Intelligence · Computer Science 2025-10-28 Adrian Orenstein , Jessica Chen , Gwyneth Anne Delos Santos , Bayley Sapara , Michael Bowling

In the present study, we investigate and compare reasoning in large language models (LLM) and humans using a selection of cognitive psychology tools traditionally dedicated to the study of (bounded) rationality. To do so, we presented to…

Computation and Language · Computer Science 2023-09-25 Nicolas Yax , Hernan Anlló , Stefano Palminteri

Current benchmarks for evaluating the reasoning capabilities of Large Language Models (LLMs) face significant limitations: task oversimplification, data contamination, and flawed evaluation items. These deficiencies necessitate more…