English
Related papers

Related papers: TouchAI: Exploring human-AI perceptual alignment i…

200 papers

For machines to interact with the physical world, they must understand the physical properties of objects and materials they encounter. We use fabrics as an example of a deformable material with a rich set of mechanical properties. A thin…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Wenzhen Yuan , Shaoxiong Wang , Siyuan Dong , Edward Adelson

Humans perceive the world using multi-modal sensory inputs such as vision, audition, and touch. In this work, we investigate the cross-modal connection between vision and touch. The main challenge in this cross-domain modeling task lies in…

Computer Vision and Pattern Recognition · Computer Science 2019-06-17 Yunzhu Li , Jun-Yan Zhu , Russ Tedrake , Antonio Torralba

Effective and safe human-machine collaboration requires the regulated and meaningful exchange of emotions between humans and artificial intelligence (AI). Current AI systems based on large language models (LLMs) can provide feedback that…

Computation and Language · Computer Science 2025-06-18 Xiuwen Wu , Hao Wang , Zhiang Yan , Xiaohan Tang , Pengfei Xu , Wai-Ting Siok , Ping Li , Jia-Hong Gao , Bingjiang Lyu , Lang Qin

AI alignment refers to models acting towards human-intended goals, preferences, or ethical principles. Given that most large-scale deep learning models act as black boxes and cannot be manually controlled, analyzing the similarity between…

Computer Vision and Pattern Recognition · Computer Science 2023-10-23 Jiyoung Lee , Seungho Kim , Seunghyun Won , Joonseok Lee , Marzyeh Ghassemi , James Thorne , Jaeseok Choi , O-Kil Kwon , Edward Choi

Deployed artificial intelligence (AI) often impacts humans, and there is no one-size-fits-all metric to evaluate these tools. Human-centered evaluation of AI-based systems combines quantitative and qualitative analysis and human input. It…

Human-Computer Interaction · Computer Science 2023-03-14 Teresa Datta , John P. Dickerson

As we consider entrusting Large Language Models (LLMs) with key societal and decision-making roles, measuring their alignment with human cognition becomes critical. This requires methods that can assess how these systems represent…

Artificial Intelligence · Computer Science 2025-10-03 Mattson Ogg , Ritwik Bose , Jamie Scharf , Christopher Ratto , Michael Wolmetz

Artificial Intelligence (AI) and large language models (LLMs) are increasingly used in social and psychological research. Among potential applications, LLMs can be used to generate, customise, or adapt measurement instruments. This study…

Human-Computer Interaction · Computer Science 2026-02-16 Mario Angelelli , Morena Oliva , Serena Arima , Enrico Ciavolino

In this paper, we advance the study of AI-augmented reasoning in the context of Human-Computer Interaction (HCI), psychology and cognitive science, focusing on the critical task of visual perception. Specifically, we investigate the…

Human-Computer Interaction · Computer Science 2025-04-18 Shravan Chaudhari , Trilokya Akula , Yoon Kim , Tom Blake

Accurate prediction of human behavior is crucial for AI systems to effectively support real-world applications, such as autonomous robots anticipating and assisting with human tasks. Real-world scenarios frequently present challenges such…

Human-Computer Interaction · Computer Science 2025-07-21 Kojiro Takeyama , Yimeng Liu , Misha Sra

We present DRESS, a large vision language model (LVLM) that innovatively exploits Natural Language feedback (NLF) from Large Language Models to enhance its alignment and interactions by addressing two key limitations in the state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Interacting with Large Language Models (LLMs) for text editing on mobile devices currently requires users to break out of their writing environment and switch to a conversational AI interface. In this paper, we propose to control the LLM…

Human-Computer Interaction · Computer Science 2025-02-12 Tim Zindulka , Jannek Sekowski , Florian Lehmann , Daniel Buschek

As AI-generated health information proliferates online and becomes increasingly indistinguishable from human-sourced information, it becomes critical to understand how people trust and label such content, especially when the information is…

Human-Computer Interaction · Computer Science 2025-12-16 Xin Sun , Rongjun Ma , Shu Wei , Pablo Cesar , Jos A. Bosch , Abdallah El Ali

When Artificial Intelligence (AI) is used to replace consumers (e.g., synthetic data), it is often assumed that AI emulates established consumers, and more generally human behaviors. Ten experiments with Large Language Models (LLMs)…

Human-Computer Interaction · Computer Science 2025-10-10 Antonios Stamatogiannakis , Arsham Ghodsinia , Sepehr Etminanrad , Dilney Gonçalves , David Santos

By comparing biological and artificial perception through the lens of illusions, we highlight critical differences in how each system constructs visual reality. Understanding these divergences can inform the development of more robust,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Jianyi Yang , Junyi Ye , Ankan Dash , Guiling Wang

Recent developments in Large Language Models (LLMs) have demonstrated their remarkable capabilities across a range of tasks. Questions, however, persist about the nature of LLMs and their potential to integrate common-sense human knowledge…

Artificial Intelligence · Computer Science 2024-06-13 Huatao Xu , Liying Han , Qirui Yang , Mo Li , Mani Srivastava

While research on human-AI collaboration exists, it mainly examined language learning and used traditional counting methods with little attention to evolution and dynamics of collaboration on cognitively demanding tasks. This study examines…

Human-Computer Interaction · Computer Science 2025-08-18 Mohammed Saqr , Kamila Misiejuk , Sonsoles López-Pernas

Are large language models (LLMs) biased in favor of communications produced by LLMs, leading to possible antihuman discrimination? Using a classical experimental design inspired by employment discrimination studies, we tested widely used…

Computation and Language · Computer Science 2025-08-12 Walter Laurito , Benjamin Davis , Peli Grietzer , Tomáš Gavenčiak , Ada Böhm , Jan Kulveit

Artificial intelligence (AI), exemplified by large language models (LLMs), is rapidly approaching and in some cases surpassing human performance across a wide range of cognitive tasks. However, human nature is not limited to intelligence…

Human-Computer Interaction · Computer Science 2026-05-20 Yoshia Abe , Tatsuya Daikoku , Yasuo Kuniyoshi

Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption remains largely untested. Existing…

Computation and Language · Computer Science 2025-11-26 Nicolò Pagan , Petter Törnberg , Christopher A. Bail , Anikó Hannák , Christopher Barrie

A fundamental question in cognitive science and AI concerns whether different learning modalities: language, vision, and action, give rise to distinct or shared internal representations. Traditional views assume that models trained on…

Artificial Intelligence · Computer Science 2026-02-02 Nicola Milano , Stefano Nolfi