English
Related papers

Related papers: Collaborative Human-AI Risk Annotation: Co-Annotat…

200 papers

Humans and AIs are often paired on decision tasks with the expectation of achieving complementary performance -- where the combination of human and AI outperforms either one alone. However, how to improve performance of a human-AI team is…

Human-Computer Interaction · Computer Science 2025-02-26 Ziyang Guo , Yifan Wu , Jason Hartline , Jessica Hullman

Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In a creative collaboration, communication is an essential component among collaborators. In many existing co-creative systems users can…

Human-Computer Interaction · Computer Science 2022-06-07 Jeba Rezwana , Mary Lou Maher

The collaboration between humans and artificial intelligence (AI) is a significant feature in this digital age. However, humans and AI may have observation, interpretation, and action conflicts when working synchronously. This phenomenon is…

Human-Computer Interaction · Computer Science 2024-04-30 He Wen

High-quality human annotations are necessary for creating effective machine learning-driven stream processing systems. We study hybrid stream processing systems based on a Human-In-The-Loop Machine Learning (HITL-ML) paradigm, in which one…

Human-Computer Interaction · Computer Science 2022-01-19 Rahul Pandey , Hemant Purohit , Carlos Castillo , Valerie L. Shalin

The potential for negative impacts of AI has rapidly become more pervasive around the world, and this has intensified a need for responsible AI governance. While many regulatory bodies endorse risk-based approaches and a multitude of risk…

Computers and Society · Computer Science 2025-02-24 Julia Barnett , Kimon Kieslich , Natali Helberger , Nicholas Diakopoulos

Human feedback is critical for aligning AI systems to human values. As AI capabilities improve and AI is used to tackle more challenging tasks, verifying quality and safety becomes increasingly challenging. This paper explores how we can…

Artificial Intelligence · Computer Science 2025-10-31 Rishub Jain , Sophie Bridgers , Lili Janzer , Rory Greig , Tian Huey Teh , Vladimir Mikulik

Professional fact-checkers rely on domain knowledge and deep contextual understanding to verify claims. Large language models (LLMs) and large reasoning models (LRMs) lack such grounding and primarily reason from available evidence alone,…

Computation and Language · Computer Science 2026-04-16 Dhruv Sahnan , Subhabrata Dutta , Tanmoy Chakraborty , Preslav Nakov , Iryna Gurevych

Providing timely and actionable feedback is crucial for effective collaboration, learning, and coordination within teams. However, many teams face challenges in receiving feedback that aligns with their goals and promotes cohesion. We…

Human-Computer Interaction · Computer Science 2025-08-13 Mohammed Almutairi , Charles Chiang , Yuxin Bai , Diego Gomez-Zara

Via thousands of papers in Explainable AI (XAI), attention maps \cite{vaswani2017attention} and feature importance maps \cite{bansal2020sam} have been established as a common means for finding how important each input feature is to an AI's…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Giang Nguyen , Mohammad Reza Taesiri , Sunnie S. Y. Kim , Anh Nguyen

Large Language Models (LLMs), when paired with prompt-based tasks, have significantly reduced data annotation costs and reliance on human annotators. However, evaluating the quality of their annotations remains challenging in dynamic,…

Computation and Language · Computer Science 2025-09-11 Cheng Chen , Haiyan Yin , Ivor Tsang

Current AI safety frameworks, which often treat harmfulness as binary, lack the flexibility to handle borderline cases where humans meaningfully disagree. To build more pluralistic systems, it is essential to move beyond consensus and…

Computers and Society · Computer Science 2026-02-04 Jing-Jing Li , Joel Mire , Eve Fleisig , Valentina Pyatkin , Anne Collins , Maarten Sap , Sydney Levine

Drama-in-education is an interdisciplinary instructional approach that integrates subjects such as language, history, and psychology. Its core component is playwriting. Based on need-finding interviews of 13 teachers, we found that current…

Human-Computer Interaction · Computer Science 2025-06-03 Xuejiao Ma , Haibo Zhao , Zinuo Guo , Yijie Guo , Guanhong Liu , Bo Jiang

Here we examine how AI agent "personalities" interact with human personalities to shape human-AI collaboration and performance. In a large-scale, preregistered randomized experiment, we paired 1,258 participants with AI agents prompted to…

Human-Computer Interaction · Computer Science 2026-04-14 Harang Ju , Sinan Aral

This paper examines artificial intelligence (AI) companionship as a site where intimate relations are simultaneously produced, extracted from, and governed through datafied systems. Drawing on critical data studies and platform studies, we…

Human-Computer Interaction · Computer Science 2026-04-09 Dayeon Eom , Julianne Renner , Sedona Chinn

We introduce Constrained Human-AI Cooperation (CHAIC), an inclusive embodied social intelligence challenge designed to test social perception and cooperation in embodied agents. In CHAIC, the goal is for an embodied agent equipped with…

Artificial Intelligence · Computer Science 2025-06-13 Weihua Du , Qiushi Lyu , Jiaming Shan , Zhenting Qi , Hongxin Zhang , Sunli Chen , Andi Peng , Tianmin Shu , Kwonjoon Lee , Behzad Dariush , Chuang Gan

Analyzing usability test videos is arduous. Although recent research showed the promise of AI in assisting with such tasks, it remains largely unknown how AI should be designed to facilitate effective collaboration between user experience…

Human-Computer Interaction · Computer Science 2021-12-24 Mingming Fan , Xianyou Yang , Tsz Tung Yu , Vera Q. Liao , Jian Zhao

The traditional data annotation process is often labor-intensive, time-consuming, and susceptible to human bias, which complicates the management of increasingly complex datasets. This study explores the potential of large language models…

Computation and Language · Computer Science 2024-09-17 Jianfei Wu , Xubin Wang , Weijia Jia

Artificial Intelligence (AI) has become a ubiquitous part of society, but a key challenge exists in ensuring that humans are equipped with the required critical thinking and AI literacy skills to interact with machines effectively by…

Human-Computer Interaction · Computer Science 2024-04-11 Antonette Shibani , Simon Knight , Kirsty Kitto , Ajanie Karunanayake , Simon Buckingham Shum

Academic writing is an indispensable yet laborious part of the research enterprise. This Perspective maps out principles and methods for using generative artificial intelligence (AI), specifically large language models (LLMs), to elevate…

Computers and Society · Computer Science 2026-04-07 Zhicheng Lin

The increasing prevalence of Artificial Intelligence (AI) in safety-critical contexts such as air-traffic control leads to systems that are practical and efficient, and to some extent explainable to humans to be trusted and accepted. The…

Computers and Society · Computer Science 2023-06-28 Sabine Theis , Sophie Jentzsch , Fotini Deligiannaki , Charles Berro , Arne Peter Raulf , Carmen Bruder