中文
相关论文

相关论文: Collaborative Human-AI Risk Annotation: Co-Annotat…

200 篇论文

Humans and AIs are often paired on decision tasks with the expectation of achieving complementary performance -- where the combination of human and AI outperforms either one alone. However, how to improve performance of a human-AI team is…

人机交互 · 计算机科学 2025-02-26 Ziyang Guo , Yifan Wu , Jason Hartline , Jessica Hullman

Human-AI co-creativity involves humans and AI collaborating on a shared creative product as partners. In a creative collaboration, communication is an essential component among collaborators. In many existing co-creative systems users can…

人机交互 · 计算机科学 2022-06-07 Jeba Rezwana , Mary Lou Maher

The collaboration between humans and artificial intelligence (AI) is a significant feature in this digital age. However, humans and AI may have observation, interpretation, and action conflicts when working synchronously. This phenomenon is…

人机交互 · 计算机科学 2024-04-30 He Wen

High-quality human annotations are necessary for creating effective machine learning-driven stream processing systems. We study hybrid stream processing systems based on a Human-In-The-Loop Machine Learning (HITL-ML) paradigm, in which one…

人机交互 · 计算机科学 2022-01-19 Rahul Pandey , Hemant Purohit , Carlos Castillo , Valerie L. Shalin

The potential for negative impacts of AI has rapidly become more pervasive around the world, and this has intensified a need for responsible AI governance. While many regulatory bodies endorse risk-based approaches and a multitude of risk…

计算机与社会 · 计算机科学 2025-02-24 Julia Barnett , Kimon Kieslich , Natali Helberger , Nicholas Diakopoulos

Human feedback is critical for aligning AI systems to human values. As AI capabilities improve and AI is used to tackle more challenging tasks, verifying quality and safety becomes increasingly challenging. This paper explores how we can…

人工智能 · 计算机科学 2025-10-31 Rishub Jain , Sophie Bridgers , Lili Janzer , Rory Greig , Tian Huey Teh , Vladimir Mikulik

Professional fact-checkers rely on domain knowledge and deep contextual understanding to verify claims. Large language models (LLMs) and large reasoning models (LRMs) lack such grounding and primarily reason from available evidence alone,…

计算与语言 · 计算机科学 2026-04-16 Dhruv Sahnan , Subhabrata Dutta , Tanmoy Chakraborty , Preslav Nakov , Iryna Gurevych

Providing timely and actionable feedback is crucial for effective collaboration, learning, and coordination within teams. However, many teams face challenges in receiving feedback that aligns with their goals and promotes cohesion. We…

人机交互 · 计算机科学 2025-08-13 Mohammed Almutairi , Charles Chiang , Yuxin Bai , Diego Gomez-Zara

Via thousands of papers in Explainable AI (XAI), attention maps \cite{vaswani2017attention} and feature importance maps \cite{bansal2020sam} have been established as a common means for finding how important each input feature is to an AI's…

计算机视觉与模式识别 · 计算机科学 2024-04-23 Giang Nguyen , Mohammad Reza Taesiri , Sunnie S. Y. Kim , Anh Nguyen

Large Language Models (LLMs), when paired with prompt-based tasks, have significantly reduced data annotation costs and reliance on human annotators. However, evaluating the quality of their annotations remains challenging in dynamic,…

计算与语言 · 计算机科学 2025-09-11 Cheng Chen , Haiyan Yin , Ivor Tsang

Current AI safety frameworks, which often treat harmfulness as binary, lack the flexibility to handle borderline cases where humans meaningfully disagree. To build more pluralistic systems, it is essential to move beyond consensus and…

计算机与社会 · 计算机科学 2026-02-04 Jing-Jing Li , Joel Mire , Eve Fleisig , Valentina Pyatkin , Anne Collins , Maarten Sap , Sydney Levine

Drama-in-education is an interdisciplinary instructional approach that integrates subjects such as language, history, and psychology. Its core component is playwriting. Based on need-finding interviews of 13 teachers, we found that current…

人机交互 · 计算机科学 2025-06-03 Xuejiao Ma , Haibo Zhao , Zinuo Guo , Yijie Guo , Guanhong Liu , Bo Jiang

Here we examine how AI agent "personalities" interact with human personalities to shape human-AI collaboration and performance. In a large-scale, preregistered randomized experiment, we paired 1,258 participants with AI agents prompted to…

人机交互 · 计算机科学 2026-04-14 Harang Ju , Sinan Aral

This paper examines artificial intelligence (AI) companionship as a site where intimate relations are simultaneously produced, extracted from, and governed through datafied systems. Drawing on critical data studies and platform studies, we…

人机交互 · 计算机科学 2026-04-09 Dayeon Eom , Julianne Renner , Sedona Chinn

We introduce Constrained Human-AI Cooperation (CHAIC), an inclusive embodied social intelligence challenge designed to test social perception and cooperation in embodied agents. In CHAIC, the goal is for an embodied agent equipped with…

Analyzing usability test videos is arduous. Although recent research showed the promise of AI in assisting with such tasks, it remains largely unknown how AI should be designed to facilitate effective collaboration between user experience…

人机交互 · 计算机科学 2021-12-24 Mingming Fan , Xianyou Yang , Tsz Tung Yu , Vera Q. Liao , Jian Zhao

The traditional data annotation process is often labor-intensive, time-consuming, and susceptible to human bias, which complicates the management of increasingly complex datasets. This study explores the potential of large language models…

计算与语言 · 计算机科学 2024-09-17 Jianfei Wu , Xubin Wang , Weijia Jia

Artificial Intelligence (AI) has become a ubiquitous part of society, but a key challenge exists in ensuring that humans are equipped with the required critical thinking and AI literacy skills to interact with machines effectively by…

人机交互 · 计算机科学 2024-04-11 Antonette Shibani , Simon Knight , Kirsty Kitto , Ajanie Karunanayake , Simon Buckingham Shum

Academic writing is an indispensable yet laborious part of the research enterprise. This Perspective maps out principles and methods for using generative artificial intelligence (AI), specifically large language models (LLMs), to elevate…

计算机与社会 · 计算机科学 2026-04-07 Zhicheng Lin

The increasing prevalence of Artificial Intelligence (AI) in safety-critical contexts such as air-traffic control leads to systems that are practical and efficient, and to some extent explainable to humans to be trusted and accepted. The…

计算机与社会 · 计算机科学 2023-06-28 Sabine Theis , Sophie Jentzsch , Fotini Deligiannaki , Charles Berro , Arne Peter Raulf , Carmen Bruder