English
Related papers

Related papers: Collaborative Human-AI Risk Annotation: Co-Annotat…

200 papers

This article benchmarked the ability of OpenAI's GPTs and a number of open-source LLMs to perform annotation tasks on political content. We used a novel protest event dataset comprising more than three million digital interactions and…

Computation and Language · Computer Science 2024-09-17 Bastián González-Bustamante

Conversational agents built on large language models (LLMs) are becoming increasingly prevalent, yet most systems are designed for one-on-one, turn-based exchanges rather than natural, asynchronous group chats. As AI assistants become…

Computation and Language · Computer Science 2025-11-24 Mateusz Jacniacki , Martí Carmona Serrat

This workshop aimed for a deeper exploration of trust and acceptance in human-robot interaction (HRI) from a multidisciplinary perspective including robots' capabilities of sensing and perceiving other agents, the environment, and…

Robotics · Computer Science 2021-08-20 Alessandra Rossi , Patrick Holthaus , Sílvia Moros , Marcus Scheunemann , Gabriella Lakatos

This position paper examines potential pitfalls on the way towards achieving human-AI co-creation with generative models in a way that is beneficial to the users' interests. In particular, we collected a set of nine potential pitfalls,…

Human-Computer Interaction · Computer Science 2021-04-02 Daniel Buschek , Lukas Mecke , Florian Lehmann , Hai Dang

Agentic AI systems, powered by Large Language Models (LLMs), offer transformative potential for value co-creation in technical services. However, persistent challenges like hallucinations and operational brittleness limit their autonomous…

Human-Computer Interaction · Computer Science 2025-07-21 Jochen Wulf , Jurg Meierhofer , Frank Hannich

Implicit authentication (IA) transparently authenticates users by utilizing their behavioral data sampled from various sensors. Identifying the illegitimate user through constantly analyzing current users' behavior, IA adds another layer of…

Cryptography and Security · Computer Science 2021-10-07 Yingyuan Yang , Xueli Huang , Jiangnan Li , Jinyuan Sun

LLMs' remarkable ability to tackle a wide range of language tasks opened new opportunities for collaborative human-AI problem solving. LLMs can amplify human capabilities by applying their intuitions and reasoning strategies at scale. We…

Computation and Language · Computer Science 2025-09-23 Abhishek Sharma , Dan Goldwasser

AI practitioners increasingly use large language model (LLM) agents in compound AI systems to solve complex reasoning tasks, these agent executions often fail to meet human standards, leading to errors that compromise the system's overall…

Artificial Intelligence · Computer Science 2025-03-18 Yoo Yeon Sung , Hannah Kim , Dan Zhang

Within journalistic editorial processes, disclosing AI usage is currently limited to simplistic labels, which misses the nuance of how humans and AI collaborated on a news article. Through co-design sessions (N=10), we elicited 69…

Human-Computer Interaction · Computer Science 2026-01-19 Amber Kusters , Pooja Prajod , Pablo Cesar , Abdallah El Ali

The absolute dominance of Artificial Intelligence (AI) introduces unprecedented societal harms and risks. Existing AI risk assessment models focus on internal compliance, often neglecting diverse stakeholder perspectives and real-world…

Artificial Intelligence · Computer Science 2025-09-15 Sofia Vei , Paolo Giudici , Pavlos Sermpezis , Athena Vakali , Adelaide Emma Bernardelli

Recent developments in Artificial Intelligence (AI) have fueled the emergence of human-AI collaboration, a setting where AI is a coequal partner. Especially in clinical decision-making, it has the potential to improve treatment quality by…

Human-Computer Interaction · Computer Science 2022-04-21 Patrick Hemmer , Max Schemmer , Lara Riefle , Nico Rosellen , Michael Vössing , Niklas Kühl

Human-AI collaboration faces growing challenges as AI systems increasingly outperform humans on complex tasks, while humans remain responsible for orchestration, validation, and decision oversight. To address this imbalance, we introduce…

Human-Computer Interaction · Computer Science 2026-02-16 Yuanrong Tang , Huiling Peng , Bingxi Zhao , Hengyang Ding , Hanchao Song , Tianhong Wang , Chen Zhong , Jiangtao Gong

We develop algorithms for collaborative control of AI agents and critics in a multi-actor, multi-critic federated multi-agent system. Each AI agent and critic has access to classical machine learning or generative AI foundation models. The…

Artificial Intelligence · Computer Science 2026-04-02 Syed Eqbal Alam , Zhan Shu

AI is redefining how humans interact with technology, leading to a synergetic collaboration between the two. Nevertheless, the effects of human cognition on this collaboration remain unclear. This study investigates the implications of two…

Human-Computer Interaction · Computer Science 2024-11-12 Samuel Aleksander Sánchez Olszewski

While augmented reality shows promise for supporting human-robot collaboration, creating such interactive systems still poses great challenges. Addressing this, we introduce ARTHUR, an open-source authoring tool for augmented…

Human-Computer Interaction · Computer Science 2025-05-05 Rasmus Lunding , Sebastian Hubenschmid , Tiare Feuchtner , Kaj Grønbæk

Integrating Artificial Intelligence (AI) into mobile and wearables offers numerous benefits at individual, societal, and environmental levels. Yet, it also spotlights concerns over emerging risks. Traditional assessments of risks and…

Human-Computer Interaction · Computer Science 2024-07-30 Marios Constantinides , Edyta Bogucka , Sanja Scepanovic , Daniele Quercia

Explainable AI (XAI) aims to bridge the gap between complex algorithmic systems and human stakeholders. Current discourse often examines XAI in isolation as either a technological tool, user interface, or policy mechanism. This paper…

Computers and Society · Computer Science 2023-11-28 Joshua L. M. Brand , Luca Nannini

Communicating the risks and benefits of AI is important for regulation and public understanding. Yet current methods such as technical reports often exclude people without technical expertise. Drawing on HCI research, we developed an Impact…

Human-Computer Interaction · Computer Science 2025-08-27 Edyta Bogucka , Marios Constantinides , Sanja Šćepanović , Daniele Quercia

Artificial Intelligence (AI) has burrowed into our lives in various aspects; however, without appropriate testing, deployed AI systems are often being criticized to fail in critical and embarrassing cases. Existing testing approaches mainly…

Artificial Intelligence · Computer Science 2018-10-23 Siwei Fu , Anbang Xu , Xiaotong Liu , Huimin Zhou , Rama Akkiraju

In this paper, we introduce CAMRA (Copilot for AMR Annotatations), a cutting-edge web-based tool designed for constructing Abstract Meaning Representation (AMR) from natural language text. CAMRA offers a novel approach to deep lexical…

Computation and Language · Computer Science 2024-02-22 Jon Z. Cai , Shafiuddin Rehan Ahmed , Julia Bonn , Kristin Wright-Bettner , Martha Palmer , James H. Martin