English
Related papers

Related papers: Collaborative Human-AI Risk Annotation: Co-Annotat…

200 papers

As generative AI models such as large language models (LLMs) become more pervasive, ensuring the safety, robustness, and overall trustworthiness of these systems is paramount. However, AI is currently facing a reproducibility crisis driven…

Machine Learning · Computer Science 2026-05-14 Deepak Pandita , Flip Korn , Chris Welty , Christopher M. Homan

This study investigates whether large language models (LLMs) can function as intelligent collaborators to bridge expertise gaps in cybersecurity decision-making. We examine two representative tasks-phishing email detection and intrusion…

Cryptography and Security · Computer Science 2025-05-07 Shahroz Tariq , Ronal Singh , Mohan Baruwal Chhetri , Surya Nepal , Cecile Paris

We compare three methods of familiarizing a human with an artificial intelligence (AI) teammate ("agent") prior to operation in a collaborative, fast-paced intelligence, surveillance, and reconnaissance (ISR) environment. In a…

Artificial Intelligence · Computer Science 2025-05-21 Ryan Bowers , Richard Agbeyibor , Jack Kolb , Karen Feigh

We examined the mechanisms underlying productivity and performance gains from AI agents using a large-scale experiment on Pairit, a platform we developed to study human-AI collaboration. We randomly assigned 2,234 participants to…

Computers and Society · Computer Science 2026-02-06 Harang Ju , Sinan Aral

The web's information ecosystem demands fact-checking systems that are both scalable and epistemically trustworthy. Automated approaches offer efficiency but often lack transparency, while human verification remains slow and inconsistent.…

Human-Computer Interaction · Computer Science 2026-04-21 Svetlana Churina , Kokil Jaidka , Anab Maulana Barik , Harshit Aneja , Cai Yang , Wynne Hsu , Mong Li Lee

This paper introduces a collaborative, human-centred taxonomy of AI, algorithmic and automation harms. We argue that existing taxonomies, while valuable, can be narrow, unclear, typically cater to practitioners and government, and often…

As Artificial Intelligence (AI) technologies continue to advance, protecting human autonomy and promoting ethical decision-making are essential to fostering trust and accountability. Human agency (the capacity of individuals to make…

Computers and Society · Computer Science 2025-10-13 Laxmiraju Kandikatla , Branislav Radeljic

LLMs offer new creative possibilities for writers but also raise concerns about authenticity and reader trust, particularly when AI involvement is disclosed. Prior research has largely framed this as an issue of transparency and provenance,…

Human-Computer Interaction · Computer Science 2026-04-14 Syemin Park , Soobin Park , Youn-kyung Lim

Developing safe, effective, and practically useful clinical prediction models (CPMs) traditionally requires iterative collaboration between clinical experts, data scientists, and informaticists. This process refines the often small but…

Artificial Intelligence · Computer Science 2026-01-15 Jean Feng , Avni Kothari , Patrick Vossler , Andrew Bishara , Lucas Zier , Newton Addo , Aaron Kornblith , Yan Shuo Tan , Chandan Singh

The traditional evaluation of information retrieval (IR) systems is generally very costly as it requires manual relevance annotation from human experts. Recent advancements in generative artificial intelligence -- specifically large…

Information Retrieval · Computer Science 2024-07-03 Harrie Oosterhuis , Rolf Jagerman , Zhen Qin , Xuanhui Wang , Michael Bendersky

The new characteristics of AI technology have brought new challenges to the research and development of AI systems. AI technology has benefited humans, but if improperly developed, it will harm humans. At present, there is no systematic…

Human-Computer Interaction · Computer Science 2021-12-06 Wei Xu , Liezhong Ge , Zaifeng Gao

This paper investigates how collaborative AI systems can enhance user agency in identifying and evaluating misinformation on social media platforms. Traditional methods, such as personal judgment or basic fact-checking, often fall short…

Human-Computer Interaction · Computer Science 2025-07-01 Varun Sangwan , Heidi Makitalo

As Artificial Intelligence (AI) systems increasingly influence decision-making across various fields, the need to attribute responsibility for undesirable outcomes has become essential, though complicated by the complex interplay between…

Artificial Intelligence · Computer Science 2024-11-06 Yahang Qi , Bernhard Schölkopf , Zhijing Jin

We investigate whether giving LLM agents the collaborative tools and autonomy that humans naturally use for problem solving can improve their performance. We equip Claude Code agents with MCP-based social media and journaling tools and…

Artificial Intelligence · Computer Science 2025-09-18 Harper Reed , Michael Sugimura , Angelo Zangari

Collaborative AI systems (CAISs) aim at working together with humans in a shared space to achieve a common goal. This critical setting yields hazardous circumstances that could harm human beings. Thus, building such systems with strong…

Human-Computer Interaction · Computer Science 2022-09-23 Jubril Gbolahan Adigun , Matteo Camilli , Michael Felderer , Andrea Giusti , Dominik T Matt , Anna Perini , Barbara Russo , Angelo Susi

The integration of large language models (LLMs) into healthcare IoT systems promises faster decisions and improved medical support. LLMs are also deployed as multi-agent teams to assist AI doctors by debating, voting, or advising on…

Cryptography and Security · Computer Science 2025-12-04 Adeela Bashir , The Anh han , Zia Ush Shamszaman

Timely and high-quality feedback is essential for effective learning in programming courses; yet, providing such support at scale remains a challenge. While AI-based systems offer scalable and immediate help, their responses can…

Computers and Society · Computer Science 2026-01-27 Tung Phung , Heeryung Choi , Mengyan Wu , Christopher Brooks , Sumit Gulwani , Adish Singla

This workshop paper presents a critical examination of the integration of Generative AI (Gen AI) into the academic writing process, focusing on the use of AI as a collaborative tool. It contrasts the performance and interaction of two AI…

Human-Computer Interaction · Computer Science 2024-04-26 Joseph Tu , Hilda Hadan , Derrick M. Wang , Sabrina A Sgandurra , Reza Hadi Mogavi , Lennart E. Nacke

Generating regulatorily compliant Suspicious Activity Report (SAR) remains a high-cost, low-scalability bottleneck in Anti-Money Laundering (AML) workflows. While large language models (LLMs) offer promising fluency, they suffer from…

Artificial Intelligence · Computer Science 2025-09-18 Prathamesh Vasudeo Naik , Naresh Kumar Dintakurthi , Zhanghao Hu , Yue Wang , Robby Qiu

Just as other disciplines, the humanities explore how computational research approaches and tools can meaningfully contribute to scholarly knowledge production. We approach the design of computational tools through the analytical lens of…

Human-Computer Interaction · Computer Science 2023-06-23 Katrin Glinka , Claudia Müller-Birn