English
Related papers

Related papers: Reimagining Data Work: Participatory Annotation Wo…

200 papers

Society's capacity for algorithmic problem-solving has never been greater. Artificial Intelligence is now applied across more domains than ever, a consequence of powerful abstractions, abundant data, and accessible software. As capabilities…

Machine Learning · Statistics 2024-08-20 Kris Sankaran

As full AI-based automation remains out of reach in most real-world applications, the focus has instead shifted to leveraging the strengths of both human and AI agents, creating effective collaborative systems. The rapid advances in this…

Human-Computer Interaction · Computer Science 2024-04-19 Steffen Holter , Mennatallah El-Assady

Public participation is indispensable for an insightful understanding of the ethics issues raised by AI technologies. Twitter is selected in this paper to serve as an online public sphere for exploring discourse on AI ethics, facilitating…

Computers and Society · Computer Science 2024-06-21 Mengyi Wei , Puzhen Zhang , Chuan Chen , Dongsheng Chen , Chenyu Zuo , Liqiu Meng

As societal challenges grow more complex, access to data for public interest use is paradoxically becoming more constrained. This emerging data winter is not simply a matter of scarcity, but of shrinking legitimate and trusted pathways for…

Computers and Society · Computer Science 2026-01-13 Stefaan Verhulst

Majority voting and averaging are common approaches employed to resolve annotator disagreements and derive single ground truth labels from multiple annotations. However, annotators may systematically disagree with one another, often…

Computation and Language · Computer Science 2021-10-13 Aida Mostafazadeh Davani , Mark Díaz , Vinodkumar Prabhakaran

It is important for researchers to understand precisely how data scientists turn raw data into insights, including typical programming patterns, workflow, and methodology. This paper contributes a novel system, called DataInquirer, that…

Human-Computer Interaction · Computer Science 2024-05-29 Jinjin Zhao , Avidgor Gal , Sanjay Krishnan

Collaboration is a task-oriented, high-level human behavior. In most cases, conversation serves as the primary medium for information exchange and coordination, making conversational data a valuable resource for the automatic analysis of…

Computation and Language · Computer Science 2026-03-31 Yi Yu , Maria Boritchev , Chloé Clavel

Using novel approaches to dataset development, the Biasly dataset captures the nuance and subtlety of misogyny in ways that are unique within the literature. Built in collaboration with multi-disciplinary experts and annotators themselves,…

Computation and Language · Computer Science 2023-11-17 Brooklyn Sheppard , Anna Richter , Allison Cohen , Elizabeth Allyn Smith , Tamara Kneese , Carolyne Pelletier , Ioana Baldini , Yue Dong

The rise of multi-agent systems powered by large language models (LLMs) and specialized reasoning agents exposes fundamental limitations in today's data management architectures. Traditional databases and data fabrics were designed for…

Multiagent Systems · Computer Science 2025-12-11 Ioana Giurgiu , Michael E. Nidd

As the public seeks greater accountability and transparency from machine learning algorithms, the research literature on methods to explain algorithms and their outputs has rapidly expanded. Feature importance methods form a popular class…

Computers and Society · Computer Science 2021-02-01 Leif Hancox-Li , I. Elizabeth Kumar

The growing popularity of AI writing assistants presents exciting opportunities to craft tools that cater to diverse user needs. This study explores how personality shapes preferences for AI writing companions and how personalized designs…

Human-Computer Interaction · Computer Science 2025-09-16 Mengke Wu , Kexin Quan , Weizi Liu , Mike Yao , Jessie Chin

Participatory data physicalisation (PDP) is recognised for its potential to support data-driven decisions among stakeholders who collaboratively construct physical elements into commonly insightful visualisations. Like all participatory…

Human-Computer Interaction · Computer Science 2025-03-18 Silvia Cazacu , Georgia Panagiotidou , Therese Steenberghen , Andrew Vande Moere

Within an increasingly digitalized organizational landscape, this research delves into the dynamics of decentralized collaboration, contrasting it with traditional collaboration models. An effective capturing of high-level collaborations…

Social and Information Networks · Computer Science 2024-10-10 Negin Maddah , Babak Heydari

Widespread integration of Generative AI tools is transforming white-collar work, reshaping how workers define their roles, manage their tasks, and collaborate with peers. This has created a need to develop an overarching understanding of…

Human-Computer Interaction · Computer Science 2025-06-24 Matthew Law , Rama Adithya Varanasi

Annotations play a vital role in highlighting critical aspects of visualizations, aiding in data externalization and exploration, collaborative sensemaking, and visual storytelling. However, despite their widespread use, we identified a…

Human-Computer Interaction · Computer Science 2026-04-10 Md Dilshadur Rahman , Ghulam Jilani Quadri , Bhavana Doppalapudi , Danielle Albers Szafir , Paul Rosen

Despite AI tools becoming increasingly embedded in academic practice, little is known about how university students integrate them into their writing processes. We examine how students engage with AI across different writing tasks, and how…

Human-Computer Interaction · Computer Science 2026-04-29 Silvia Bodei , Duncan P. Brumby , Katie Fisher , Jon Mella

Various tools and practices have been developed to support practitioners in identifying, assessing, and mitigating fairness-related harms caused by AI systems. However, prior research has highlighted gaps between the intended design of…

Artificial Intelligence · Computer Science 2022-02-14 Michael Madaio , Lisa Egede , Hariharan Subramonyam , Jennifer Wortman Vaughan , Hanna Wallach

In the contemporary world of AI and data-driven applications, supervised machines often derive their understanding, which they mimic and reproduce, through annotations--typically conveyed in the form of words or labels. However, such…

Artificial Intelligence · Computer Science 2024-06-13 Delfina Sol Martinez Pandiani , Valentina Presutti

This study reports findings from a cross-sectional survey (n = 72) of higher education practitioners examining beliefs, behaviors, and institutional conditions related to artificial intelligence (AI) integration in teaching and learning.…

Artificial Intelligence · Computer Science 2026-05-29 David Gibson , M. Elizabeth Azukas , Gerald Knezek

Much attention and concern has been raised recently about bias and the use of machine learning algorithms in healthcare, especially as it relates to perpetuating racial discrimination and health disparities. Following an initial system…

Machine Learning · Computer Science 2023-05-24 Jill A. Kuhlberg , Irene Headen , Ellis A. Ballard , Donald Martin