English
Related papers

Related papers: Reimagining Data Work: Participatory Annotation Wo…

200 papers

While human annotations play a crucial role in language technologies, annotator subjectivity has long been overlooked in data collection. Recent studies that have critically examined this issue are often situated in the Western context, and…

Computation and Language · Computer Science 2024-04-18 Aida Mostafazadeh Davani , Mark Díaz , Dylan Baker , Vinodkumar Prabhakaran

This reflective paper explores often-unspoken challenges of designing and facilitating co-design and participatory workshops, offering practical strategies for early career researchers (ECRs) navigating these methods. Drawing from personal…

Human-Computer Interaction · Computer Science 2025-08-01 Monique Munarini

Over the past decades, cognitive neuroscientists and behavioral economists have recognized the value of describing the process of decision making in detail and modeling the emergence of decisions over time. For example, the time it takes to…

Neurons and Cognition · Quantitative Biology 2025-07-24 Mrugsen Nagsen Gopnarayan , Jaan Aru , Sebastian Gluth

To ensure that AI-infused systems work for disabled people, we need to bring accessibility datasets sourced from this community in the development lifecycle. However, there are many ethical and privacy concerns limiting greater data…

Computers and Society · Computer Science 2023-03-10 Rie Kamikubo , Kyungjun Lee , Hernisa Kacorri

This work investigates personal perspectives in visualization annotations as devices for collective data-driven storytelling. Inspired by existing efforts in critical cartography, we show how people share personal memories in a…

Human-Computer Interaction · Computer Science 2025-03-26 Tobias Kauer , Marian Dörk , Benjamin Bach

Despite the growing consensus that stakeholders affected by AI systems should participate in their design, enormous variation and implicit disagreements exist among current approaches. For researchers and practitioners who are interested in…

Human-Computer Interaction · Computer Science 2023-10-03 Fernando Delgado , Stephen Yang , Michael Madaio , Qian Yang

Participatory approaches to artificial intelligence (AI) and machine learning (ML) are gaining momentum: the increased attention comes partly with the view that participation opens the gateway to an inclusive, equitable, robust, responsible…

Computers and Society · Computer Science 2022-09-19 Abeba Birhane , William Isaac , Vinodkumar Prabhakaran , Mark Díaz , Madeleine Clare Elish , Iason Gabriel , Shakir Mohamed

In the densifying data ecosystem of today's cities, data intermediaries are crucial stakeholders in facilitating data access and use. Community advocates live in these sites of social injustices and opportunities for change. Highly…

Human-Computer Interaction · Computer Science 2025-01-15 Han Qiao , Siyi Wu , Christoph Becker

During complex knowledge work, people engage in iterative sensemaking: interpreting information, connecting ideas, and refining their understanding. Yet in current human-AI collaboration, these cognitive processes are difficult to share and…

Human-Computer Interaction · Computer Science 2026-04-14 Yoonsu Kim , Chanbin Park , Kihoon Son , Saelyne Yang , Juho Kim

Existing AI evaluation practices often fail to capture how systems actually perform in low-resource environments, where operational constraints shape usability as much as model quality. Through a structured analysis of existing benchmark…

Artificial Intelligence · Computer Science 2026-05-28 Aakash Pant , Kavya Shah , Apoorv Agnihotri , Sneha Nikam , Prasaanth Balraj , Nakul Jain

Crowdsourced annotations of data play a substantial role in the development of Artificial Intelligence (AI). It is broadly recognised that annotations of text data can contain annotator bias, where systematic disagreement in annotations can…

Computation and Language · Computer Science 2024-10-22 Terne Sasha Thorn Jakobsen , Andreas Bjerre-Nielsen , Robert Böhm

Identifying misogyny using artificial intelligence is a form of combating online toxicity against women. However, the subjective nature of interpreting misogyny poses a significant challenge to model the phenomenon. In this paper, we…

Computation and Language · Computer Science 2024-06-25 Jason Angel , Segun Taofeek Aroyehun , Grigori Sidorov , Alexander Gelbukh

This paper explores public perceptions around the role of affective computing in the workplace. It uses a series of design fictions with 46 UK based participants, unpacking their perspectives on the advantages and disadvantages of tracking…

Human-Computer Interaction · Computer Science 2022-05-18 Lachlan Urquhart , Alex Laffer , Diana Miranda

Neuroscience data are highly fragmented across labs, formats, and experimental paradigms, and reuse often requires substantial manual effort. A persistent roadblock to data reuse and integration is the need to decipher bespoke and diverse…

Machine Learning · Computer Science 2026-05-15 Ling-Qi Zhang , Kristin Branson

Machine Learning (ML) systems, particularly when deployed in high-stakes domains, are deeply consequential. They can exacerbate existing inequities, create new modes of discrimination, and reify outdated social constructs. Accordingly, the…

Computers and Society · Computer Science 2023-08-31 Glen Berman

Dialogue-based human-AI collaboration can revolutionize collaborative problem-solving, creative exploration, and social support. To realize this goal, the development of automated agents proficient in skills such as negotiating, following…

Computation and Language · Computer Science 2023-07-19 Amogh Mannekote

Participatory approaches are widely invoked in AI governance, yet participation rarely translates into durable influence. In public sector and civic AI systems, community contributions such as deliberations, annotations, prompts, and…

Computers and Society · Computer Science 2026-02-12 Rashid Mushkani

Routinely collected clinical patient data posits a valuable resource for data-driven medical innovation. Such secondary data use for medical research purposes is dependent on the patient's consent. To gain an understanding of the patients'…

Human-Computer Interaction · Computer Science 2022-08-01 David Leimstädtner , Peter Sörries , Claudia Müller-Birn

Current news commenting systems are designed based on implicitly individualistic assumptions, where discussion is the result of a series of disconnected opinions. This often results in fragmented and polarized conversations that fail to…

Human-Computer Interaction · Computer Science 2026-02-13 Yoojin Hong , Yersultan Doszhan , Joseph Seering

Generative AI tools can help users with many tasks. One such task is data analysis, which is notoriously challenging for non-expert end-users due to its expertise requirements, and where AI holds much potential, such as finding relevant…

Human-Computer Interaction · Computer Science 2024-07-04 Ian Drosos , Advait Sarkar , Xiaotong Xu , Carina Negreanu , Sean Rintel , Lev Tankelevitch