English
Related papers

Related papers: A Scoping Study of Evaluation Practices for Respon…

200 papers

This contribution explores how the integration of Artificial Intelligence (AI) into organizational practices can be effectively framed through a socio-technical perspective to comply with the requirements of Human-centered AI (HCAI).…

Human-Computer Interaction · Computer Science 2026-01-30 Thomas Herrmann

Behind the scenes of maintaining the safety of technology products from harmful and illegal digital content lies unrecognized human labor. The recent rise in the use of generative AI technologies and the accelerating demands to meet…

Human-Computer Interaction · Computer Science 2024-11-05 Alice Qian Zhang , Judith Amores , Mary L. Gray , Mary Czerwinski , Jina Suh

As artificial intelligence (AI) systems become increasingly complex and ubiquitous, these systems will be responsible for making decisions that directly affect individuals and society as a whole. Such decisions will need to be justified due…

Artificial Intelligence · Computer Science 2018-12-21 Prashan Madumal , Ronal Singh , Joshua Newn , Frank Vetere

AI-powered educational technologies have demonstrated measurable benefits for learners, but their design and evaluation have largely centered on K-12 contexts. As a result, many AI-supported learning systems remain poorly aligned with the…

In an era characterized by the pervasive integration of artificial intelligence into decision-making processes across diverse industries, the demand for trust has never been more pronounced. This thesis embarks on a comprehensive…

Machine Learning · Statistics 2024-01-18 Alessandro Castelnovo

Background: Trustworthy AI serves as a foundational pillar for two major AI ethics conferences: AIES and FAccT. However, current research often adopts techno-centric approaches, focusing primarily on technical attributes such as…

Artificial Intelligence · Computer Science 2026-04-23 Siddharth Mehrotra , Jin Huang , Xuelong Fu , Roel Dobbe , Clara I. Sánchez , Maarten de Rijke

An emerging body of research indicates that ineffective cross-functional collaboration -- the interdisciplinary work done by industry practitioners across roles -- represents a major barrier to addressing issues of fairness in AI design and…

Human-Computer Interaction · Computer Science 2023-06-13 Wesley Hanwen Deng , Nur Yildirim , Monica Chang , Motahhare Eslami , Ken Holstein , Michael Madaio

AI evaluations have become critical tools for assessing large language model capabilities and safety. This paper presents practical insights from eight months of maintaining $inspect\_evals$, an open-source repository of 70+…

Computation and Language · Computer Science 2025-07-10 Alexandra Abbas , Celia Waggoner , Justin Olive

The recent rapid advancements in artificial intelligence research and deployment have sparked more discussion about the potential ramifications of socially- and emotionally-intelligent AI. The question is not if research can produce such…

Artificial Intelligence · Computer Science 2021-07-30 Desmond C. Ong

We consider two fundamental and related issues currently faced by Artificial Intelligence (AI) development: the lack of ethics and interpretability of AI decisions. Can interpretable AI decisions help to address ethics in AI? Using a…

Artificial Intelligence · Computer Science 2021-09-21 Jean-Marie John-Mathews

Test automation is common in software development; often one tests repeatedly to identify regressions. If the amount of test cases is large, one may select a subset and only use the most important test cases. The regression test selection…

Software Engineering · Computer Science 2021-07-01 Per Erik Strandberg , Mirgita Frasheri , Eduard Paul Enoiu

Generative AI is rapidly moving from research to deployment, elevating the need for responsible development, evaluation, and governance. We conduct a PRISMA guided review of 232 studies (November 2022 - December 2025), spanning large…

We present Ethics Readiness Levels (ERLs), a four-level, iterative method to track how ethical reflection is implemented in the design of AI systems. ERLs bridge high-level ethical principles and everyday engineering by turning ethical…

Computers and Society · Computer Science 2025-12-11 Laurynas Adomaitis , Vincent Israel-Jost , Alexei Grinbaum

Artificial Intelligence (AI) has made impressive progress in recent years and represents a key technology that has a crucial impact on the economy and society. However, it is clear that AI and business models based on it can only reach…

The increasing prevalence of Artificial Intelligence (AI) in safety-critical contexts such as air-traffic control leads to systems that are practical and efficient, and to some extent explainable to humans to be trusted and accepted. The…

Computers and Society · Computer Science 2023-06-28 Sabine Theis , Sophie Jentzsch , Fotini Deligiannaki , Charles Berro , Arne Peter Raulf , Carmen Bruder

Generative AI (GenAI) models have become vital across industries, yet current evaluation methods have not adapted to their widespread use. Traditional evaluations often rely on benchmarks and fixed datasets, frequently failing to reflect…

Requirement Engineering (RE) is the foundation of successful software development. In RE, the goal is to ensure that implemented systems satisfy stakeholder needs through rigorous requirements elicitation, validation, and evaluation…

Software Engineering · Computer Science 2025-10-07 Mateen Ahmed Abbasi , Petri Ihantola , Tommi Mikkonen , Niko Mäkitalo

Since 2022, generative AI (genAI) has rapidly become integrated into workplaces. Though organizations have made commitments to use this technology "responsibly", how organizations and their employees prioritize responsibility in their…

Computers and Society · Computer Science 2025-01-29 Genevieve Smith , Natalia Luka , Merrick Osborne , Brian Lattimore , Jessica Newman , Brandie Nonnecke , Brent Mittelstadt

Because artificial intelligence (AI) increasingly mediates organizational work, fairness has become a critical governance challenge. Existing frameworks often prioritize abstract ethical principles rather than fairness-specific ones and…

Computers and Society · Computer Science 2026-04-21 Christoph Burtscher , Mateusz Dolata

In an era marked by rapid technological advancements and complex global challenges, responsible foresight has emerged as an essential framework for policymakers aiming to navigate future uncertainties and shape the future. Responsible…

Artificial Intelligence · Computer Science 2025-11-27 Maria Perez-Ortiz