English
Related papers

Related papers: Industry Practitioners Perspectives on AI Model Qu…

200 papers

Artificial Intelligence (AI) is an important driving force for the development and transformation of the financial industry. However, with the fast-evolving AI technology and application, unintentional bias, insufficient model validation,…

Machine Learning · Statistics 2019-12-17 Yukun Zhang , Longsheng Zhou

AI models are increasingly deployed in live clinical environments where they must perform reliably across complex, high-stakes workflows that standard training and validation datasets were never designed to capture. Evaluating these systems…

Artificial Intelligence · Computer Science 2026-05-12 Prasanna Desikan , Harshit Rajgarhia , Shivali Dalmia , Ananya Mantravadi

Artificial Intelligence (AI) systems are not intrinsically neutral and biases trickle in any type of technological tool. In particular when dealing with people, the impact of AI algorithms' technical errors originating with mislabeled data…

Artificial Intelligence · Computer Science 2025-04-03 Camilla Quaresmini , Giuseppe Primiero

This paper offers a domain-mediated comparative review of 251 studies on public attitudes toward AI, published between 2011 and 2025. Drawing on a systematic literature review, we analyse how different factors including perceived benefits…

Computers and Society · Computer Science 2025-09-24 Filip Bialy , Mark Elliot , Robert Meckin

Artificial intelligence (AI) presents new challenges for the user experience (UX) of products and services. Recently, practitioner-facing resources and design guidelines have become available to ease some of these challenges. However,…

Human-Computer Interaction · Computer Science 2023-04-21 Nur Yildirim , Mahima Pushkarna , Nitesh Goyal , Martin Wattenberg , Fernanda Viegas

Although artificial intelligence (AI) is solving real-world challenges and transforming industries, there are serious concerns about its ability to behave and make decisions in a responsible way. Many AI ethics principles and guidelines for…

Artificial Intelligence · Computer Science 2022-07-22 Qinghua Lu , Liming Zhu , Xiwei Xu , Jon Whittle , David Douglas , Conrad Sanderson

Efforts to mitigate bias and enhance fairness in the artificial intelligence (AI) community have predominantly focused on technical solutions. While numerous reviews have addressed bias in AI, this review uniquely focuses on the practical…

Artificial Intelligence · Computer Science 2024-10-24 Abdoul Jalil Djiberou Mahamadou , Artem A. Trotsyuk

As artificial intelligence (AI) becomes integral to economy and society, communication gaps between developers, users, and stakeholders hinder trust and informed decision-making. High-level AI labels, inspired by frameworks like EU energy…

Artificial Intelligence · Computer Science 2025-01-22 Raphael Fischer , Magdalena Wischnewski , Alexander van der Staay , Katharina Poitz , Christian Janiesch , Thomas Liebig

In this paper we discuss how systems with Artificial Intelligence (AI) can undergo safety assessment. This is relevant, if AI is used in safety related applications. Taking a deeper look into AI models, we show, that many models of…

Artificial Intelligence · Computer Science 2021-05-17 Jens Braband , Hendrik Schäbe

AI and its relevant technologies, including machine learning, deep learning, chatbots, virtual assistants, and others, are currently undergoing a profound transformation of development and organizational processes within companies.…

Cryptography and Security · Computer Science 2024-12-11 Tingting Bi , Guangsheng Yu , Qin Wang

Comparing model performances on benchmark datasets is an integral part of measuring and driving progress in artificial intelligence. A model's performance on a benchmark dataset is commonly assessed based on a single or a small set of…

Artificial Intelligence · Computer Science 2021-11-09 Kathrin Blagec , Georg Dorffner , Milad Moradi , Matthias Samwald

In reaction to growing concerns about the potential harms of artificial intelligence (AI), societies have begun to demand more transparency about how AI models and systems are created and used. To address these concerns, several efforts…

Computers and Society · Computer Science 2024-03-13 David Piorkowski , John Richards , Michael Hind

Public AI benchmark results are widely broadcast by model developers as indicators of model quality within a growing and competitive market. However, these advertised scores do not necessarily reflect the traits of interest to those who…

Audits are critical mechanisms for identifying the risks and limitations of deployed artificial intelligence (AI) systems. However, the effective execution of AI audits remains incredibly difficult, and practitioners often need to make use…

Computers and Society · Computer Science 2025-03-03 Victor Ojewale , Ryan Steed , Briana Vecchione , Abeba Birhane , Inioluwa Deborah Raji

Artificial Intelligence (AI) is a fast-growing research and development (R&D) discipline which is attracting increasing attention because of its promises to bring vast benefits for consumers and businesses, with considerable benefits…

Artificial Intelligence · Computer Science 2022-05-10 Zhenghua Chen , Min Wu , Alvin Chan , Xiaoli Li , Yew-Soon Ong

Machine learning (ML), artificial intelligence (AI) and other modern statistical methods are providing new opportunities to operationalize previously untapped and rapidly growing sources of data for patient benefit. Whilst there is a lot of…

Recent Artificial Intelligence (AI) models have matched or exceeded human experts in several benchmarks of biomedical task performance, but surgical benchmarks in particular are often missing from prominent medical benchmark suites. Since…

Measuring and evaluating software quality has become a fundamental task. Many models have been proposed to support stakeholders in dealing with software quality. However, in most cases, quality models do not fit perfectly for the target…

Software Engineering · Computer Science 2013-12-05 Michael Kläs , Constanza Lampasona , Jürgen Münch

Context: This study explores how software professionals identify and address biases in AI systems within the software industry, focusing on practical knowledge and real-world applications. Goal: We aimed to understand the strategies…

Software Engineering · Computer Science 2024-09-05 Ronnie de Souza Santos , Luiz Fernando de Lima , Maria Teresa Baldassarre , Rodrigo Spinola

The discussions around Artificial Intelligence (AI) and medical imaging are centered around the success of deep learning algorithms. As new algorithms enter the market, it is important for practicing radiologists to understand the pitfalls…

Image and Video Processing · Electrical Eng. & Systems 2022-11-28 Rishi Gadepally , Andrew Gomella , Eric Gingold , Paras Lakhani