English
Related papers

Related papers: Auditing AI models for Verified Deployment under S…

200 papers

Audits contribute to the trustworthiness of Learning Analytics (LA) systems that integrate Artificial Intelligence (AI) and may be legally required in the future. We argue that the efficacy of an audit depends on the auditability of the…

Computers and Society · Computer Science 2024-11-15 Linda Fernsel , Yannick Kalff , Katharina Simbeck

Testing deep learning (DL) systems requires extensive and diverse, yet valid, test inputs. While synthetic test input generation methods, such as metamorphic testing, are widely used for DL testing, they risk introducing invalid inputs that…

Software Engineering · Computer Science 2025-01-06 Delaram Ghobari , Mohammad Hossein Amini , Dai Quoc Tran , Seunghee Park , Shiva Nejati , Mehrdad Sabetzadeh

Conventionally, AI models are thought to trade off explainability for lower accuracy. We develop a training strategy that not only leads to a more explainable AI system for object classification, but as a consequence, suffers no perceptible…

Computer Vision and Pattern Recognition · Computer Science 2020-03-17 Andrea Zunino , Sarah Adel Bargal , Riccardo Volpi , Mehrnoosh Sameki , Jianming Zhang , Stan Sclaroff , Vittorio Murino , Kate Saenko

The recent spike in certified Artificial Intelligence (AI) tools for healthcare has renewed the debate around adoption of this technology. One thread of such debate concerns Explainable AI (XAI) and its promise to render AI devices more…

Artificial Intelligence · Computer Science 2023-02-27 Giovanni Cinà , Tabea E. Röber , Rob Goedhart , Ş. İlker Birbil

Human-in-the-loop validation is essential in safety-critical clinical AI, yet the transition between initial model inference and expert correction is rarely analyzed as a structured signal. We introduce a diagnostic alignment framework in…

Artificial Intelligence · Computer Science 2026-02-27 Dimitrios P. Panagoulias , Evangelia-Aikaterini Tsichrintzi , Georgios Savvidis , Evridiki Tsoureli-Nikita

The objectives that Large Language Models (LLMs) implicitly optimize remain dangerously opaque, making trustworthy alignment and auditing a grand challenge. While Inverse Reinforcement Learning (IRL) can infer reward functions from…

Machine Learning · Computer Science 2025-10-09 Matthieu Bou , Nyal Patel , Arjun Jagota , Satyapriya Krishna , Sonali Parbhoo

Deep Neural Networks have become the dominant solution for Autonomous Driving perception, but their opacity conflicts with emerging Trustworthy AI guidelines and complicates safety assurance, debugging, and human oversight. While…

Robotics · Computer Science 2026-05-25 Till Beemelmanns , Shayan Sharifi , Manas Mehrotra , Ayushman Choudhuri , Lutz Eckstein

Large language models (LLMs) are increasingly used in the social sciences to simulate human behavior, based on the assumption that they can generate realistic, human-like text. Yet this assumption remains largely untested. Existing…

Computation and Language · Computer Science 2025-11-26 Nicolò Pagan , Petter Törnberg , Christopher A. Bail , Anikó Hannák , Christopher Barrie

Deep Learning (DL) is penetrating into a diverse range of mass mobility, smart living, and industrial applications, rapidly transforming the way we live and work. DL is at the heart of many AI implementations. A key set of challenges is to…

Networking and Internet Architecture · Computer Science 2023-11-27 Weisi Guo , Schyler Sun , Bin Li , Sam Blakeman

Prognostic and diagnostic AI-based medical devices hold immense promise for advancing healthcare, yet their rapid development has outpaced the establishment of appropriate validation methods. Existing approaches often fall short in…

Machine Learning · Computer Science 2024-09-10 Florian Hellmeier , Kay Brosien , Carsten Eickhoff , Alexander Meyer

With the rise in the wholesale adoption of Deep Learning (DL) models in nearly all aspects of society, a unique set of challenges is imposed. Primarily centered around the architectures of these models, these risks pose a significant…

Cryptography and Security · Computer Science 2024-09-17 Jamal Al-Karaki , Muhammad Al-Zafar Khan , Mostafa Mohamad , Dababrata Chowdhury

Deep learning (DL) has emerged as a promising tool to downscale climate projections at regional-to-local scales from large-scale atmospheric fields following the perfect-prognosis (PP) approach. Given their complexity, it is crucial to…

Machine Learning · Statistics 2023-02-06 Jose González-Abad , Jorge Baño-Medina , José Manuel Gutiérrez

Few-shot-based facial recognition systems have gained increasing attention due to their scalability and ability to work with a few face images during the model deployment phase. However, the power of facial recognition systems enables…

Cryptography and Security · Computer Science 2023-04-07 Min Chen , Zhikun Zhang , Tianhao Wang , Michael Backes , Yang Zhang

Deep Learning (DL) has been widely adopted in diverse industrial domains, including autonomous driving, intelligent healthcare, and aided programming. Like traditional software, DL systems are also prone to faults, whose malfunctioning may…

Machine Learning · Computer Science 2026-01-01 Hanmo You , Zan Wang , Zishuo Dong , Luanqi Mo , Jianjun Zhao , Junjie Chen

Deep Learning (DL) models have rapidly advanced, focusing on achieving high performance through testing model accuracy and robustness. However, it is unclear whether DL projects, as software systems, are tested thoroughly or functionally…

Software Engineering · Computer Science 2024-02-27 Han Wang , Sijia Yu , Chunyang Chen , Burak Turhan , Xiaodong Zhu

This research paper delves into the evolving landscape of fine-tuning large language models (LLMs) to align with human users, extending beyond basic alignment to propose "personality alignment" for language models in organizational…

Human-Computer Interaction · Computer Science 2023-12-07 Byunggu Yu , Junwhan Kim

The explosion of visual content available online underscores the requirement for an accurate machine assessor to robustly evaluate scores across diverse types of visual contents. While recent studies have demonstrated the exceptional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Haoning Wu , Zicheng Zhang , Weixia Zhang , Chaofeng Chen , Liang Liao , Chunyi Li , Yixuan Gao , Annan Wang , Erli Zhang , Wenxiu Sun , Qiong Yan , Xiongkuo Min , Guangtao Zhai , Weisi Lin

Deploying machine learning in regulated financial environments -- credit risk, fraud detection, and anti-money laundering -- exposes critical vulnerabilities in algorithmic reproducibility. While early financial ML addressed statistical…

Artificial Intelligence · Computer Science 2026-05-28 Ruizhe Zhou , Xiaoyang Liu , Gaoyuan Du , Yi Zheng , Shouxi Ren , Deepayan Chakrabarti , Dengdu Jiang

Financial statement auditing is essential for stakeholders to understand a company's financial health, yet current manual processes are inefficient and error-prone. Even with extensive verification procedures, auditors frequently miss…

Information Retrieval · Computer Science 2025-06-24 Rushi Wang , Jiateng Liu , Weijie Zhao , Shenglan Li , Denghui Zhang

The remarkable achievements of Artificial Intelligence (AI) algorithms, particularly in Machine Learning (ML) and Deep Learning (DL), have fueled their extensive deployment across multiple sectors, including Software Engineering (SE).…

Software Engineering · Computer Science 2025-02-06 Sicong Cao , Xiaobing Sun , Ratnadira Widyasari , David Lo , Xiaoxue Wu , Lili Bo , Jiale Zhang , Bin Li , Wei Liu , Di Wu , Yixin Chen