English
Related papers

Related papers: Investigating the Robustness of Artificial Intelli…

200 papers

AI systems, in particular with deep learning techniques, have demonstrated superior performance for various real-world applications. Given the need for tailored optimization in specific scenarios, as well as the concerns related to the…

Artificial Intelligence · Computer Science 2024-11-12 Zhiyu Zhu , Zhibo Jin , Hongsheng Hu , Minhui Xue , Ruoxi Sun , Seyit Camtepe , Praveen Gauravaram , Huaming Chen

Reliable and robust evaluation methods are a necessary first step towards developing machine learning models that are themselves robust and reliable. Unfortunately, current evaluation protocols typically used to assess classifiers fail to…

Machine Learning · Computer Science 2025-05-26 Michael W. Spratling

Fairness and robustness are critical elements of Trustworthy AI that need to be addressed together. Fairness is about learning an unbiased model while robustness is about learning from corrupted data, and it is known that addressing only…

Machine Learning · Computer Science 2021-10-28 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

This chapter introduces and investigates some fundamental questions on the relationship between accuracy and robustness in both classical and quantum classification algorithms under noisy and adversarial conditions. We introduce and clarify…

Quantum Physics · Physics 2026-02-18 Nana Liu

Autonomous systems increasingly rely on machine learning techniques to transform high-dimensional raw inputs into predictions that are then used for decision-making and control. However, it is often easy to maliciously manipulate such…

Machine Learning · Computer Science 2023-02-07 Jinghan Yang , Hunmin Kim , Wenbin Wan , Naira Hovakimyan , Yevgeniy Vorobeychik

Algorithms are increasingly common components of high-impact decision-making, and a growing body of literature on adversarial examples in laboratory settings indicates that standard machine learning models are not robust. This suggests that…

Machine Learning · Statistics 2018-11-28 Suproteem K. Sarkar , Kojin Oshiba , Daniel Giebisch , Yaron Singer

The development of Artificial Intelligence (AI), including AI in Science (AIS), should be done following the principles of responsible AI. Progress in responsible AI is often quantified through evaluation metrics, yet there has been less…

Computers and Society · Computer Science 2025-10-31 Theresia Veronika Rampisela , Maria Maistro , Tuukka Ruotsalo , Christina Lioma

Adversarial training (i.e., training on adversarially perturbed input data) is a well-studied method for making neural networks robust to potential adversarial attacks during inference. However, the improved robustness does not come for…

Robotics · Computer Science 2023-01-27 Mathias Lechner , Alexander Amini , Daniela Rus , Thomas A. Henzinger

We tackle here a specific, still not widely addressed aspect, of AI robustness, which consists of seeking invariance / insensitivity of model performance to hidden factors of variations in the data. Towards this end, we employ a two step…

Machine Learning · Computer Science 2022-03-04 William Paul , Philippe Burlina

Existing approaches to algorithmic fairness aim to ensure equitable outcomes if human decision-makers comply perfectly with algorithmic decisions. However, perfect compliance with the algorithm is rarely a reality or even a desirable…

Machine Learning · Computer Science 2025-07-01 Haosen Ge , Hamsa Bastani , Osbert Bastani

Safety goes first. Meeting and maintaining industry safety standards for robustness of artificial intelligence (AI) and machine learning (ML) models require continuous monitoring for faults and performance drops. Deep learning models are…

Machine Learning · Computer Science 2023-02-03 Aria Khademi , Michael Hopka , Devesh Upadhyay

In this discussion paper, we survey recent research surrounding robustness of machine learning models. As learning algorithms become increasingly more popular in data-driven control systems, their robustness to data uncertainty must be…

Machine Learning · Computer Science 2022-09-28 Brendon G. Anderson , Tanmay Gautam , Somayeh Sojoudi

Robust optimization is a young and emerging field of research having received a considerable increase of interest over the last decade. In this paper, we argue that the the algorithm engineering methodology fits very well to the field of…

Optimization and Control · Mathematics 2016-01-12 Marc Goerigk , Anita Schöbel

As machine learning models become increasingly prevalent in critical decision-making models and systems in fields like finance, healthcare, etc., ensuring their robustness against adversarial attacks and changes in the input data is…

Machine Learning · Statistics 2024-08-05 Arun Prakash R , Anwesha Bhattacharyya , Joel Vaughan , Vijayan N. Nair

Despite extraordinary progress, current machine learning systems have been shown to be brittle against adversarial examples: seemingly innocuous but carefully crafted perturbations of test examples that cause machine learning predictors to…

Machine Learning · Computer Science 2023-06-14 Omar Montasser

Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Richa Singh , Akshay Agarwal , Maneet Singh , Shruti Nagpal , Mayank Vatsa

Context:With the advancement of artificial intelligence (AI) technology and applications, numerous AI models have been developed, leading to the emergence of open-source model hosting platforms like Hugging Face (HF). Thanks to these…

Software Engineering · Computer Science 2024-08-07 Hao Qin , Mingyang Li , Junjie Wang , Qing Wang

Algorithm fairness has become a central problem for the broad adoption of artificial intelligence. Although the past decade has witnessed an explosion of excellent work studying algorithm biases, achieving fairness in real-world AI…

Machine Learning · Computer Science 2023-09-06 James Enouen , Tianshu Sun , Yan Liu

Recent research in artificial intelligence and machine learning has largely emphasized general-purpose learning and ever-larger training sets and more and more compute. In contrast, I propose a hybrid, knowledge-driven, reasoning-based…

Artificial Intelligence · Computer Science 2020-02-20 Gary Marcus

Many decision-making scenarios in modern life benefit from the decision support of artificial intelligence algorithms, which focus on a data-driven philosophy and automated programs or systems. However, crucial decision issues related to…

Artificial Intelligence · Computer Science 2023-12-29 Xia Wang , Anda Liang , Jonathan Sprinkle , Taylor T. Johnson