English
Related papers

Related papers: RobustFair: Adversarial Evaluation through Fairnes…

200 papers

Although deep neural networks (DNNs) achieve high predictive accuracy, their confidence estimates are often unreliable, potentially compromising user trust in their decisions. This has motivated research on calibrated models, where…

Machine Learning · Computer Science 2026-05-25 Ramya Hebbalaguppe , Ajay Shastry , Soumya Suvra Ghosal , Chetan Arora

Deep neural networks are susceptible to adversarial manipulations in the input domain. The extent of vulnerability has been explored intensively in cases of $\ell_p$-bounded and $\ell_p$-minimal adversarial perturbations. However, the…

Machine Learning · Computer Science 2019-10-10 Ali Dabouei , Sobhan Soleymani , Fariborz Taherkhani , Jeremy Dawson , Nasser M. Nasrabadi

Deepfake detection models face two critical challenges: generalization to unseen manipulations and demographic fairness among population groups. However, existing approaches often demonstrate that these two objectives are inherently…

Machine Learning · Computer Science 2025-07-04 Harry Cheng , Ming-Hui Liu , Yangyang Guo , Tianyi Wang , Liqiang Nie , Mohan Kankanhalli

The information bottleneck (IB) method is a feasible defense solution against adversarial attacks in deep learning. However, this method suffers from the spurious correlation, which leads to the limitation of its further improvement of…

Machine Learning · Computer Science 2022-10-27 Huan Hua , Jun Yan , Xi Fang , Weiquan Huang , Huilin Yin , Wancheng Ge

Robust optimization has been established as a leading methodology to approach decision problems under uncertainty. To derive a robust optimization model, a central ingredient is to identify a suitable model for uncertainty, which is called…

Optimization and Control · Mathematics 2021-09-10 Marc Goerigk , Jannis Kurtz

While deep neural networks (DNNs) have revolutionized many fields, their fragility to carefully designed adversarial attacks impedes the usage of DNNs in safety-critical applications. In this paper, we strive to explore the robust features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hong Wang , Yuefan Deng , Shinjae Yoo , Yuewei Lin

Despite the tremendous success of deep neural networks in various learning problems, it has been observed that adding an intentionally designed adversarial perturbation to inputs of these architectures leads to erroneous classification with…

Machine Learning · Computer Science 2018-12-19 Emilio Rafael Balda , Arash Behboodi , Rudolf Mathar

Optimizing prediction accuracy can come at the expense of fairness. Towards minimizing discrimination against a group, fair machine learning algorithms strive to equalize the behavior of a model across different groups, by imposing a…

Machine Learning · Statistics 2020-06-17 Hongyan Chang , Ta Duy Nguyen , Sasi Kumar Murakonda , Ehsan Kazemi , Reza Shokri

Deep Neural Networks (DNNs) are becoming a crucial component of modern software systems, but they are prone to fail under conditions that are different from the ones observed during training (out-of-distribution inputs) or on inputs that…

Software Engineering · Computer Science 2023-09-11 Michael Weiss , André García Gómez , Paolo Tonella

Existing bias mitigation methods for DNN models primarily work on learning debiased encoders. This process not only requires a lot of instance-level annotations for sensitive attributes, it also does not guarantee that all fairness…

Machine Learning · Computer Science 2021-10-28 Mengnan Du , Subhabrata Mukherjee , Guanchu Wang , Ruixiang Tang , Ahmed Hassan Awadallah , Xia Hu

The ubiquity of deep neural networks (DNNs), cloud-based training, and transfer learning is giving rise to a new cybersecurity frontier in which unsecure DNNs have `structural malware' (i.e., compromised weights and activation pathways). In…

Machine Learning · Computer Science 2021-02-05 N. Benjamin Erichson , Dane Taylor , Qixuan Wu , Michael W. Mahoney

Robust optimization has been widely used in nowadays data science, especially in adversarial training. However, little research has been done to quantify how robust optimization changes the optimizers and the prediction losses comparing to…

Machine Learning · Computer Science 2020-10-06 Zhun Deng , Cynthia Dwork , Jialiang Wang , Linjun Zhang

Pursuing causality from data is a fundamental problem in scientific discovery, treatment intervention, and transfer learning. This paper introduces a novel algorithmic method for addressing nonparametric invariance and causality learning in…

Statistics Theory · Mathematics 2025-11-18 Yihong Gu , Cong Fang , Peter Bühlmann , Jianqing Fan

As deep image classification applications, e.g., face recognition, become increasingly prevalent in our daily lives, their fairness issues raise more and more concern. It is thus crucial to comprehensively test the fairness of these…

Machine Learning · Computer Science 2021-12-03 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang

The robustness of deep neural networks (DNN) models has attracted increasing attention due to the urgent need for security in many applications. Numerous existing open-sourced tools or platforms are developed to evaluate the robustness of…

Machine Learning · Computer Science 2023-01-18 Jialiang Sun , Wen Yao , Tingsong Jiang , Chao Li , Xiaoqian Chen

Graph Neural Networks (GNNs) have demonstrated remarkable efficacy in tackling a wide array of graph-related tasks across diverse domains. However, a significant challenge lies in their propensity to generate biased predictions,…

Machine Learning · Computer Science 2025-01-03 Abdullah Alchihabi , Yuhong Guo

Neural networks are prone to misclassify slightly modified input images. Recently, many defences have been proposed, but none have improved the robustness of neural networks consistently. Here, we propose to use adversarial attacks as a…

Neural and Evolutionary Computing · Computer Science 2021-06-11 Shashank Kotyan , Danilo Vasconcellos Vargas

An important goal in deep learning is to learn versatile, high-level feature representations of input data. However, standard networks' representations seem to possess shortcomings that, as we illustrate, prevent them from fully realizing…

Machine Learning · Statistics 2019-09-30 Logan Engstrom , Andrew Ilyas , Shibani Santurkar , Dimitris Tsipras , Brandon Tran , Aleksander Madry

Federated learning is a prominent framework that enables clients (e.g., mobile devices or organizations) to train a collaboratively global model under a central server's orchestration while keeping local training datasets' privacy. However,…

Machine Learning · Computer Science 2021-07-20 Farnaz Tahmasebian , Jian Lou , Li Xiong

Fairness is a widely discussed topic in recommender systems, but its practical implementation faces challenges in defining sensitive features while maintaining recommendation accuracy. We propose feature fairness as the foundation to…

Information Retrieval · Computer Science 2023-09-28 Hengchang Hu , Yiming Cao , Zhankui He , Samson Tan , Min-Yen Kan