English
Related papers

Related papers: Towards Improving Robustness Against Common Corrup…

200 papers

In recent years, deep neural network is introduced in recommender systems to solve the collaborative filtering problem, which has achieved immense success on computer vision, speech recognition and natural language processing. On one hand,…

Information Retrieval · Computer Science 2020-10-14 Ge Fan , Wei Zeng , Shan Sun , Biao Geng , Weiyi Wang , Weibo Liu

Steering the behavior of a strong model pre-trained on internet-scale data can be difficult due to the scarcity of competent supervisors. Recent studies reveal that, despite supervisory noises, a strong student model may surpass its weak…

Machine Learning · Computer Science 2024-02-26 Yuejiang Liu , Alexandre Alahi

In today's era of big data, robust least-squares regression becomes a more challenging problem when considering the adversarial corruption along with explosive growth of datasets. Traditional robust methods can handle the noise but suffer…

Data Structures and Algorithms · Computer Science 2017-10-04 Xuchao Zhang , Liang Zhao , Arnold P. Boedihardjo , Chang-Tien Lu

This paper studies a challenging robust federated learning task with model heterogeneous and data corrupted clients, where the clients have different local model structures. Data corruption is unavoidable due to factors such as random…

Machine Learning · Computer Science 2025-03-13 Xiuwen Fang , Mang Ye , Bo Du

A recent trend in deep learning algorithms has been towards training large scale models, having high parameter count and trained on big dataset. However, robustness of such large scale models towards real-world settings is still a…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Nishant Jain , Harkirat Behl , Yogesh Singh Rawat , Vibhav Vineet

Deep neural network-based image compression has been extensively studied. However, the model robustness which is crucial to practical application is largely overlooked. We propose to examine the robustness of prevailing learned image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Tong Chen , Zhan Ma

Deep neural networks have achieved substantial achievements in several computer vision areas, but have vulnerabilities that are often fooled by adversarial examples that are not recognized by humans. This is an important issue for security…

Computer Vision and Pattern Recognition · Computer Science 2021-01-29 Hakmin Lee , Hong Joo Lee , Seong Tae Kim , Yong Man Ro

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

Machine Learning · Computer Science 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

The Mixture-of-Experts (MoE) model uses a set of expert networks that specialize on subsets of a dataset under the supervision of a gating network. A common issue in MoE architectures is ``expert collapse'' where overlapping class…

Neural and Evolutionary Computing · Computer Science 2026-03-31 Abien Fred Agarap , Arnulfo P. Azcarraga

The robustness of neural networks against input perturbations with bounded magnitude represents a serious concern in the deployment of deep learning models in safety-critical systems. Recently, the scientific community has focused on…

Machine Learning · Computer Science 2023-11-29 Bernd Prach , Fabio Brau , Giorgio Buttazzo , Christoph H. Lampert

In addition to high accuracy, robustness is becoming increasingly important for machine learning models in various applications. Recently, much research has been devoted to improving the model robustness by training with noise…

Machine Learning · Computer Science 2021-03-30 Kun-Peng Ning , Lue Tao , Songcan Chen , Sheng-Jun Huang

Even the state-of-the-art deep learning models lack fundamental abilities compared to humans. Multiple comparison paradigms have been proposed to explore the distinctions between humans and deep learning. While most comparisons rely on…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Jinyu Fan , Yi Zeng

In this paper, we present a novel nonlinear programming-based approach to fine-tune pre-trained neural networks to improve robustness against adversarial attacks while maintaining high accuracy on clean data. Our method introduces…

Machine Learning · Computer Science 2024-10-28 Shudian Zhao , Jan Kronqvist

Machine Learning with deep neural networks has transformed computational approaches to scientific and engineering problems. Central to many of these advancements are precisely tuned neural architectures that are tailored to the domains in…

Quantum Physics · Physics 2025-04-23 Mathias Weiden , Justin Kalloor , John Kubiatowicz , Costin Iancu

A necessary characteristic for the deployment of deep learning models in real world applications is resistance to small adversarial perturbations while maintaining accuracy on non-malicious inputs. While robust training provides models that…

Machine Learning · Statistics 2020-02-27 Aditya Saligrama , Guillaume Leclerc

Robust optimization is concerned with constructing solutions that remain feasible also when a limited number of resources is removed from the solution. Most studies of robust combinatorial optimization to date made the assumption that every…

Optimization and Control · Mathematics 2015-04-21 David Adjiashvili

In deep learning applications, robustness measures the ability of neural models that handle slight changes in input data, which could lead to potential safety hazards, especially in safety-critical applications. Pre-deployment assessment of…

Software Engineering · Computer Science 2024-04-26 Wenchuan Mu , Kwan Hui Lim

Neural network ensembles have been studied extensively in the context of adversarial robustness and most ensemble-based approaches remain vulnerable to adaptive attacks. In this paper, we investigate the robustness of Error-Correcting…

Machine Learning · Computer Science 2023-03-07 Thomas Philippon , Christian Gagné

Adversarial examples have appeared as a ubiquitous property of machine learning models where bounded adversarial perturbation could mislead the models to make arbitrarily incorrect predictions. Such examples provide a way to assess the…

Machine Learning · Computer Science 2021-03-02 Zhuolin Yang , Zhaoxi Chen , Tiffany Cai , Xinyun Chen , Bo Li , Yuandong Tian

Machine learning systems based on deep neural networks, being able to produce state-of-the-art results on various perception tasks, have gained mainstream adoption in many applications. However, they are shown to be vulnerable to…

Machine Learning · Computer Science 2018-01-16 Bo Luo , Yannan Liu , Lingxiao Wei , Qiang Xu