English
Related papers

Related papers: NoisyMix: Boosting Model Robustness to Common Corr…

200 papers

The last decade has witnessed the breakthrough of deep neural networks (DNNs) in many fields. With the increasing depth of DNNs, hundreds of millions of multiply-and-accumulate (MAC) operations need to be executed. To accelerate such…

Hardware Architecture · Computer Science 2022-11-29 Amro Eldebiky , Grace Li Zhang , Georg Boecherer , Bing Li , Ulf Schlichtmann

Noisy labels can impair model performance, making the study of learning with noisy labels an important topic. Two conventional approaches are noise modeling and noise detection. However, these two methods are typically studied…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Siqi Wang , Chau Pham , Bryan A. Plummer

Mixup is a data augmentation technique that creates new examples as convex combinations of training points and labels. This simple technique has empirically shown to improve the accuracy of many state-of-the-art models in different settings…

Machine Learning · Computer Science 2026-05-28 Luigi Carratino , Moustapha Cissé , Rodolphe Jenatton , Jean-Philippe Vert

Despite the success of convolutional neural networks (CNNs) in many academic benchmarks for computer vision tasks, their application in the real-world is still facing fundamental challenges. One of these open problems is the inherent lack…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Julia Grabinski , Paul Gavrikov , Janis Keuper , Margret Keuper

The conditional diffusion model (CDM) enhances the standard diffusion model by providing more control, improving the quality and relevance of the outputs, and making the model adaptable to a wider range of complex tasks. However, inaccurate…

Machine Learning · Computer Science 2024-08-07 Weifeng Xu , Xiang Zhu , Xiaoyong Li

While deep neural networks can attain good accuracy on in-distribution test points, many applications require robustness even in the face of unexpected perturbations in the input, changes in the domain, or other sources of distribution…

Machine Learning · Computer Science 2022-10-12 Marvin Zhang , Sergey Levine , Chelsea Finn

Recently, a number of image-mixing-based augmentation techniques have been introduced to improve the generalization of deep neural networks. In these techniques, two or more randomly selected natural images are mixed together to generate an…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Khawar Islam , Muhammad Zaigham Zaheer , Arif Mahmood , Karthik Nandakumar

We introduce a novel, biologically plausible local learning rule that provably increases the robustness of neural dynamics to noise in nonlinear recurrent neural networks with homogeneous nonlinearities. Our learning rule achieves higher…

Neurons and Cognition · Quantitative Biology 2022-10-12 Christopher H. Stock , Sarah E. Harvey , Samuel A. Ocko , Surya Ganguli

In multimedia understanding tasks, corrupted samples pose a critical challenge, because when fed to machine learning models they lead to performance degradation. In the past, three groups of approaches have been proposed to handle noisy…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Francesco Barbato , Umberto Michieli , Mehmet Kerim Yucel , Pietro Zanuttigh , Mete Ozay

The growing scale and complexity of safety-critical control systems underscore the need to evolve current control architectures aiming for the unparalleled performances achievable through state-of-the-art optimization and machine learning…

Systems and Control · Electrical Eng. & Systems 2024-09-30 Luca Furieri , Clara Lucía Galimberti , Giancarlo Ferrari-Trecate

Recent advances in reasoning models and agentic AI systems have led to an increased reliance on diverse external information. However, this shift introduces input contexts that are inherently noisy, a reality that current sanitized…

Artificial Intelligence · Computer Science 2026-01-13 Seongyun Lee , Yongrae Jo , Minju Seo , Moontae Lee , Minjoon Seo

Deep neural networks have enabled improved image quality and fast inference times for various inverse problems, including accelerated magnetic resonance imaging (MRI) reconstruction. However, such models require a large number of…

Image and Video Processing · Electrical Eng. & Systems 2022-06-20 Arjun D Desai , Beliz Gunel , Batu M Ozturkler , Harris Beg , Shreyas Vasanawala , Brian A Hargreaves , Christopher Ré , John M Pauly , Akshay S Chaudhari

Learning with Noisy Labels (LNL) has become an appealing topic, as imperfectly annotated data are relatively cheaper to obtain. Recent state-of-the-art approaches employ specific selection mechanisms to separate clean and noisy samples and…

Machine Learning · Computer Science 2023-08-04 Ruixuan Xiao , Yiwen Dong , Haobo Wang , Lei Feng , Runze Wu , Gang Chen , Junbo Zhao

Neural networks have become increasingly popular in controller design due to their versatility and efficiency. However, their integration into feedback systems can pose stability challenges, particularly in the presence of uncertainties.…

Optimization and Control · Mathematics 2025-03-04 Yuhao Zhang , Xiangru Xu

There is a growing need for models that are interpretable and have reduced energy and computational cost (e.g., in health care analytics and federated learning). Examples of algorithms to train such models include logistic regression and…

Machine Learning · Computer Science 2023-02-21 Tyler Sypherd , Nathan Stromberg , Richard Nock , Visar Berisha , Lalitha Sankar

Robustness is a crucial factor for the successful deployment of robots in unstructured environments, particularly in the domain of Simultaneous Localization and Mapping (SLAM). Simulation-based benchmarks have emerged as a highly scalable…

Generalization is one of the fundamental issues in machine learning. However, traditional techniques like uniform convergence may be unable to explain generalization under overparameterization. As alternative approaches, techniques based on…

Machine Learning · Computer Science 2022-03-22 Jiaye Teng , Jianhao Ma , Yang Yuan

Artificial and biological agents cannon learn given completely random and unstructured data. The structure of data is encoded in the metric relationships between data points. In the context of neural networks, neuronal activity within a…

Machine Learning · Computer Science 2022-11-03 Kosio Beshkov , Jonas Verhellen , Mikkel Elle Lepperød

With the introduction of machine learning in high-stakes decision making, ensuring algorithmic fairness has become an increasingly important problem to solve. In response to this, many mathematical definitions of fairness have been…

Machine Learning · Computer Science 2024-06-04 Edward Small , Wei Shao , Zeliang Zhang , Peihan Liu , Jeffrey Chan , Kacper Sokol , Flora Salim

A recently-proposed technique called self-adaptive training augments modern neural networks by allowing them to adjust training labels on the fly, to avoid overfitting to samples that may be mislabeled or otherwise non-representative. By…

Machine Learning · Computer Science 2020-06-16 Daniel Chiu , Franklyn Wang , Scott Duke Kominers