English
Related papers

Related papers: Robust Neural Processes for Noisy Data

200 papers

This paper is centered around the approximation of dynamical systems by means of Gaussian processes. To this end, trajectories of such systems must be collected to be used as training data. The measurements of these trajectories are…

Systems and Control · Electrical Eng. & Systems 2025-04-02 Tobias M. Wolff , Victor G. Lopez , Matthias A. Müller

Supervised fine-tuning (SFT) plays a crucial role in adapting large language models (LLMs) to specific domains or tasks. However, as demonstrated by empirical experiments, the collected data inevitably contains noise in practical…

Computation and Language · Computer Science 2024-12-20 Junyu Luo , Xiao Luo , Kaize Ding , Jingyang Yuan , Zhiping Xiao , Ming Zhang

In this paper we explore audiovisual emotion recognition under noisy acoustic conditions with a focus on speech features. We attempt to answer the following research questions: (i) How does speech emotion recognition perform on noisy data?…

Sound · Computer Science 2021-03-03 Michael Neumann , Ngoc Thang Vu

Diffusion models (DMs) are a powerful generative framework that have attracted significant attention in recent years. However, the high computational cost of training DMs limits their practical applications. In this paper, we start with a…

Machine Learning · Computer Science 2024-04-12 Tianshuo Xu , Peng Mi , Ruilin Wang , Yingcong Chen

State-of-the art vision models can achieve superhuman performance on image classification tasks when testing and training data come from the same distribution. However, when models are tested on corrupted images (e.g. due to scale changes,…

Machine Learning · Computer Science 2019-06-11 Luke Metz , Niru Maheswaranathan , Jonathon Shlens , Jascha Sohl-Dickstein , Ekin D. Cubuk

In recent years, non-monotonic Inductive Logic Programming has received growing interest. Specifically, several new learning frameworks and algorithms have been introduced for learning under the answer set semantics, allowing the learning…

Artificial Intelligence · Computer Science 2018-08-28 Mark Law , Alessandra Russo , Krysia Broda

Learning in uncertain, noisy, or adversarial environments is a challenging task for deep neural networks (DNNs). We propose a new theoretically grounded and efficient approach for robust learning that builds upon Bayesian estimation and…

Machine Learning · Computer Science 2021-11-12 Giuseppina Carannante , Dimah Dera , Ghulam Rasool , Nidhal C. Bouaynaya , Lyudmila Mihaylova

In low-resource settings, the performance of supervised labeling models can be improved with automatically annotated or distantly supervised data, which is cheap to create but often noisy. Previous works have shown that significant…

Computation and Language · Computer Science 2019-11-06 Lukas Lange , Michael A. Hedderich , Dietrich Klakow

Performative prediction is a framework for learning models that influence the data they intend to predict. We focus on finding classifiers that are performatively stable, i.e. optimal for the data distribution they induce. Standard…

Machine Learning · Computer Science 2025-02-07 Mehrnaz Mofakhami , Ioannis Mitliagkas , Gauthier Gidel

Many learning tasks in machine learning can be viewed as taking a gradient step towards minimizing the average loss of a batch of examples in each training iteration. When noise is prevalent in the data, this uniform treatment of examples…

Machine Learning · Computer Science 2021-04-06 Negin Majidi , Ehsan Amid , Hossein Talebi , Manfred K. Warmuth

Noisy labels composed of correct and corrupted ones are pervasive in practice. They might significantly deteriorate the performance of convolutional neural networks (CNNs), because CNNs are easily overfitted on corrupted labels. To address…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Xiaoshuang Shi , Zhenhua Guo , Kang Li , Yun Liang , Xiaofeng Zhu

Label noise is ubiquitous in real-world scenarios, posing a practical challenge to supervised models due to its effect in hurting the generalization performance of deep neural networks. Existing methods primarily employ the sample selection…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Mengmeng Sheng , Zeren Sun , Tao Chen , Shuchao Pang , Yucheng Wang , Yazhou Yao

Diffusion models have become fundamental tools for modeling data distributions in machine learning. Despite their success, these models face challenges when generating data with extreme brightness values, as evidenced by limitations…

Machine Learning · Statistics 2026-04-10 Takuro Kutsuna

Noisy training set usually leads to the degradation of generalization and robustness of neural networks. In this paper, we propose using a theoretically guaranteed noisy label detection framework to detect and remove noisy data for Learning…

Machine Learning · Computer Science 2022-03-22 Yikai Wang , Xinwei Sun , Yanwei Fu

Despite recent monumental advances in the field, many Natural Language Processing (NLP) models still struggle to perform adequately on noisy domains. We propose a novel probabilistic embedding-level method to improve the robustness of NLP…

Computation and Language · Computer Science 2021-04-20 Kira A. Selby , Yinong Wang , Ruizhe Wang , Peyman Passban , Ahmad Rashid , Mehdi Rezagholizadeh , Pascal Poupart

The behavior of recurrent neural network for the data-driven simulation of noisy dynamical systems is studied by training a set of Long Short-Term Memory Networks (LSTM) on the Mackey-Glass time series with a wide range of noise level. It…

Neural and Evolutionary Computing · Computer Science 2019-04-11 Kyongmin Yeo

Neural Processes (NPs) are powerful and flexible models able to incorporate uncertainty when representing stochastic processes, while maintaining a linear time complexity. However, NPs produce a latent description by aggregating independent…

Machine Learning · Computer Science 2020-09-30 Ben Day , Cătălina Cangea , Arian R. Jamasb , Pietro Liò

Industry datasets used for text classification are rarely created for that purpose. In most cases, the data and target predictions are a by-product of accumulated historical data, typically fraught with noise, present in both the text-based…

Information Retrieval · Computer Science 2018-09-12 Emilia Apostolova , R. Andrew Kreek

The availability of large labeled datasets has allowed Convolutional Network models to achieve impressive recognition results. However, in many settings manual annotation of the data is impractical; instead our data has noisy labels, i.e.…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Sainbayar Sukhbaatar , Joan Bruna , Manohar Paluri , Lubomir Bourdev , Rob Fergus

The notion of neural collapse refers to several emergent phenomena that have been empirically observed across various canonical classification problems. During the terminal phase of training a deep neural network, the feature embedding of…

Machine Learning · Computer Science 2023-04-05 Duc Anh Nguyen , Ron Levie , Julian Lienen , Gitta Kutyniok , Eyke Hüllermeier
‹ Prev 1 8 9 10 Next ›