English
Related papers

Related papers: Deep Active Learning with Noise Stability

200 papers

This work proposes a robust data-driven predictive control approach for unknown nonlinear systems in the presence of bounded process and measurement noise. Data-driven reachable sets are employed for the controller design instead of using…

Systems and Control · Electrical Eng. & Systems 2023-07-18 Mahsa Farjadnia , Amr Alanwar , Muhammad Umar B. Niazi , Marco Molinari , Karl Henrik Johansson

Deep learning has emerged as a promising paradigm to give access to highly accurate predictions of molecular and materials properties. A common short-coming shared by current approaches, however, is that neural networks only give point…

Computational Physics · Physics 2023-05-10 Albert Zhu , Simon Batzner , Albert Musaelian , Boris Kozinsky

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

Recent breakthroughs made by deep learning rely heavily on large number of annotated samples. To overcome this shortcoming, active learning is a possible solution. Beside the previous active learning algorithms that only adopted information…

Computer Vision and Pattern Recognition · Computer Science 2019-10-29 Junyu Liu , Xiang Li , Jin Wang , Jiqiang Zhou , Jianxiong Shen

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

In the machine learning domain, active learning is an iterative data selection algorithm for maximizing information acquisition and improving model performance with limited training samples. It is very useful, especially for the industrial…

Machine Learning · Statistics 2020-04-24 Xiaowei Yue , Yuchen Wen , Jeffrey H. Hunt , Jianjun Shi

We present a novel approach for training deep neural networks in a Bayesian way. Classical, i.e. non-Bayesian, deep learning has two major drawbacks both originating from the fact that network parameters are considered to be deterministic.…

Machine Learning · Statistics 2019-03-11 Konstantin Posch , Jan Steinbrener , Jürgen Pilz

This work investigates the detection of instabilities that may occur when utilizing deep learning models for image reconstruction tasks. Although neural networks often empirically outperform traditional reconstruction methods, their usage…

Image and Video Processing · Electrical Eng. & Systems 2020-03-31 Jan Macdonald , Maximilian März , Luis Oala , Wojciech Samek

Neural networks (NNs) can achieved high performance in various fields such as computer vision, and natural language processing. However, deploying NNs in resource-constrained safety-critical systems has challenges due to uncertainty in the…

Machine Learning · Computer Science 2024-01-17 Soyed Tuhin Ahmed

Modern deep learning faces significant challenges with noisy labels, class ambiguity, as well as the need to robustly reject out-of-distribution or corrupted samples. In this work, we propose a unified framework based on the concept of a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yasser Taha , Grégoire Montavon , Nils Körber

Learning and decision-making in domains with naturally high noise-to-signal ratio, such as Finance or Healthcare, is often challenging, while the stakes are very high. In this paper, we study the problem of learning and acting under a…

Machine Learning · Computer Science 2023-09-26 Yikai Zhang , Songzhu Zheng , Mina Dalirrooyfard , Pengxiang Wu , Anderson Schneider , Anant Raj , Yuriy Nevmyvaka , Chao Chen

We propose a simple method that combines neural networks and Gaussian processes. The proposed method can estimate the uncertainty of outputs and flexibly adjust target functions where training data exist, which are advantages of Gaussian…

Machine Learning · Statistics 2017-07-20 Tomoharu Iwata , Zoubin Ghahramani

Data-driven control in unknown environments requires a clear understanding of the involved uncertainties for ensuring safety and efficient exploration. While aleatoric uncertainty that arises from measurement noise can often be explicitly…

Machine Learning · Computer Science 2023-07-13 Neha Das , Jonas Umlauft , Armin Lederer , Thomas Beckers , Sandra Hirche

Datasets in engineering applications are often limited and contaminated, mainly due to unavoidable measurement noise and signal distortion. Thus, using conventional data-driven approaches to build a reliable discriminative model, and…

Machine Learning · Statistics 2020-04-14 Xihaier Luo , Ahsan Kareem

Active statistical inference is a new method for inference with AI-assisted data collection. Given a budget on the number of labeled data points that can be collected and assuming access to an AI predictive model, the basic idea is to…

Machine Learning · Statistics 2025-11-13 Puheng Li , Tijana Zrnic , Emmanuel Candès

We propose an outlier robust multivariate time series model which can be used for detecting previously unseen anomalous sounds based on noisy training data. The presented approach doesn't assume the presence of labeled anomalies in the…

Sound · Computer Science 2022-02-07 Wo Jae Lee , Karim Helwani , Arvindh Krishnaswamy , Srikanth Tenneti

We present a statistical learning framework for robust identification of partial differential equations from noisy spatiotemporal data. Extending previous sparse regression approaches for inferring PDE models from simulated data, we address…

Numerical Analysis · Mathematics 2019-07-19 Suryanarayana Maddu , Bevan L. Cheeseman , Ivo F. Sbalzarini , Christian L. Müller

There is an emerging trend in applying deep learning methods to control complex nonlinear systems. This paper considers enhancing the runtime safety of nonlinear systems controlled by neural networks in the presence of disturbance and…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Jianglin Lan , Siyuan Zhan , Ron Patton , Xianxian Zhao

Accurate noise modelling is important for training of deep learning reconstruction algorithms. While noise models are well known for traditional imaging techniques, the noise distribution of a novel sensor may be difficult to determine a…

Machine Learning · Computer Science 2018-07-11 Felix Horger , Tobias Würfl , Vincent Christlein , Andreas Maier

Uncertainty estimation is an essential step in the evaluation of the robustness for deep learning models in computer vision, especially when applied in risk-sensitive areas. However, most state-of-the-art deep learning models either fail to…

Computer Vision and Pattern Recognition · Computer Science 2022-01-12 Lu Mi , Hao Wang , Yonglong Tian , Hao He , Nir Shavit