English
Related papers

Related papers: World Model Robustness via Surprise Recognition

200 papers

An important challenge when using computer vision models in the real world is to evaluate their performance in potential out-of-distribution (OOD) scenarios. While simple synthetic corruptions are commonly applied to test OOD robustness,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Olaf Dünkel , Artur Jesslen , Jiahao Xie , Christian Theobalt , Christian Rupprecht , Adam Kortylewski

In practical scenarios where training data is limited, many predictive signals in the data can be rather from some biases in data acquisition (i.e., less generalizable), so that one cannot prevent a model from co-adapting on such…

Machine Learning · Computer Science 2023-03-27 Jongheon Jeong , Sihyun Yu , Hankook Lee , Jinwoo Shin

Adversarial learning has emerged as one of the successful techniques to circumvent the susceptibility of existing methods against adversarial perturbations. However, the majority of existing defense methods are tailored to defend against a…

Machine Learning · Computer Science 2021-06-28 Divyam Madaan , Jinwoo Shin , Sung Ju Hwang

Consistency training regularizes a model by enforcing predictions of original and perturbed inputs to be similar. Previous studies have proposed various augmentation methods for the perturbation but are limited in that they are agnostic to…

Computation and Language · Computer Science 2022-04-29 Jungsoo Park , Gyuwan Kim , Jaewoo Kang

We propose a method for variable selection in the intensity function of spatial point processes that combines sparsity-promoting estimation with noise-robust model selection. As high-resolution spatial data becomes increasingly available…

Methodology · Statistics 2025-10-30 Dominik Sturm , Ivo F. Sbalzarini

Several important models of machine learning algorithms have been successfully generalized to the quantum world, with potential speedup to training classical classifiers and applications to data analytics in quantum physics that can be…

Quantum Physics · Physics 2021-10-01 Ji Guan , Wang Fang , Mingsheng Ying

A grand challenge in machine learning is the development of computational algorithms that match or outperform humans in perceptual inference tasks that are complicated by nuisance variation. For instance, visual object recognition involves…

Machine Learning · Statistics 2015-04-03 Ankit B. Patel , Tan Nguyen , Richard G. Baraniuk

Reinforcement learning often requires extensive training data. Simulation-to-real transfer offers a promising approach to address this challenge in robotics. While differentiable simulators offer improved sample efficiency through exact…

Robotics · Computer Science 2024-12-02 Severin Bochem , Eduardo Gonzalez-Sanchez , Yves Bicker , Gabriele Fadini

Probabilistic models often use neural networks to control their predictive uncertainty. However, when making out-of-distribution (OOD)} predictions, the often-uncontrollable extrapolation properties of neural networks yield poor uncertainty…

Machine Learning · Computer Science 2022-01-19 Pierre Segonne , Yevgen Zainchkovskyy , Søren Hauberg

Foundation models are usually pre-trained on large-scale datasets and then adapted to downstream tasks through tuning. However, the large-scale pre-training datasets, often inaccessible or too expensive to handle, can contain label noise…

Machine Learning · Computer Science 2025-05-06 Hao Chen , Zihan Wang , Ran Tao , Hongxin Wei , Xing Xie , Masashi Sugiyama , Bhiksha Raj , Jindong Wang

Deep reinforcement learning has been applied more and more widely nowadays, especially in various complex control tasks. Effective exploration for noisy networks is one of the most important issues in deep reinforcement learning. Noisy…

Machine Learning · Computer Science 2020-06-22 Shuai Han , Wenbo Zhou , Jing Liu , Shuai Lü

In a reinforcement learning (RL) setting, the agent's optimal strategy heavily depends on her risk preferences and the underlying model dynamics of the training environment. These two aspects influence the agent's ability to make…

Machine Learning · Computer Science 2025-09-23 Anthony Coache , Sebastian Jaimungal

Deep Neural Networks, despite their great success in diverse domains, are provably sensitive to small perturbations on correctly classified examples and lead to erroneous predictions. Recently, it was proposed that this behavior can be…

Machine Learning · Computer Science 2020-09-29 Nan Xu , Oluwaseyi Feyisetan , Abhinav Aggarwal , Zekun Xu , Nathanael Teissier

We explore building generative neural network models of popular reinforcement learning environments. Our world model can be trained quickly in an unsupervised manner to learn a compressed spatial and temporal representation of the…

Machine Learning · Computer Science 2018-05-10 David Ha , Jürgen Schmidhuber

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

Robustness and safety are critical for the trustworthy deployment of deep reinforcement learning. Real-world decision making applications require algorithms that can guarantee robust performance and safety in the presence of general…

Machine Learning · Computer Science 2024-03-29 James Queeney , Erhan Can Ozcan , Ioannis Ch. Paschalidis , Christos G. Cassandras

Robust stability and stochastic stability have separately seen intense study in control theory for many decades. In this work we establish relations between these properties for discrete-time systems and employ them for robust control…

Dynamical Systems · Mathematics 2020-04-20 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

Understanding simplicity biases in deep learning offers a promising path toward developing reliable AI. A common metric for this, inspired by Boolean function analysis, is average sensitivity, which captures a model's robustness to…

Machine Learning · Computer Science 2026-02-10 Themistoklis Haris , Zihan Zhang , Yuichi Yoshida

Deep neural networks have shown remarkable performance across a wide range of vision-based tasks, particularly due to the availability of large-scale datasets for training and better architectures. However, data seen in the real world are…

Machine Learning · Computer Science 2018-11-26 Muhammad Usama , Dong Eui Chang

In the past five years, deep learning methods have become state-of-the-art in solving various inverse problems. Before such approaches can find application in safety-critical fields, a verification of their reliability appears mandatory.…

Machine Learning · Computer Science 2023-01-18 Martin Genzel , Jan Macdonald , Maximilian März