English
Related papers

Related papers: Incremental Noising and its Fractal Behavior

200 papers

We formulate and study a general family of (continuous-time) stochastic dynamics for accelerated first-order minimization of smooth convex functions. Building on an averaging formulation of accelerated mirror descent, we propose a…

Optimization and Control · Mathematics 2017-07-20 Walid Krichene , Peter L. Bartlett

Additive noise in Partial Differential equations, in particular those of fluid mechanics, has relatively natural motivations. The aim of this work is showing that suitable multiscale arguments lead rigorously, from a model of fluid with…

Probability · Mathematics 2022-05-12 Franco Flandoli , Umberto Pappalettera

The science of fractography revolves around the correlation between topographic characteristics of the fracture surface and the mechanisms and external conditions leading to their creation. While being a topic of investigation for…

Image and Video Processing · Electrical Eng. & Systems 2020-05-11 Stylianos Tsopanidis , Raúl Herrero Moreno , Shmuel Osovski

Randomized smoothing is a technique for providing provable robustness guarantees against adversarial attacks while making minimal assumptions about a classifier. This method relies on taking a majority vote of any base classifier over…

Machine Learning · Computer Science 2023-05-09 Ambar Pal , Jeremias Sulam

Despite rapid advances in speech recognition, current models remain brittle to superficial perturbations to their inputs. Small amounts of noise can destroy the performance of an otherwise state-of-the-art model. To harden models against…

Audio and Speech Processing · Electrical Eng. & Systems 2018-07-19 Davis Liang , Zhiheng Huang , Zachary C. Lipton

Procedural noise is a fundamental component of computer graphics pipelines, offering a flexible way to generate textures that exhibit "natural" random variation. Many different types of noise exist, each produced by a separate algorithm. In…

Image denoising is a typical ill-posed problem due to complex degradation. Leading methods based on normalizing flows have tried to solve this problem with an invertible transformation instead of a deterministic mapping. However, the…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Wenchao Du , Hu Chen , Yi Zhang , H. Yang

Enhancing the generalisation abilities of neural networks (NNs) through integrating noise such as MixUp or Dropout during training has emerged as a powerful and adaptable technique. Despite the proven efficacy of noise in NN training, there…

Machine Learning · Computer Science 2024-04-04 Martin Ferianc , Ondrej Bohdal , Timothy Hospedales , Miguel Rodrigues

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong

Stochastic resonance is a well established phenomenon, which proves relevant for a wide range of applications, of broad trans-disciplinary breath. Consider a one dimensional bistable stochastic system, characterized by a deterministic…

Statistical Mechanics · Physics 2023-10-17 Giuliano Migliorini , Duccio Fanelli

Gradients play a pivotal role in neural networks explanation. The inherent high dimensionality and structural complexity of neural networks result in the original gradients containing a significant amount of noise. While several approaches…

Machine Learning · Computer Science 2024-07-02 Linjiang Zhou , Xiaochuan Shi , Chao Ma , Zepeng Wang

Noise in data appears to be inevitable in most real-world machine learning applications and would cause severe overfitting problems. Not only can data features contain noise, but labels are also prone to be noisy due to human input. In this…

Machine Learning · Computer Science 2025-05-09 Weipeng Huang , Qin Li , Yang Xiao , Cheng Qiao , Tie Cai , Junwei Liang , Neil J. Hurley , Guangyuan Piao

Many applications of computer vision require the ability to adapt to novel data distributions after deployment. Adaptation requires algorithms capable of continual learning (CL). Continual learners must be plastic to adapt to novel tasks…

Machine Learning · Computer Science 2025-04-24 Edison Mucllari , Aswin Raghavan , Zachary Alan Daniels

In this paper, we investigate accelerated first-order methods for smooth convex optimization problems under inexact information on the gradient of the objective. The noise in the gradient is considered to be additive with two possibilities:…

Optimization and Control · Mathematics 2023-01-10 Vasin Artem , Alexander Gasnikov , Pavel Dvurechensky , Vladimir Spokoiny

The goal of ordinal embedding is to represent items as points in a low-dimensional Euclidean space given a set of constraints in the form of distance comparisons like "item $i$ is closer to item $j$ than item $k$". Ordinal constraints like…

Machine Learning · Statistics 2016-06-24 Lalit Jain , Kevin Jamieson , Robert Nowak

Nutation has been recognized as of great significance for spintronics; but justifying its presence has proven to be a hard problem. In this paper we show that nutation can be understood as emerging from a systematic expansion of a kernel…

Statistical Mechanics · Physics 2021-11-03 Pascal Thibaudeau , Stam Nicolis

We propose a method for variable selection in the intensity function of spatial point processes that combines sparsity-promoting estimation with noise-robust model selection. As high-resolution spatial data becomes increasingly available…

Methodology · Statistics 2025-10-30 Dominik Sturm , Ivo F. Sbalzarini

We explore the effect of interplay of interfacial noise and curvature driven dynamics in a binary spin system. An appropriate model is the generalised two dimensional voter model proposed earlier (J. Phys. A: Math. Gen. {\bf 26}, 2317…

Statistical Mechanics · Physics 2017-02-09 Parna Roy , Parongama Sen

In this paper we address smoothing-that is, optimisation-based-estimation techniques for localisation problems in the case where motion sensors are very accurate. Our mathematical analysis focuses on the difficult limit case where motion…

Systems and Control · Electrical Eng. & Systems 2022-04-12 Paul Chauchat , Silvere Bonnabel , Axel Barrau

In-Context Learning (ICL) is suffering from unsatisfactory performance and under-calibration due to high prior bias and unfaithful confidence. Some previous works fine-tuned language models for better ICL performance with enormous datasets…

Computation and Language · Computer Science 2024-02-16 Yufeng Zhao , Yoshihiro Sakai , Naoya Inoue