English
Related papers

Related papers: Remarks on regularization by noise, convex integra…

200 papers

In this paper, we study the motion by mean curvature of curves in the plane perturbed by scale-dependent noise. We first introduce a so-called scale-dependent noise from the physics background to the curve shortening flow. To be more…

Probability · Mathematics 2025-11-27 Qi Yan

Traffic flow oscillations, including traffic waves, are a common yet incompletely understood feature of congested traffic. Possible mechanisms include traffic flow instabilities, indifference regions or finite human perception thresholds…

Physics and Society · Physics 2017-08-24 Martin Treiber , Arne Kesting

We investigate the impact of noise on a two-dimensional simple paradigmatic piecewise-smooth dynamical system. For that purpose we consider the motion of a particle subjected to dry friction and coloured noise. The finite correlation time…

Statistical Mechanics · Physics 2017-06-14 Paul M. Geffert , Wolfram Just

We discuss the phenomenon of spontaneous symmetry breaking by means of a class of non-perturbative renormalization group flow equations which employ a regulating smearing function in the proper-time integration. We show, both analytically…

High Energy Physics - Theory · Physics 2009-11-10 A. Bonanno , G. Lacagnina

The gradient noise of SGD is considered to play a central role in the observed strong generalization abilities of deep learning. While past studies confirm that the magnitude and the covariance structure of gradient noise are critical for…

Machine Learning · Computer Science 2020-06-22 Jingfeng Wu , Wenqing Hu , Haoyi Xiong , Jun Huan , Vladimir Braverman , Zhanxing Zhu

The effect of a small amount of noise on the standard mapping is considered. Whenever the standard mapping possesses accelerator modes (where the action increases approximately linearly with time), the diffusion coefficient contains a term…

Chaotic Dynamics · Physics 2007-05-23 Charles F. F. Karney , Alexander B. Rechester , Roscoe B. White

Noise, through its interaction with the nonlinearity of the living systems, can give rise to counter-intuitive phenomena such as stochastic resonance, noise-delayed extinction, temporal oscillations, and spatial patterns. In this paper we…

Populations and Evolution · Quantitative Biology 2007-05-23 B. Spagnolo , D. Valenti , A. Fiasconaro

This paper concerns stochastic perturbations of piecewise-smooth ODE systems relevant for vibro-impacting dynamics, where impact events constitute the primary source of randomness. Such systems are characterised by the existence of…

Dynamical Systems · Mathematics 2015-02-11 David J. W. Simpson , Rachel Kuske

Injecting noise within gradient descent has several desirable features, such as smoothing and regularizing properties. In this paper, we investigate the effects of injecting noise before computing a gradient step. We demonstrate that small…

Machine Learning · Computer Science 2023-01-24 Antonio Orvieto , Anant Raj , Hans Kersting , Francis Bach

Finite-size effects in systems with diverging characteristic lengthscale have been addressed via state-of-the-art Monte Carlo and molecular dynamics simulations of various models exhibiting solid-solid, liquid-liquid and vapor-liquid…

Statistical Mechanics · Physics 2018-03-09 Subir K. Das , Sutapa Roy , Suman Majumder , Shaista Ahmad

Implicit bias plays an important role in explaining how overparameterized models generalize well. Explicit regularization like weight decay is often employed in addition to prevent overfitting. While both concepts have been studied…

Machine Learning · Computer Science 2025-08-25 Tom Jacobs , Chao Zhou , Rebekka Burkholz

Overfitting is one of the most critical challenges in deep neural networks, and there are various types of regularization methods to improve generalization performance. Injecting noises to hidden units during training, e.g., dropout, is…

Machine Learning · Computer Science 2017-11-10 Hyeonwoo Noh , Tackgeun You , Jonghwan Mun , Bohyung Han

(Stochastic) bilevel optimization is a frequently encountered problem in machine learning with a wide range of applications such as meta-learning, hyper-parameter optimization, and reinforcement learning. Most of the existing studies on…

Machine Learning · Computer Science 2023-03-16 Meng Ding , Mingxi Lei , Yunwen Lei , Di Wang , Jinhui Xu

We consider a harmonic chain in contact with thermal reservoirs at different temperatures and subject to bulk noises of different types: velocity flips or self-consistent reservoirs. While both systems have the same covariances in the…

Statistical Mechanics · Physics 2015-05-30 Cedric Bernardin , Venkateshan Kannan , Joel L. Lebowitz , Jani Lukkarinen

Robust stability and stochastic stability have separately seen intense study in control theory for many decades. In this work we establish relations between these properties for discrete-time systems and employ them for robust control…

Dynamical Systems · Mathematics 2020-04-20 Benjamin Gravell , Peyman Mohajerin Esfahani , Tyler Summers

Shortcuts in a regular architecture affect the information transport through the system due to the severe decrease in average path length. A fundamental new perspective in terms of pattern formation is the destabilizing effect of…

Statistical Mechanics · Physics 2009-11-11 Carsten Marr , Marc-Thorsten Huett

This paper focuses on stochastic proximal gradient methods for optimizing a smooth non-convex loss function with a non-smooth non-convex regularizer and convex constraints. To the best of our knowledge we present the first non-asymptotic…

Optimization and Control · Mathematics 2019-05-27 Michael R. Metel , Akiko Takeda

In this paper we prove strong well-posedness for a system of stochastic differential equations driven by a degenerate diffusion satisfying a weak-type H\"ormander condition, assuming H\"older regularity assumptions on the drift coefficient.…

Probability · Mathematics 2022-10-07 Giacomo Lucertini , Stefano Pagliarani , Andrea Pascucci

This paper is concerned with effects of noise on the solutions of partial differential equations. We first provide a sufficient condition to ensure the existence of a unique positive solution for a class of stochastic parabolic equations.…

Analysis of PDEs · Mathematics 2014-10-14 Guangying Lv , Jinqiao Duan

Most biological systems are formed by component parts that to some degree are inter-related. Groups of parts that are more associated among themselves and are relatively autonomous from others are called modules. One of the consequences of…

Populations and Evolution · Quantitative Biology 2013-08-12 Gabriel Marroig , Diogo Melo , Guilherme Garcia