English
Related papers

Related papers: Stochastic Learning Equation using Monotone Increa…

200 papers

We study the problem of global maximization of a function f given a finite number of evaluations perturbed by noise. We consider a very weak assumption on the function, namely that it is locally smooth (in some precise sense) with respect…

Machine Learning · Computer Science 2026-04-28 Michal Valko , Alexandra Carpentier , Rémi Munos

We consider a stochastic partial differential equation with logarithmic (or negative power) nonlinearity, with one reflection at 0 and with a constraint of conservation of the space average. The equation, driven by the derivative in space…

Analysis of PDEs · Mathematics 2019-10-21 Ludovic Goudenège

The numerical evaluation of statistics plays a crucial role in statistical physics and its applied fields. It is possible to evaluate the statistics for a stochastic differential equation with Gaussian white noise via the corresponding…

Numerical Analysis · Mathematics 2023-07-04 Jun Ohkubo

We study the task of learning Generalized Linear models (GLMs) in the agnostic model under the Gaussian distribution. We give the first polynomial-time algorithm that achieves a constant-factor approximation for \textit{any} monotone…

Machine Learning · Computer Science 2025-08-05 Nikos Zarifis , Puqian Wang , Ilias Diakonikolas , Jelena Diakonikolas

We study the convergence of semilinear parabolic stochastic evolution equations, posed on a sequence of Banach spaces approximating a limiting space and driven by additive white noise projected onto the former spaces. Under appropriate…

Probability · Mathematics 2025-06-11 Yves van Gennip , Jonas Latz , Joshua Willems

We address the numerical discretization of the Allen-Cahn prob- lem with additive white noise in one-dimensional space. The discretization is conducted in two stages: (1) regularize the white noise and study the regularized problem, (2)…

Numerical Analysis · Mathematics 2013-09-20 Markos A. Katsoulakis , Georgios T. Kossioris , Omar Lakkis

We study a stochastic Landau-Lifshitz equation on a bounded interval and with finite dimensional noise. We first show that there exists a pathwise unique solution to this equation and that this solution enjoys the maximal regularity…

Probability · Mathematics 2016-09-15 Z. Brzeźniak , B. Goldys , T. Jegaraj

We study stochastic optimization from a joint continuous-discrete point of view. Starting from a second-order stochastic differential equation interpreted as a noisy accelerated gradient flow, we discretize the dynamics by a fully implicit…

Optimization and Control · Mathematics 2026-05-07 Valentin Leplat , Roland Hildebrand

We describe inexact proximal Newton-like methods for solving degenerate regularized optimization problems and for the broader problem of finding a zero of a generalized equation that is the sum of a continuous map and a maximal monotone…

Optimization and Control · Mathematics 2026-02-12 Ching-pei Lee , Stephen J. Wright

This paper examines a variety of classical optimization problems, including well-known minimization tasks and more general variational inequalities. We consider a stochastic formulation of these problems, and unlike most previous work, we…

Optimization and Control · Mathematics 2025-11-11 Vladimir Solodkin , Andrew Veprikov , Aleksandr Beznosikov

We calculate the stochastic upper bounds for the Lorenz equations using an extension of the background method. In analogy with Rayleigh-B\'enard convection the upper bounds are for heat transport versus Rayleigh number. As might be…

Chaotic Dynamics · Physics 2020-07-06 Sahil Agarwal , J. S. Wettlaufer

This article studies the Cauchy problem for the Boltzmann equation with stochastic kinetic transport. Under a cut-off assumption on the collision kernel and a coloring hypothesis for the noise coefficients, we prove the global existence of…

Probability · Mathematics 2018-03-01 Samuel Punshon-Smith , Scott Smith

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

This paper studies the 1D stochastic Allen--Cahn equation on a bounded domain driven by localized white noise. We prove that the associated Markov process admits a unique invariant measure and is exponential mixing. The main challenge lies…

Probability · Mathematics 2026-05-08 Ziyu Liu , Shengquan Xiang , Zhifei Zhang

Collaborative training can improve the accuracy of a model for a user by trading off the model's bias (introduced by using data from other users who are potentially different) against its variance (due to the limited amount of data on any…

Machine Learning · Computer Science 2022-06-24 El Mahdi Chayti , Sai Praneeth Karimireddy , Sebastian U. Stich , Nicolas Flammarion , Martin Jaggi

This paper examines the asymptotic convergence properties of Lipschitz interpolation methods within the context of bounded stochastic noise. In the first part of the paper, we establish probabilistic consistency guarantees of the classical…

Optimization and Control · Mathematics 2023-10-12 Julien Walden Huang , Stephen Roberts , Jan-Peter Calliess

Real-life applications of deep neural networks are hindered by their unsteady predictions when faced with noisy inputs and adversarial attacks. The certified radius in this context is a crucial indicator of the robustness of models. However…

Machine Learning · Computer Science 2024-03-19 Blaise Delattre , Alexandre Araujo , Quentin Barthélemy , Alexandre Allauzen

In this work, we investigate the regularized solutions and their finite element solutions to the inverse source problems governed by partial differential equations, and establish the stochastic convergence and optimal finite element…

Numerical Analysis · Mathematics 2021-10-25 Zhiming Chen , Wenlong Zhang , Jun Zou

Exponential generalization bounds with near-tight rates have recently been established for uniformly stable learning algorithms. The notion of uniform stability, however, is stringent in the sense that it is invariant to the data-generating…

Machine Learning · Statistics 2022-06-09 Xiao-Tong Yuan , Ping Li

Learning theory has largely focused on two main learning scenarios. The first is the classical statistical setting where instances are drawn i.i.d. from a fixed distribution and the second scenario is the online learning, completely…

Machine Learning · Statistics 2011-04-28 Alexander Rakhlin , Karthik Sridharan , Ambuj Tewari