English
Related papers

Related papers: Constructive approaches to concentration inequalit…

200 papers

Chance constraints provide a principled framework to mitigate the risk of high-impact extreme events by modifying the controllable properties of a system. The low probability and rare occurrence of such events, however, impose severe…

Optimization and Control · Mathematics 2022-01-11 Shanyin Tong , Anirudh Subramanyam , Vishwas Rao

Algorithms for min-max optimization and variational inequalities are often studied under monotonicity assumptions. Motivated by non-monotone machine learning applications, we follow the line of works [Diakonikolas et al., 2021, Lee and Kim,…

Optimization and Control · Mathematics 2023-07-19 Eduard Gorbunov , Adrien Taylor , Samuel Horváth , Gauthier Gidel

In this paper, we study randomized and cyclic coordinate descent for convex unconstrained optimization problems. We improve the known convergence rates in some cases by using the numerical semidefinite programming performance estimation…

Optimization and Control · Mathematics 2022-12-26 Hadi Abbaszadehpeivasti , Etienne de Klerk , Moslem Zamani

The purpose of this note is to present several aspects of concentration phenomena in high dimensional geometry. At the heart of the study is a geometric analysis point of view coming from the theory of high dimensional convex bodies. The…

Functional Analysis · Mathematics 2013-10-07 Olivier Guédon

A variational model for learning convolutional image atoms from corrupted and/or incomplete data is introduced and analyzed both in function space and numerically. Building on lifting and relaxation strategies, the proposed approach is…

Optimization and Control · Mathematics 2018-12-10 Antonin Chambolle , Martin Holler Thomas Pock

Recently, based on the idea of randomizing space theory, random convex analysis has been being developed in order to deal with the corresponding problems in random environments such as analysis of conditional convex risk measures and the…

Functional Analysis · Mathematics 2017-09-11 Tiexin Guo , Erxin Zhang , Mingzhi Wu , Bixuan Yang , George Yuan , Xiaolin Zeng

Latent or unobserved phenomena pose a significant difficulty in data analysis as they induce complicated and confounding dependencies among a collection of observed variables. Factor analysis is a prominent multivariate statistical modeling…

Methodology · Statistics 2020-06-22 Armeen Taeb , Venkat Chandrasekaran

Inference in models where the parameter is defined by moment inequalities is of interest in many areas of economics. This paper develops a new method for improving the performance of generalized moment selection (GMS) testing procedures in…

Econometrics · Economics 2020-08-26 Rami V. Tabri , Christopher D. Walker

We consider a convex optimization problem with many linear inequality constraints. To deal with a large number of constraints, we provide a penalty reformulation of the problem, where the penalty is a variant of the one-sided Huber loss…

Optimization and Control · Mathematics 2023-11-03 Angelia Nedich , Tatiana Tatarenko

Consider an ergodic stationary random field $A$ on the ambient space $\mathbb R^d$. In order to establish concentration properties for nonlinear functions $Z(A)$, it is standard to appeal to functional inequalities like Poincar\'e or…

Probability · Mathematics 2019-10-11 Mitia Duerinckx , Antoine Gloria

A wide array of machine learning problems are formulated as the minimization of the expectation of a convex loss function on some parameter space. Since the probability distribution of the data of interest is usually unknown, it is is often…

Optimization and Control · Mathematics 2019-05-27 Emilie Chouzenoux , Henri Gérard , Jean-Christophe Pesquet

Shrinkage of large particles, either through depolymerisation (i.e. progressive shortening) or through fragmentation (breakage into smaller pieces) may be modelled by discrete equations, of Becker-D\''oring type, or by continuous ones. In…

Analysis of PDEs · Mathematics 2024-07-08 Marie Doumic

This paper conducts sensitivity analysis of random constraint and variational systems related to stochastic optimization and variational inequalities. We establish efficient conditions for well-posedness, in the sense of robust Lipschitzian…

Optimization and Control · Mathematics 2021-12-13 Boris S. Mordukhovich , Pedro Pérez-Aros

We prove Fuk-Nagaev and Rosenthal-type inequalities for sums of independent random matrices, focusing on the situation when the norms of the matrices possess finite moments of only low orders. Our bounds depend on the ``intrinsic''…

Probability · Mathematics 2025-11-20 Moritz Jirak , Stanislav Minsker , Yiqiu Shen , Martin Wahl

The concentration inequality approach for normal approximation by Stein's method is generalized to the multivariate setting. We use this approach to prove a non-smooth function distance for multivariate normal approximation for standardized…

Probability · Mathematics 2015-05-19 Louis H. Y. Chen , Xiao Fang

While classical concentration inequalities are typically restricted to two special cases -- independence and martingale difference sequences -- we extend concentration inequalities to a much broader class of stochastic processes by relaxing…

Probability · Mathematics 2026-02-25 Changqing Liu

In this paper we develop tools for studying limit theorems by means of convexity. We establish bounds for the discrepancy in total variation between probability measures $\mu$ and $\nu$ such that $\nu$ is log-concave with respect to $\mu$.…

Probability · Mathematics 2022-10-24 Arturo Jaramillo , James Melbourne

This paper deals with the optimization of Bolza problem with a system of convex and nonconvex, discrete and differential state variable inequality constraints of second order by deriving necessary and sufficient conditions for optimality.…

Optimization and Control · Mathematics 2020-09-17 Elimhan N. Mahmudov , S. Demir Saglam

In this paper we show an alternative approach to the concentration of truncated variation for stochastic processes on a real line. Our method is based on the moments control and can be used to generalize the results to the case of processes…

Probability · Mathematics 2016-03-28 Witold Bednorz , Rafal Lochowski

This paper focuses on investigating an inexact stochastic model-based optimization algorithm that integrates preconditioning techniques for solving stochastic composite optimization problems. The proposed framework unifies and extends the…

Optimization and Control · Mathematics 2025-12-12 Chenglong Bao , Yancheng Yuan , Shulan Zhu