English
Related papers

Related papers: R\'enyi-infinity constrained sampling with $d^3$ m…

200 papers

This paper considers non-smooth optimization problems where we seek to minimize the pointwise maximum of a continuously parameterized family of functions. Since the objective function is given as the solution to a maximization problem,…

Optimization and Control · Mathematics 2026-01-12 Dimitris Boskos , Jorge Cortés , Sonia Martínez

We solve the problem of estimating the distribution of presumed i.i.d. observations for the total variation loss. Our approach is based on density models and is versatile enough to cope with many different ones, including some density…

Statistics Theory · Mathematics 2024-01-05 Y. Baraud , H. Halconruy , G. Maillard

We introduce a suite of new particle-based algorithms for sampling in constrained domains which are entirely learning rate free. Our approach leverages coin betting ideas from convex optimisation, and the viewpoint of constrained sampling…

Machine Learning · Statistics 2023-12-27 Louis Sharrock , Lester Mackey , Christopher Nemeth

A broad range of inverse problems can be abstracted into the problem of minimizing the sum of several convex functions in a Hilbert space. We propose a proximal decomposition algorithm for solving this problem with an arbitrary number of…

Optimization and Control · Mathematics 2009-11-13 Patrick L. Combettes , Jean-Christophe Pesquet

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmic design. We…

Optimization and Control · Mathematics 2023-02-17 Jelena Diakonikolas , Cristóbal Guzmán

We give algorithms for sampling several structured logconcave families to high accuracy. We further develop a reduction framework, inspired by proximal point methods in convex optimization, which bootstraps samplers for regularized…

Data Structures and Algorithms · Computer Science 2021-10-25 Yin Tat Lee , Ruoqi Shen , Kevin Tian

The conventional channel resolvability problem refers to the determination of the minimum rate required for an input process so that the output distribution approximates a target distribution in either the total variation distance or the…

Information Theory · Computer Science 2018-12-04 Lei Yu , Vincent Y. F. Tan

We study a generalized framework for structured sparsity. It extends the well-known methods of Lasso and Group Lasso by incorporating additional constraints on the variables as part of a convex optimization problem. This framework provides…

Machine Learning · Computer Science 2011-06-28 Andreas Argyriou , Luca Baldassarre , Jean Morales , Massimiliano Pontil

Multi-distribution learning (MDL), which seeks to learn a shared model that minimizes the worst-case risk across $k$ distinct data distributions, has emerged as a unified framework in response to the evolving demand for robustness,…

Machine Learning · Computer Science 2025-08-12 Zihan Zhang , Wenhao Zhan , Yuxin Chen , Simon S. Du , Jason D. Lee

We consider the constrained Linear Inverse Problem (LIP), where a certain atomic norm (like the $\ell_1 $ norm) is minimized subject to a quadratic constraint. Typically, such cost functions are non-differentiable, which makes them not…

Optimization and Control · Mathematics 2025-07-08 Mohammed Rayyan Sheriff , Floor Fenne Redel , Peyman Mohajerin Esfahani

A remarkable recent paper by Rubinfeld and Vasilyan (2022) initiated the study of \emph{testable learning}, where the goal is to replace hard-to-verify distributional assumptions (such as Gaussianity) with efficiently testable ones and to…

Machine Learning · Computer Science 2022-11-28 Aravind Gollakota , Adam R. Klivans , Pravesh K. Kothari

The divergence in the interaction term of the Calogero model can be prevented introducing a cutoff length parameter, this modification leads to a quasi-exactly solvable model whose eigenfunctions can be written in terms of Heun's…

Quantum Physics · Physics 2018-05-09 Federico M. Pont , Omar Osenda , Pablo Serra

This paper presents a detailed theoretical analysis of the Langevin Monte Carlo sampling algorithm recently introduced in Durmus et al. (Efficient Bayesian computation by proximal Markov chain Monte Carlo: when Langevin meets Moreau, 2016)…

Methodology · Statistics 2017-05-26 Nicolas Brosse , Alain Durmus , Éric Moulines , Marcelo Pereyra

We analyze the convergence rate of the randomized Newton-like method introduced by Qu et. al. (2016) for smooth and convex objectives, which uses random coordinate blocks of a Hessian-over-approximation matrix $\bM$ instead of the true…

Numerical Analysis · Mathematics 2020-02-13 Mojmír Mutný , Michał Dereziński , Andreas Krause

We consider the sample complexity of learning with adversarial robustness. Most prior theoretical results for this problem have considered a setting where different classes in the data are close together or overlapping. Motivated by some…

Machine Learning · Computer Science 2023-01-19 Robi Bhattacharjee , Somesh Jha , Kamalika Chaudhuri

We provide the sandwiched R\'enyi divergence of order $\alpha\in(\frac{1}{2},1)$, as well as its induced quantum information quantities, with an operational interpretation in the characterization of the exact strong converse exponents of…

Quantum Physics · Physics 2024-05-29 Ke Li , Yongsheng Yao

We study the problem of modeling univariate distributions via their quantile functions. We introduce a flexible family of distributions whose quantile function is a linear combination of basis quantiles. Because the model is linear in its…

Methodology · Statistics 2026-02-05 Cheng Peng , Yizhou Li , Stan Uryasev

Sharpness (of the loss minima) is a common measure to investigate the generalization of neural networks. Intuitively speaking, the flatter the landscape near the minima is, the better generalization might be. Unfortunately, the correlation…

Machine Learning · Computer Science 2025-10-17 Qiaozhe Zhang , Jun Sun , Ruijie Zhang , Yingzhuang Liu

Motivated by practical applications where stable long-term performance is critical-such as robotics, operations research, and healthcare-we study the problem of distributionally robust (DR) average-reward reinforcement learning. We propose…

Machine Learning · Computer Science 2026-02-03 Zijun Chen , Shengbo Wang , Nian Si

We establish sharp exponential deviation estimates of the information content as well as a sharp bound on the varentropy for the class of convex measures on Euclidean spaces. This generalizes a similar development for log-concave measures…

Probability · Mathematics 2020-02-25 Matthieu Fradelizi , Jiange Li , Mokshay Madiman