English
Related papers

Related papers: Efficient first-order algorithms for large-scale, …

200 papers

Many key problems in machine learning and data science are routinely modeled as optimization problems and solved via optimization algorithms. With the increase of the volume of data and the size and complexity of the statistical models used…

Optimization and Control · Mathematics 2020-08-28 Filip Hanzely

The problem of minimizing the sum of nonsmooth, convex objective functions defined on a real Hilbert space over the intersection of fixed point sets of nonexpansive mappings, onto which the projections cannot be efficiently computed, is…

Optimization and Control · Mathematics 2016-02-08 Hideaki Iiduka

The maximum entropy principle (MEP) is a method for obtaining the most likely distribution functions of observables from statistical systems, by maximizing entropy under constraints. The MEP has found hundreds of applications in ergodic and…

Classical Physics · Physics 2016-10-03 Rudolf Hanel , Stefan Thurner , Murray Gell-Mann

This paper addresses a new interpretation of the traditional optimization method in reinforcement learning (RL) as optimization problems using reverse Kullback-Leibler (KL) divergence, and derives a new optimization method using forward KL…

Machine Learning · Computer Science 2022-04-25 Taisuke Kobayashi

These notes focus on the minimization of convex functionals using first-order optimization methods, which are fundamental in many areas of applied mathematics and engineering. The primary goal of this document is to introduce and analyze…

Optimization and Control · Mathematics 2024-10-28 Charles Dossal , Samuel Hurault , Nicolas Papadakis

Robust estimators of location and dispersion are often used in the elliptical model to obtain an uncontaminated and highly representative subsample by trimming the data outside an ellipsoid based in the associated Mahalanobis distance. Here…

Statistics Theory · Mathematics 2016-08-14 Juan A. Cuesta-Albertos , Carlos Matrán , Agustín Mayo-Iscar

We present a novel adaptive optimization algorithm for large-scale machine learning problems. Equipped with a low-cost estimate of local curvature and Lipschitz smoothness, our method dynamically adapts the search direction and step-size.…

Machine Learning · Computer Science 2021-09-14 Majid Jahani , Sergey Rusakov , Zheng Shi , Peter Richtárik , Michael W. Mahoney , Martin Takáč

In this work, we investigate Gaussian Mixture Models ({\it abbrv} GMM) and the related problem of non parametric maximum likelihood estimation ({\it abbrv} NPMLE) from the perspective of statistical mechanics. In particular, we establish…

Statistics Theory · Mathematics 2026-03-25 Subhroshekhar Ghosh , Adityanand Guntuboyina , Satyaki Mukherjee , Hoang-Son Tran

The maximum-entropy principle (Max-Ent) is a valuable and extensively used tool in statistical mechanics and quantum information theory. It provides a method for inferring the state of a system by utilizing a reduced set of parameters…

Quantum Physics · Physics 2024-03-01 F. T. B. Pérez , J. M. Matera

In the construction of low-rank matrix approximation and maximum element search it is effective to use maxvol algorithm. Nevertheless, even in the case of rank 1 approximation the algorithm does not always converge to the maximum matrix…

Numerical Analysis · Mathematics 2023-09-04 Alexander Osinsky

Multi-distribution learning (MDL), which seeks to learn a shared model that minimizes the worst-case risk across $k$ distinct data distributions, has emerged as a unified framework in response to the evolving demand for robustness,…

Machine Learning · Computer Science 2025-08-12 Zihan Zhang , Wenhao Zhan , Yuxin Chen , Simon S. Du , Jason D. Lee

This paper is devoted to the study of the max K-armed bandit problem, which consists in sequentially allocating resources in order to detect extreme values. Our contribution is twofold. We first significantly refine the analysis of the…

Machine Learning · Statistics 2017-07-28 Mastane Achab , Stephan Clémençon , Aurélien Garivier , Anne Sabourin , Claire Vernade

Very large datasets are often encountered in climatology, either from a multiplicity of observations over time and space or outputs from deterministic models (sometimes in petabytes= 1 million gigabytes). Loading a large data vector and…

Computation · Statistics 2010-07-08 Reza Hosseini

Masked diffusion models (MDMs) have shown promise in language modeling, yet their scalability and effectiveness in core language tasks, such as text generation and language understanding, remain underexplored. This paper establishes the…

Artificial Intelligence · Computer Science 2025-03-03 Shen Nie , Fengqi Zhu , Chao Du , Tianyu Pang , Qian Liu , Guangtao Zeng , Min Lin , Chongxuan Li

Many large scale problems in computational fluid dynamics such as uncertainty quantification, Bayesian inversion, data assimilation and PDE constrained optimization are considered very challenging computationally as they require a large…

Computational Physics · Physics 2020-04-22 Kjetil O. Lye , Siddhartha Mishra , Deep Ray

Maximum likelihood estimation (MLE) is a statistical method used to estimate the parameters of a probability distribution that best explain the observed data. In the context of text generation, MLE is often used to train generative language…

Computation and Language · Computer Science 2023-10-27 Chenze Shao , Zhengrui Ma , Min Zhang , Yang Feng

The convergence rate of various first-order optimization algorithms is a pivotal concern within the numerical optimization community, as it directly reflects the efficiency of these algorithms across different optimization problems. Our…

Optimization and Control · Mathematics 2024-07-23 Chenyi Li , Ziyu Wang , Wanyi He , Yuxuan Wu , Shengyang Xu , Zaiwen Wen

We consider the problem of making nonparametric inference in a class of multi-dimensional diffusions in divergence form, from low-frequency data. Statistical analysis in this setting is notoriously challenging due to the intractability of…

Methodology · Statistics 2025-01-23 Matteo Giordano , Sven Wang

We present a new family of min-max optimization algorithms that automatically exploit the geometry of the gradient data observed at earlier iterations to perform more informative extra-gradient steps in later ones. Thanks to this adaptation…

Optimization and Control · Mathematics 2020-11-20 Kimon Antonakopoulos , E. Veronica Belmega , Panayotis Mertikopoulos

We show that distribution functions of nonequilibrium steady states (NESS) evolving under a slowly varying protocol can be accurately obtained from limited data and the closest known detailed state of the system. In this manner, one needs…

Statistical Mechanics · Physics 2015-08-26 Puneet Kumar Patra , Marc Meléndez , Baidurya Bhattacharya
‹ Prev 1 8 9 10 Next ›