English
Related papers

Related papers: A Linearly Convergent Algorithm for Computing the …

200 papers

We prove number of quantitative stability bounds for the cases of equality in Petz's monotonicity theorem for quasi-relative entropies defined in terms of an operator monotone decreasing functions. Included in our results is a bound in…

Mathematical Physics · Physics 2018-05-18 Eric A. Carlen , Anna Vershynina

We consider the stochastic approximation problem where a convex function has to be minimized, given only the knowledge of unbiased estimates of its gradients at certain points, a framework which includes machine learning methods based on…

Machine Learning · Computer Science 2013-06-11 Francis Bach , Eric Moulines

In this paper, we study analytical approximate solutions of the second-order homogeneous differential equations with the existence of only two turning points (but without poles), by using the uniform asymptotic approximation (UAA) method.…

General Relativity and Quantum Cosmology · Physics 2024-01-09 Rui Pan , John Joseph Marchetta , Jamal Saeed , Gerald Cleaver , Bao-Fei Li , Anzhong Wang , Tao Zhu

Phase retrieval problems involve solving linear equations, but with missing sign (or phase, for complex numbers) information. More than four decades after it was first proposed, the seminal error reduction algorithm of (Gerchberg and Saxton…

Machine Learning · Statistics 2015-06-15 Praneeth Netrapalli , Prateek Jain , Sujay Sanghavi

Experimental design is a classical statistics problem and its aim is to estimate an unknown $m$-dimensional vector $\beta$ from linear measurements where a Gaussian noise is introduced in each measurement. For the combinatorial experimental…

Machine Learning · Statistics 2024-12-06 Mohit Singh , Weijun Xie

Pointer analysis is one of the fundamental problems in static program analysis. Given a set of pointers, the task is to produce a useful over-approximation of the memory locations that each pointer may point-to at runtime. The most common…

Programming Languages · Computer Science 2020-10-15 Anders Alnor Mathiasen , Andreas Pavlogiannis

We study alternating first-order algorithms with no inner loops for solving nonconvex-strongly-concave min-max problems. We show the convergence of the alternating gradient descent--ascent algorithm method by proposing a substantially…

Optimization and Control · Mathematics 2026-03-31 Guido Tapia-Riera , Camille Castera , Nicolas Papadakis

We present an algorithm for L1-norm kernel PCA and provide a convergence analysis for it. While an optimal solution of L2-norm kernel PCA can be obtained through matrix decomposition, finding that of L1-norm kernel PCA is not trivial due to…

Machine Learning · Statistics 2020-06-12 Cheolmin Kim , Diego Klabjan

This paper focuses on recursive estimation of time varying autoregressive processes in a nonparametric setting. The stability of the model is revisited and uniform results are provided when the time-varying autoregressive parameters belong…

Statistics Theory · Mathematics 2007-06-13 Eric Moulines , Pierre Priouret , François Roueff

Online linear programming (OLP) has found broad applications in revenue management and resource allocation. State-of-the-art OLP algorithms achieve low regret by repeatedly solving linear programming (LP) subproblems that incorporate…

Machine Learning · Statistics 2025-11-04 Jingruo Sun , Wenzhi Gao , Ellen Vitercik , Yinyu Ye

Finding an $\epsilon$-stationary point of a nonconvex function with a Lipschitz continuous Hessian is a central problem in optimization. Regularized Newton methods are a classical tool and have been studied extensively, yet they still face…

Optimization and Control · Mathematics 2025-11-03 Yuhao Zhou , Jintao Xu , Bingrui Li , Chenglong Bao , Chao Ding , Jun Zhu

Uncertainty estimation remains a key challenge when adapting pre-trained language models to downstream classification tasks, with overconfidence often observed for difficult inputs. While predictive entropy provides a strong baseline for…

Computation and Language · Computer Science 2026-04-07 Artem Zabolotnyi , Roman Makarov , Mile Mitrovic , Polina Proskura , Oleg Travkin , Roman Alferov , Alexey Zaytsev

Many optimization algorithms$\unicode{x2013}$including gradient descent, proximal methods, and operator splitting techniques$\unicode{x2013}$can be formulated as fixed-point iterations (FPI) of continuous operators. When these operators are…

Optimization and Control · Mathematics 2025-11-03 Kira van Treek , Javier F. Peña , Juan C. Vera , Luis F. Zuluaga

This paper presents a novel approach to address the constrained coding challenge of generating almost-balanced sequences. While strictly balanced sequences have been well studied in the past, the problem of designing efficient algorithms…

Information Theory · Computer Science 2024-05-15 Daniella Bar-Lev , Adir Kobovich , Orian Leitersdorf , Eitan Yaakobi

In this work, we study the robust phase retrieval problem where the task is to recover an unknown signal $\theta^* \in \mathbb{R}^d$ in the presence of potentially arbitrarily corrupted magnitude-only linear measurements. We propose an…

Machine Learning · Computer Science 2024-09-10 Adarsh Barik , Anand Krishna , Vincent Y. F. Tan

This paper studies adaptive first-order least-squares finite element methods for second-order elliptic partial differential equations in non-divergence form. Unlike the classical finite element method which uses weak formulations of PDEs…

Numerical Analysis · Mathematics 2019-06-28 Weifeng Qiu , Shun Zhang

This paper focuses on regularisation methods using models up to the third order to search for up to second-order critical points of a finite-sum minimisation problem. The variant presented belongs to the framework of [3]: it employs random…

Numerical Analysis · Mathematics 2021-04-05 Stefania Bellavia , Gianmarco Gurioli , Benedetta Morini , Philippe L. Toint

We propose a zero-order optimization method for sequential min-max problems based on two populations of interacting particles. The systems are coupled so that one population aims to solve the inner maximization problem, while the other aims…

Optimization and Control · Mathematics 2024-07-25 Giacomo Borghi , Hui Huang , Jinniao Qiu

In a recent work, Esmer et al. describe a simple method - Approximate Monotone Local Search - to obtain exponential approximation algorithms from existing parameterized exact algorithms, polynomial-time approximation algorithms and, more…

Data Structures and Algorithms · Computer Science 2023-08-30 Baris Can Esmer , Ariel Kulik , Daniel Marx , Daniel Neuen , Roohani Sharma

The canonical price-adjustment process, t\^atonnement, typically fails to converge to the exact competitive equilibrium (CE) and requires a high iteration complexity of $\tilde{\mathcal{O}}(1/\epsilon)$ to compute $\epsilon$-CE prices in…

Optimization and Control · Mathematics 2025-10-10 He Chen , Chonghe Jiang , Anthony Man-Cho So
‹ Prev 1 4 5 6 7 8 10 Next ›