English
Related papers

Related papers: Optimal Convergence Rate of Self-Consistent Field …

200 papers

Let $\{ X_{\bf n}, {\bf n}\in \mathbb{N}^d \}$ be a random field i.e. a family of random variables indexed by $\mathbb{N}^d $, $d\ge 2$. Complete convergence, convergence rates for non identically distributed, negatively dependent and…

Probability · Mathematics 2014-12-01 Zbigniew A. Lagodowski

Eigenvector spatial filtering (ESF) is a spatial modeling approach, which has been applied in urban and regional studies, ecological studies, and so on. However, it is computationally demanding, and may not be suitable for large data…

Methodology · Statistics 2018-04-23 Daisuke Murakami , Daniel A. Griffith

This paper considers the recovery of a rank $r$ positive semidefinite matrix $X X^T\in\mathbb{R}^{n\times n}$ from $m$ scalar measurements of the form $y_i := a_i^T X X^T a_i$ (i.e., quadratic measurements of $X$). Such problems arise in a…

Numerical Analysis · Mathematics 2016-06-02 Chris D. White , Sujay Sanghavi , Rachel Ward

With the widespread use of self-consistent field methods, including Hartree-Fock and Density Functional Theory, the implications of accelerating these methods are immense. To this end, we develop a tensor hypercontraction construction with…

Chemical Physics · Physics 2025-08-27 Andreas Erbs Hillers-Bendtsen , Todd J. Martínez

We consider time-harmonic scalar transmission problems between dielectric and dispersive materials with generalized Lorentz frequency laws. For certain frequency ranges such equations involve a sign-change in their principle part. Due to…

Numerical Analysis · Mathematics 2024-01-30 Martin Halla , Thorsten Hohage , Florian Oberender

We prove precise rates of convergence for monotone approximation schemes of fractional and nonlocal Hamilton-Jacobi-Bellman (HJB) equations. We consider diffusion corrected difference-quadrature schemes from the literature and new…

Analysis of PDEs · Mathematics 2023-09-04 Indranil Chowdhury , Espen R. Jakobsen

Non-convex optimization with local search heuristics has been widely used in machine learning, achieving many state-of-art results. It becomes increasingly important to understand why they can work for these NP-hard problems on typical…

Machine Learning · Computer Science 2017-06-20 Rong Ge , Tengyu Ma

Building on existing $hp$-adaptive algorithms driven by equilibrated-flux estimators from [ESAIM Math. Model. Numer. Anal. 57 (2023), 329--366] and the references therein, we propose a novel $h$-adaptive algorithm for a fixed polynomial…

Numerical Analysis · Mathematics 2026-03-11 Théophile Chaumont-Frelet , Zhaonan Dong , Gregor Gantner , Martin Vohralík

The double-exponential Sinc-collocation method is known as a super-accurate method for solving initial value problems of ordinary differential equations, for which the error decreases almost exponentially as a function of the number of…

Numerical Analysis · Mathematics 2026-04-29 Yusaku Yamamoto , Ken'ichiro Tanaka

We present new convergence analyses for parallel subspace correction methods for unconstrained semicoercive and nearly semicoercive convex optimization problems, generalizing the theory of singular and nearly singular linear problems to a…

Numerical Analysis · Mathematics 2026-04-03 Young-Ju Lee , Jongho Park

The Fokker-Planck equation (FPE) is the partial differential equation that governs the density evolution of the It\^o process and is of great importance to the literature of statistical physics and machine learning. The FPE can be regarded…

Machine Learning · Computer Science 2022-06-28 Zebang Shen , Zhenfu Wang , Satyen Kale , Alejandro Ribeiro , Amin Karbasi , Hamed Hassani

In this paper, an important discovery has been found for nonconforming immersed finite element (IFE) methods using the integral values on edges as degrees of freedom for solving elliptic interface problems. We show that those IFE methods…

Numerical Analysis · Mathematics 2023-05-17 Haifeng Ji , Feng Wang , Jinru Chen , Zhilin Li

We revisit the classical problem of finding an approximately stationary point of the average of $n$ smooth and possibly nonconvex functions. The optimal complexity of stochastic first-order methods in terms of the number of gradient…

Machine Learning · Computer Science 2022-06-07 Alexander Tyurin , Lukang Sun , Konstantin Burlachenko , Peter Richtárik

Given a nonconvex function that is an average of $n$ smooth functions, we design stochastic first-order methods to find its approximate stationary points. The convergence of our new methods depends on the smallest (negative) eigenvalue…

Optimization and Control · Mathematics 2018-09-28 Zeyuan Allen-Zhu

This paper considers the sparse generalized eigenvalue problem (SGEP), which aims to find the leading eigenvector with at most $k$ nonzero entries. SGEP naturally arises in many applications in machine learning, statistics, and scientific…

Machine Learning · Statistics 2020-03-25 Yunfeng Cai , Ping Li

We present a new approach to solve the exponential retrieval problem. We derive a stable technique, based on the singular value decomposition (SVD) of lag-covariance and crosscovariance matrices consisting of covariance coefficients…

Signal Processing · Electrical Eng. & Systems 2020-08-11 D. J Nicolsky , G. S. Tipenko

Power iteration has been generalized to solve many interesting problems in machine learning and statistics. Despite its striking success, theoretical understanding of when and how such an algorithm enjoys good convergence property is…

Optimization and Control · Mathematics 2020-06-12 Cheolmin Kim , Youngseok Kim , Diego Klabjan

By extending the classical analysis techniques due to Samokish, Faddeev and Faddeeva, and Longsine and McCormick among others, we prove the convergence of preconditioned steepest descent with implicit deflation (PSD-id) method for solving…

Numerical Analysis · Mathematics 2016-05-31 Yunfeng Cai , Zhaojun Bai , John E. Pask , N. Sukumar

We consider a special nonconvex quartic minimization problem over a single spherical constraint, which includes the discretized energy functional minimization problem of non-rotating Bose-Einstein condensates (BECs) as one of the important…

Numerical Analysis · Mathematics 2020-12-04 Pengfei Huang , Qingzhi Yang , Yuning Yang

Motivated by applications in optimization and machine learning, we consider stochastic quasi-Newton (SQN) methods for solving stochastic optimization problems. In the literature, the convergence analysis of these algorithms relies on strong…

Optimization and Control · Mathematics 2016-03-16 Farzad Yousefian , Angelia Nedić , Uday V. Shanbha