English
Related papers

Related papers: New deterministic approaches to the least square m…

200 papers

We study the spectral norm of matrices M that can be factored as M=BA, where A is a random matrix with independent mean zero entries, and B is a fixed matrix. Under the (4+epsilon)-th moment assumption on the entries of A, we show that the…

Probability · Mathematics 2016-12-23 Roman Vershynin

Let $(Y,g)$ be a compact Riemannian manifold of positive scalar curvature (psc). It is well-known, due to Schoen-Yau, that any closed stable minimal hypersurface of $Y$ also admits a psc-metric. We establish an analogous result for stable…

Differential Geometry · Mathematics 2017-02-07 Boris Botvinnik , Demetre Kazaras

Random matrix ensembles are introduced that respect the local tensor structure of Hamiltonians describing a chain of $n$ distinguishable spin-half particles with nearest-neighbour interactions. We prove a central limit theorem for the…

Mathematical Physics · Physics 2017-06-19 J. P. Keating , N. Linden , H. J. Wells

Recently, Pagh presented a randomized approximation algorithm for the multiplication of real-valued matrices building upon work for detecting the most frequent items in data streams. We continue this line of research and present new {\em…

Data Structures and Algorithms · Computer Science 2012-09-21 Konstantin Kutzkov

We use the geometric mean to parametrize metrics in the Hassan-Rosen ghost-free bimetric theory and pose the initial-value problem. The geometric mean of two positive definite symmetric matrices is a well-established mathematical notion…

High Energy Physics - Theory · Physics 2025-03-24 Mikica Kocic

This paper presents an efficient algorithm for the progressive approximation of Wasserstein barycenters of persistence diagrams, with applications to the visual analysis of ensemble data. Given a set of scalar fields, our approach enables…

Graphics · Computer Science 2019-10-10 Jules Vidal , Joseph Budin , Julien Tierny

Nonlinear least-squares problems are a special class of unconstrained optimization problems in which their gradient and Hessian have special structures. In this paper, we exploit these structures and proposed a matrix-free algorithm with a…

Optimization and Control · Mathematics 2020-02-06 Aliyu Muhammed Awwal , Poom Kumam , Hassan Mohammad

In this paper we propose a semi-parametric Bayesian Generalized Least Squares estimator. In a generic setting where each error is a vector, the parametric Generalized Least Square estimator maintains the assumption that each error vector…

Econometrics · Economics 2023-02-01 Ruochen Wu , Melvyn Weeks

We extend the geometrical inverse approximation approach for solving linear least-squares problems. For that we focus on the minimization of $1-\cos(X(A^TA),I)$, where $A$ is a given rectangular coefficient matrix and $X$ is the approximate…

Numerical Analysis · Mathematics 2019-02-25 Jean-Paul Chehab , Marcos Raydan

We consider the minimization of composite objective functions composed of the expectation of quadratic functions and an arbitrary convex function. We study the stochastic dual averaging algorithm with a constant step-size, showing that it…

Optimization and Control · Mathematics 2017-02-22 Nicolas Flammarion , Francis Bach

Many problems in computational science and engineering become one-to-many after coarse graining, partial observation, or inverse reconstruction: a resolved state may not determine a unique subgrid forcing, a structural descriptor may not…

Machine Learning · Statistics 2026-05-28 Junfeng Chen

We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction…

Machine Learning · Computer Science 2021-02-10 Zhengmian Hu , Feihu Huang , Heng Huang

We consider the least-squares regression problem and provide a detailed asymptotic analysis of the performance of averaged constant-step-size stochastic gradient descent (a.k.a. least-mean-squares). In the strongly-convex case, we provide…

Machine Learning · Computer Science 2014-12-02 Alexandre Défossez , Francis Bach

Geodesic metric spaces support a variety of averaging constructions for given finite sets. Computing such averages has generated extensive interest in diverse disciplines. Here we consider the inverse problem of recognizing computationally…

Optimization and Control · Mathematics 2024-06-07 Ariel Goodwin , Adrian S. Lewis , Genaro Lopez-Acedo , Adriana Nicolae

In this paper we present new constructive methods, random and deterministic, for the efficient subsampling of finite frames in $\mathbb C^m$. Based on a suitable random subsampling strategy, we are able to extract from any given frame with…

Numerical Analysis · Mathematics 2023-01-25 Felix Bartel , Martin Schäfer , Tino Ullrich

The problem of finding the longest simple cycle in a directed graph is NP-hard, with critical applications in computational biology, scheduling, and network analysis. Existing approaches include exact algorithms with exponential runtimes,…

Data Structures and Algorithms · Computer Science 2026-01-13 Ali Dasdan

We study the problem of model aggregation within the Wasserstein space for probability measures on the real line. Given a fixed finite collection of candidate probability models, we consider the associated class of Wasserstein barycenters…

We give a deterministic algorithm for finding the minimum (weight) cut of an undirected graph on $n$ vertices and $m$ edges using $\text{polylog}(n)$ calls to any maximum flow subroutine. Using the current best deterministic maximum flow…

Data Structures and Algorithms · Computer Science 2022-05-31 Jason Li , Debmalya Panigrahi

We prove the following isoperimetric type inequality: Given a finite absolutely continuous Borel measure on ${\mathbb R}^n$, halfspaces have maximal measure among all subsets with prescribed barycenter. As a consequence, we make progress…

Probability · Mathematics 2025-07-11 Shoni Gilboa , Pazit Haim-Kislev , Boaz Slomka

Mean-Field is an efficient way to approximate a posterior distribution in complex graphical models and constitutes the most popular class of Bayesian variational approximation methods. In most applications, the mean field distribution…

Machine Learning · Computer Science 2015-02-23 Pierre Baqué , Jean-Hubert Hours , François Fleuret , Pascal Fua