中文
相关论文

相关论文: Another view of the Gaussian algorithm

200 篇论文

We consider ``one-at-a-time'' coordinate-wise descent algorithms for a class of convex optimization problems. An algorithm of this kind has been proposed for the $L_1$-penalized regression (lasso) in the literature, but it seems to have…

统计计算 · 统计学 2007-12-18 Jerome Friedman , Trevor Hastie , Holger Höfling , Robert Tibshirani

A cumbersome operation in numerical analysis and linear algebra, optimization, machine learning and engineering algorithms; is inverting large full-rank matrices which appears in various processes and applications. This has both numerical…

数值分析 · 数学 2022-06-24 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

The robust principal component analysis (RPCA) decomposes a data matrix into a low-rank part and a sparse part. There are mainly two types of algorithms for RPCA. The first type of algorithm applies regularization terms on the singular…

数值分析 · 数学 2021-02-02 Ningyu Sha , Lei Shi , Ming Yan

The purpose of this paper is twofold. First, we use a classical method to establish Gaussian bounds of the fundamental matrix of a generalized parabolic Lam\'{e} system with only bounded and measurable coefficients. Second, we derive a…

偏微分方程分析 · 数学 2021-04-27 Huan Xu

We consider differentially private approximate singular vector computation. Known worst-case lower bounds show that the error of any differentially private algorithm must scale polynomially with the dimension of the singular vector. We are…

数据结构与算法 · 计算机科学 2012-11-06 Moritz Hardt , Aaron Roth

We investigate the problem of recovering a partially observed high-rank matrix whose columns obey a nonlinear structure such as a union of subspaces, an algebraic variety or grouped in clusters. The recovery problem is formulated as the…

机器学习 · 统计学 2022-12-12 Florentin Goyens , Coralia Cartis , Armin Eftekhari

Lattice reduction is a combinatorial optimization problem aimed at finding the most orthogonal basis in a given lattice. The Lenstra-Lenstra-Lov\'asz (LLL) algorithm is the best algorithm in the literature for solving this problem. In light…

机器学习 · 计算机科学 2025-02-11 Giovanni Luca Marchetti , Gabriele Cesa , Pratik Kumar , Arash Behboodi

We propose a computational framework for computing low-rank approximations to the ensemble of solutions of a parametrized system of the form $A(\xi)x(\xi)+g(x(\xi))=b(\xi)$ for multiple parameter values. The central idea is to reinterpret…

数值分析 · 数学 2026-04-09 Marco Sutti , Tommaso Vanzan

Gaussian processes (GP) provide a prior over functions and allow finding complex regularities in data. Gaussian processes are successfully used for classification/regression problems and dimensionality reduction. In this work we consider…

机器学习 · 计算机科学 2016-11-21 Pavel Izmailov , Dmitry Kropotov

We present a framework for accelerating a spectrum of machine learning algorithms that require computation of bilinear inverse forms $u^\top A^{-1}u$, where $A$ is a positive definite matrix and $u$ a given vector. Our framework is built on…

机器学习 · 统计学 2016-05-31 Chengtao Li , Suvrit Sra , Stefanie Jegelka

Parametrized quantum optical circuits are a class of quantum circuits in which the carriers of quantum information are photons and the gates are optical transformations. Classically optimizing these circuits is challenging due to the…

量子物理 · 物理学 2020-12-02 Filippo M. Miatto , Nicolás Quesada

We give a deterministic O(log n)^n algorithm for the {\em Shortest Vector Problem (SVP)} of a lattice under {\em any} norm, improving on the previous best deterministic bound of n^O(n) for general norms and nearly matching the bound of…

计算复杂性 · 计算机科学 2011-07-28 Daniel Dadush , Santosh Vempala

Large scale optimization problems are ubiquitous in machine learning and data analysis and there is a plethora of algorithms for solving such problems. Many of these algorithms employ sub-sampling, as a way to either speed up the…

最优化与控制 · 数学 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

We describe several algorithms for matrix completion and matrix approximation when only some of its entries are known. The approximation constraint can be any whose approximated solution is known for the full matrix. For low rank…

数值分析 · 数学 2014-07-01 Gil Shabat , Yaniv Shmueli , Amir Averbuch

We study the following problem: Given a variable of interest, we would like to find a best linear predictor for it by choosing a subset of $k$ relevant variables obeying a matroid constraint. This problem is a natural generalization of…

数据结构与算法 · 计算机科学 2023-01-19 Theophile Thiery , Justin Ward

The Restricted Invertibility problem is the problem of selecting the largest subset of columns of a given matrix $X$, while keeping the smallest singular value of the extracted submatrix above a certain threshold. In this paper, we address…

概率论 · 数学 2015-12-07 Stephane Chretien

We give a generalisation of the Lenstra-Lenstra-Lov\'asz (LLL) lattice-reduction algorithm that is valid for an arbitrary (split, semisimple) reductive group $G$. This can be regarded as `lattice reduction with symmetries'. We make this…

数论 · 数学 2025-02-03 Beth Romano , Jack A. Thorne

Updating a linear least squares solution can be critical for near real-time signalprocessing applications. The Greville algorithm proposes a simple formula for updating the pseudoinverse of a matrix A $\in$ R nxm with rank r. In this paper,…

数学软件 · 计算机科学 2021-06-23 Ruben Staub , Stephan N. Steinmann

A Gaussian process (GP) is a powerful and widely used regression technique. The main building block of a GP regression is the covariance kernel, which characterizes the relationship between pairs in the random field. The optimization to…

数值分析 · 数学 2022-01-05 Vahid Keshavarzzadeh , Shandian Zhe , Robert M. Kirby , Akil Narayan

We propose a Gaussian variational inference framework for the motion planning problem. In this framework, motion planning is formulated as an optimization over the distribution of the trajectories to approximate the desired trajectory…

机器人学 · 计算机科学 2023-03-27 Hongzhe Yu , Yongxin Chen