中文
相关论文

相关论文: Mixed Precision Iterative Refinement with Sparse A…

200 篇论文

We investigate implicit regularization schemes for gradient descent methods applied to unpenalized least squares regression to solve the problem of reconstructing a sparse signal from an underdetermined system of linear measurements under…

机器学习 · 统计学 2019-09-12 Tomas Vaškevičius , Varun Kanade , Patrick Rebeschini

Sparse grids based on Lagrange polynomials have become one of the staple methods for approximating functions that are high-dimensional and expensive to evaluate, in the context e.g. of PDE-based parametric design exploration. They are…

计算工程、金融与科学 · 计算机科学 2026-03-10 Matteo Rosellini , Filippo Fruzza , Alessandro Mariotti , Maria Vittoria Salvetti , Lorenzo Tamellini

We consider sparse array beamfomer design achieving maximum signal-to interference plus noise ratio (MaxSINR). Both array configuration and weights are attuned to the changing sensing environment. This is accomplished by simultaneously…

信号处理 · 电气工程与系统科学 2019-10-24 Syed A. Hamza , Moeness G. Amin

Inverse problems arise in a wide spectrum of applications in fields ranging from engineering to scientific computation. Connected with the rise of interest in inverse problems is the development and analysis of regularization methods, such…

数值分析 · 数学 2025-05-12 Abinash Nayak

Sparse linear iterative solvers are essential for many large-scale simulations. Much of the runtime of these solvers is often spent in the implicit evaluation of matrix polynomials via a sequence of sparse matrix-vector products. A variety…

数值分析 · 数学 2026-05-12 Christie Alappat , Jonas Thies , Georg Hager , Holger Fehske , Gerhard Wellein

We present a new algorithm and the corresponding convergence analysis for the regularization of linear inverse problems with sparsity constraints, applied to a new generalized sparsity promoting functional. The algorithm is based on the…

数值分析 · 数学 2016-12-30 Sergey Voronin , Ingrid Daubechies

Learning a Gaussian Mixture Model (GMM) is hard when the number of parameters is too large given the amount of available data. As a remedy, we propose restricting the GMM to a Gaussian Markov Random Field Mixture Model (GMRF-MM), as well as…

机器学习 · 计算机科学 2022-01-25 Shahaf E. Finder , Eran Treister , Oren Freifeld

Sparse model selection is ubiquitous from linear regression to graphical models where regularization paths, as a family of estimators upon the regularization parameter varying, are computed when the regularization parameter is unknown or…

机器学习 · 统计学 2018-10-10 Chendi Huang , Yuan Yao

The convergence rate is analyzed for the SpaSRA algorithm (Sparse Reconstruction by Separable Approximation) for minimizing a sum $f (\m{x}) + \psi (\m{x})$ where $f$ is smooth and $\psi$ is convex, but possibly nonsmooth. It is shown that…

最优化与控制 · 数学 2009-12-10 William Hager , Dzung Phan , Hongchao Zhang

We study sparse recovery with structured random measurement matrices having independent, identically distributed, and uniformly bounded rows and with a nontrivial covariance structure. This class of matrices arises from random sampling of…

信息论 · 计算机科学 2020-05-15 Simone Brugiapaglia , Sjoerd Dirksen , Hans Christian Jung , Holger Rauhut

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

机器学习 · 计算机科学 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

We present a stationary iteration based upon a block splitting for a class of indefinite least squares problem. Convergence of the proposed method is investigated and optimal value of the involving parameter is used. The induced…

数值分析 · 数学 2025-12-15 Davod Khojasteh Salkuyeh

In many practical applications such as direction-of-arrival (DOA) estimation and line spectral estimation, the sparsifying dictionary is usually characterized by a set of unknown parameters in a continuous domain. To apply the conventional…

信息论 · 计算机科学 2015-06-18 Jun Fang , Jing Li , Yanning Shen , Hongbin Li , Shaoqian Li

We propose fast O(N) preconditioning, where N is the number of gridpoints on the prediction horizon, for iterative solution of (non)-linear systems appearing in model predictive control methods such as forward-difference Newton-Krylov…

最优化与控制 · 数学 2016-10-20 Andrew Knyazev , Alexander Malyshev

Variational inference techniques based on inducing variables provide an elegant framework for scalable posterior estimation in Gaussian process (GP) models. Besides enabling scalability, one of their main advantages over sparse…

机器学习 · 统计学 2021-02-24 Simone Rossi , Markus Heinonen , Edwin V. Bonilla , Zheyang Shen , Maurizio Filippone

Sparse regression and classification estimators that respect group structures have application to an assortment of statistical and machine learning problems, from multitask learning to sparse additive modeling to hierarchical selection.…

统计方法学 · 统计学 2024-03-11 Ryan Thompson , Farshid Vahid

Sparse coding refers to the pursuit of the sparsest representation of a signal in a typically overcomplete dictionary. From a Bayesian perspective, sparse coding provides a Maximum a Posteriori (MAP) estimate of the unknown vector under a…

信号处理 · 电气工程与系统科学 2019-09-04 Dror Simon , Jeremias Sulam , Yaniv Romano , Yue M. Lu , Michael Elad

In this paper, we propose an algorithm for the construction of low-rank approximations of the inverse of an operator given in low-rank tensor format. The construction relies on an updated greedy algorithm for the minimization of a suitable…

数值分析 · 数学 2017-05-11 Loic Giraldi , Anthony Nouy , Gregory Legrain

We propose a new class of multi-layer iterative schemes for solving sparse linear systems in saddle point structure. The new scheme consist of an iterative preconditioner that is based on the (approximate) nullspace method, combined with an…

数值分析 · 数学 2026-02-09 Murat Manguoğlu , Volker Mehrmann

Matrix completion constantly receives tremendous attention from many research fields. It is commonly applied for recommender systems such as movie ratings, computer vision such as image reconstruction or completion, multi-task learning such…

机器学习 · 计算机科学 2019-10-08 Abdallah Chehade , Zunya Shi