English
Related papers

Related papers: Structured Backward Errors for Special Classes of …

200 papers

We consider a Bayesian framework for estimating a high-dimensional sparse precision matrix, in which adaptive shrinkage and sparsity are induced by a mixture of Laplace priors. Besides discussing our formulation from the Bayesian…

Machine Learning · Statistics 2018-05-22 Lingrui Gan , Naveen N. Narisetty , Feng Liang

Semidefinite programs (SDPs) are standard convex problems that are frequently found in control and optimization applications. Interior-point methods can solve SDPs in polynomial time up to arbitrary accuracy, but scale poorly as the size of…

Optimization and Control · Mathematics 2022-01-10 Jared Miller , Yang Zheng , Mario Sznaier , Antonis Papachristodoulou

In this paper, we compute the structured eigenvalue backward error of a Rosenbrock system matrix $S(z)=\left[\begin{array}{cc} A-zI & B \\ C & P(z) \end{array}\right]$ for a given scalar $\lambda\in \mathbb C$. We have developed simplified…

Optimization and Control · Mathematics 2025-11-21 Anshul Prajapati , Punit Sharma

Saddle point problems arise in a variety of applications, e.g., when solving the Stokes equations. They can be formulated such that the system matrix is symmetric, but indefinite, so the variational convergence theory that is usually used…

Numerical Analysis · Mathematics 2022-03-14 Matthias Bolten , Marco Donatelli , Paola Ferrari , Isabella Furci

We survey the numerical stability of some fast algorithms for solving systems of linear equations and linear least squares problems with a low displacement-rank structure. For example, the matrices involved may be Toeplitz or Hankel. We…

Numerical Analysis · Mathematics 2021-07-06 Richard P. Brent

A mathematical characterization of serially-pruned permutations (SPPs) employed in variable-length permuters and their associated fast pruning algorithms and architectures are proposed. Permuters are used in many signal processing systems…

Information Theory · Computer Science 2014-10-21 Mohammad M. Mansour

This study introduces two second-order methods designed to provably avoid saddle points in composite nonconvex optimization problems: (i) a nonsmooth trust-region method and (ii) a curvilinear linesearch method. These developments are…

Optimization and Control · Mathematics 2025-06-30 Alexander Bodard , Masoud Ahookhosh , Panagiotis Patrinos

Statistical inference for stochastic block models typically relies on the spectrum of the normalized adjacency matrix $\A^*$. In practice, the true probability matrix $\mathbf{B}$ is unknown and must be replaced by a plug-in estimator…

Methodology · Statistics 2026-04-09 Jianwei Hu , Ding Chen , Ji Zhu

Motivated by recent progress on stochastic matching with few queries, we embark on a systematic study of the sparsification of stochastic packing problems (SPP) more generally. Specifically, we consider SPPs where elements are independently…

Data Structures and Algorithms · Computer Science 2022-11-16 Shaddin Dughmi , Yusuf Hakan Kalayci , Neel Patel

The topic of recovery of a structured model given a small number of linear observations has been well-studied in recent years. Examples include recovering sparse or group-sparse vectors, low-rank matrices, and the sum of sparse and low-rank…

Information Theory · Computer Science 2014-07-28 Samet Oymak , Amin Jalali , Maryam Fazel , Yonina C. Eldar , Babak Hassibi

The trace approximation problem for Toeplitz matrices and its applications to stationary processes dates back to the classic book by Grenander and Szeg\"o, "Toeplitz forms and their applications". It has then been extensively studied in the…

Probability · Mathematics 2013-04-25 Mamikon S. Ginovyan , Artur A. Sahakyan , Murad S. Taqqu

This paper directly builds upon previous work where we introduced new reduced basis a posteriori error bounds for parametrized saddle point problems based on Brezzi's theory. We here sharpen these estimates for the special case of a…

Numerical Analysis · Mathematics 2012-11-06 Anna-Lena Gerner , Karen Veroy

In this paper, we propose a novel deep architecture tailored for 3D point cloud applications, named as SPE-Net. The embedded ``Selective Position Encoding (SPE)'' procedure relies on an attention mechanism that can effectively attend to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Zhaofan Qiu , Yehao Li , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei

Semidefinite programming (SDP) problems are challenging to solve because of their high dimensionality. However, solving sparse SDP problems with small tree-width are known to be relatively easier because: (1) they can be decomposed into…

Optimization and Control · Mathematics 2024-11-01 Tianyun Tang , Kim-Chuan Toh

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

The main focus of this paper is the characterization and exploitation of the asymptotic spectrum of the saddle--point matrix sequences arising from the discretization of optimization problems constrained by elliptic partial differential…

Numerical Analysis · Mathematics 2021-01-05 Fabio Durastante , Isabella Furci

This paper studies a structured compound stochastic program (SP) involving multiple expectations coupled by nonconvex and nonsmooth functions. We present a successive convex-programming based sampling algorithm and establish its…

Optimization and Control · Mathematics 2021-05-25 Junyi Liu , Ying Cui , Jong-Shi Pang

We present a comprehensive framework for structured sparse coding and modeling extending the recent ideas of using learnable fast regressors to approximate exact sparse codes. For this purpose, we develop a novel block-coordinate proximal…

Machine Learning · Computer Science 2012-06-22 Alex Bronstein , Pablo Sprechmann , Guillermo Sapiro

In this work, we conduct a systematic study of stochastic saddle point problems (SSP) and stochastic variational inequalities (SVI) under the constraint of $(\epsilon,\delta)$-differential privacy (DP) in both Euclidean and non-Euclidean…

Machine Learning · Computer Science 2024-11-11 Raef Bassily , Cristóbal Guzmán , Michael Menart

Structural bias (SB) refers to systematic preferences of an optimisation algorithm for particular regions of the search space that arise independently of the objective function. While SB has been studied extensively in single-objective…

Neural and Evolutionary Computing · Computer Science 2026-02-09 Jakub Kudela , Niki van Stein , Thomas Bäck , Anna V. Kononova