English
Related papers

Related papers: SuperDC: Stable superfast divide-and-conquer eigen…

200 papers

We propose a new method for computing the eigenvalue decomposition of a dense real normal matrix $A$ through the decomposition of its skew-symmetric part. The method relies on algorithms that are known to be efficiently implemented, such as…

Numerical Analysis · Mathematics 2026-03-31 Simon Mataigne , Kyle A. Gallivan

Semidefinite programs (SDPs) often arise in relaxations of some NP-hard problems, and if the solution of the SDP obeys certain rank constraints, the relaxation will be tight. Decomposition methods based on chordal sparsity have already been…

Optimization and Control · Mathematics 2020-09-17 Jared Miller , Yang Zheng , Biel Roig-Solvas , Mario Sznaier , Antonis Papachristodoulou

We present semi-decentralized and distributed algorithms, designed via a preconditioned forward-backward operator splitting, for solving large-scale, decomposable semidefinite programs (SDPs). We exploit a chordal aggregate sparsity pattern…

Optimization and Control · Mathematics 2019-11-19 Filippo Fabiani , Sergio Grammatico

Semidefinite programs (SDPs) are powerful theoretical tools that have been studied for over two decades, but their practical use remains limited due to computational difficulties in solving large-scale, realistic-sized problems. In this…

Optimization and Control · Mathematics 2018-05-15 Richard Y. Zhang , Javad Lavaei

This work is concerned with approximating the smallest eigenvalue of a parameter-dependent Hermitian matrix $A(\mu)$ for many parameter values $\mu \in \mathbb{R}^P$. The design of reliable and efficient algorithms for addressing this task…

Numerical Analysis · Mathematics 2015-04-24 Petar Sirković , Daniel Kressner

We investigate the stability of a Sequential Monte Carlo (SMC) method applied to the problem of sampling from a target distribution on $\mathbb{R}^d$ for large $d$. It is well known that using a single importance sampling step one produces…

Computation · Statistics 2012-04-19 Alexandros Beskos , Dan Crisan , Ajay Jasra

We introduce fast randomized algorithms for solving semidefinite programming (SDP) relaxations of the partial permutation synchronization (PPS) problem, a core task in multi-image matching with significant relevance to 3D reconstruction.…

Optimization and Control · Mathematics 2025-06-26 Michael Lindsey , Yunpeng Shi

Nowadays, data are generated massively and rapidly from scientific fields as bioinformatics, neuroscience and astronomy to business and engineering fields. Cluster analysis, as one of the major data analysis tools, is therefore more…

Machine Learning · Computer Science 2015-01-07 Teng Qiu , Yongjie Li

In this paper, we consider the problem of partitioning a small data sample of size $n$ drawn from a mixture of 2 sub-gaussian distributions in $\R^p$. We consider semidefinite programming relaxations of an integer quadratic program that is…

Machine Learning · Statistics 2025-03-19 Shuheng Zhou

In distributed model predictive control (DMPC), where a centralized optimization problem is solved in distributed fashion using dual decomposition, it is important to keep the number of iterations in the solution algorithm, i.e. the amount…

Optimization and Control · Mathematics 2013-07-11 Pontus Giselsson , Anders Rantzer

We present a practical and powerful new framework for both unconstrained and constrained submodular function optimization based on discrete semidifferentials (sub- and super-differentials). The resulting algorithms, which repeatedly compute…

Data Structures and Algorithms · Computer Science 2013-08-13 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

In this paper we extend the deterministic sublinear FFT algorithm in Plonka et al. (2018) for fast reconstruction of $M$-sparse vectors ${\mathbf x}$ of length $N= 2^J$, where we assume that all components of the discrete Fourier transform…

Numerical Analysis · Mathematics 2021-03-09 Gerlind Plonka , Therese von Wulffen

This paper presents a randomized algorithm for computing the near-optimal low-rank dynamic mode decomposition (DMD). Randomized algorithms are emerging techniques to compute low-rank matrix approximations at a fraction of the cost of…

Numerical Analysis · Mathematics 2019-11-28 N. Benjamin Erichson , Lionel Mathelin , Steven L. Brunton , J. Nathan Kutz

Many computer vision problems (e.g., camera calibration, image alignment, structure from motion) are solved with nonlinear optimization methods. It is generally accepted that second order descent methods are the most robust, fast, and…

Computer Vision and Pattern Recognition · Computer Science 2014-05-06 Xuehan Xiong , Fernando De la Torre

Decomposition plays a significant role in cooperative co-evolution which shows great potential in large scale black-box optimization. However, current popular decomposition algorithms generally require to sample and evaluate a large number…

Optimization and Control · Mathematics 2019-05-30 Zhigang Ren , An Chen , Yaochu Jin , Wenhua Guo , Yongsheng Liang , Zuren Feng

The central importance of large scale eigenvalue problems in scientific computation necessitates the development of massively parallel algorithms for their solution. Recent advances in dense numerical linear algebra have enabled the routine…

Numerical Analysis · Mathematics 2020-05-08 David B. Williams-Young , Paul G. Beckman , Chao Yang

We develop a family of stabilized backward differentiation formula (sBDF) schemes of orders one through four for semilinear parabolic equations. The proposed methods are designed to achieve three properties that are rarely available…

Numerical Analysis · Mathematics 2026-03-25 Haishen Dai , Huan Lei , Bin Zheng

We provide a new theoretical framework for the variable-step deferred correction (DC) methods based on the well-known BDF2 formula. By using the discrete orthogonal convolution kernels, some high-order BDF2-DC methods are proven to be…

Numerical Analysis · Mathematics 2024-02-12 Jiahe Yue , Hong-lin Liao , Nan Liu

Decomposition is a proven way to shrink deep networks without changing input-output dimensionality or interface semantics. We bring this idea to hyperdimensional computing (HDC), where footprint cuts usually shrink the feature axis and…

Machine Learning · Computer Science 2026-02-04 Sanggeon Yun , Hyunwoo Oh , Ryozo Masukawa , Mohsen Imani

A family of symmetric matrices $A_1,\ldots, A_d$ is SDC (simultaneous diagonalization by congruence, also called non-orthogonal joint diagonalization) if there is an invertible matrix $X$ such that every $X^T A_k X$ is diagonal. In this…

Numerical Analysis · Mathematics 2025-04-30 Haoze He , Daniel Kressner