English
Related papers

Related papers: Spectral Sparsification and Regret Minimization Be…

200 papers

Spectral graph sparsification aims to find ultra-sparse subgraphs whose Laplacian matrix can well approximate the original Laplacian eigenvalues and eigenvectors. In recent years, spectral sparsification techniques have been extensively…

Data Structures and Algorithms · Computer Science 2020-04-30 Zhuo Feng

Sparse Matrix-Vector Multiplication (SpMV) is the cornerstone in many iterative workloads, including large-scale graph analytics and sparse iterative solvers. Accelerating SpMV on real-world graphs remains challenging due to highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-11 Qi Zhang , Zhengan Yao , Zhenglu Jiang , Zan-Bo Zhang

Adaptivity to the difficulties of a problem is a key property in sequential decision-making problems to broaden the applicability of algorithms. Follow-the-regularized-leader (FTRL) has recently emerged as one of the most promising…

Machine Learning · Computer Science 2024-02-14 Taira Tsuchiya , Shinji Ito , Junya Honda

Beampattern synthesis is a key problem in many wireless applications. With the increasing scale of MIMO antenna array, it is highly desired to conduct beampattern synthesis on a sparse array to reduce the power and hardware cost. In this…

Signal Processing · Electrical Eng. & Systems 2021-06-08 Tong Wei , Linlong Wu , M. R. Bhavani Shankar

Permutation synchronization is an important problem in computer science that constitutes the key step of many computer vision tasks. The goal is to recover $n$ latent permutations from their noisy and incomplete pairwise measurements. In…

Statistics Theory · Mathematics 2024-05-13 Duc Nguyen , Anderson Ye Zhang

Sparse optimization is a fundamental challenge in various practical applications. A popular approach to sparse optimization is $\ell_p$ regularization. However, it may encounter optimization instability due to the unbounded gradients when…

Machine Learning · Computer Science 2026-05-29 Huangyu Xu , Jingqin Yang , Qianqian Xu , Jiaye Teng

Fast matrix multiplication algorithms may be useful, provided that their running time is good in practice. Particularly, the leading coefficient of their arithmetic complexity needs to be small. Many sub-cubic algorithms have large leading…

Data Structures and Algorithms · Computer Science 2020-08-11 Gal Beniamini , Nathan Cheng , Olga Holtz , Elaye Karstadt , Oded Schwartz

Background: We study the sparsification of dynamic programming folding algorithms of RNA structures. Sparsification applies to the mfe-folding of RNA structures and can lead to a significant reduction of time complexity. Results: We analyze…

Combinatorics · Mathematics 2012-02-07 Fenix W. D. Huang , Christian M. Reidys

Recovering jointly sparse signals in the multiple measurement vectors (MMV) setting is a fundamental problem in machine learning, but traditional methods often require careful parameter tuning or prior knowledge of the sparsity of the…

Machine Learning · Computer Science 2026-02-02 Lakshmi Jayalal , Sheetal Kalyani

We present the first almost-linear time algorithm for constructing linear-sized spectral sparsification for graphs. This improves all previous constructions of linear-sized spectral sparsification, which requires $\Omega(n^2)$ time. A key…

Data Structures and Algorithms · Computer Science 2015-08-14 Yin Tat Lee , He Sun

Temporal data are naturally everywhere, especially in the digital era that sees the advent of big data and internet of things. One major challenge that arises during temporal data analysis and mining is the comparison of time series or…

Machine Learning · Computer Science 2017-11-15 Saeid Soheily-Khah , Pierre-François Marteau

We describe a simple algorithm for spectral graph sparsification, based on iterative computations of weighted spanners and uniform sampling. Leveraging the algorithms of Baswana and Sen for computing spanners, we obtain the first…

Data Structures and Algorithms · Computer Science 2014-04-21 Ioannis Koutis

Recently, a class of algorithms combining classical fixed point iterations with repeated random sparsification of approximate solution vectors has been successfully applied to eigenproblems with matrices as large as $10^{108} \times…

Numerical Analysis · Mathematics 2025-04-28 Jonathan Weare , Robert J. Webber

We consider the problem of minimizing an objective function that is the sum of a convex function and a group sparsity-inducing regularizer. Problems that integrate such regularizers arise in modern machine learning applications, often for…

Optimization and Control · Mathematics 2020-07-30 Frank E. Curtis , Yutong Dai , Daniel P. Robinson

We consider the problem of minimizing different notions of swap regret in online optimization. These forms of regret are tightly connected to correlated equilibrium concepts in games, and have been more recently shown to guarantee…

Machine Learning · Computer Science 2026-05-22 Ioannis Anagnostides , Gabriele Farina , Maxwell Fishelson , Haipeng Luo , Jon Schneider

We consider the problem of output feedback controller sparsification for systems with parametric uncertainties. We develop an optimization scheme that minimizes the performance deterioration caused by the sparsification process, while…

Optimization and Control · Mathematics 2018-05-16 Reza Arastoo , MirSaleh Bahavarnia

We show that a simple randomized sketch of the matrix multiplicative weight (MMW) update enjoys (in expectation) the same regret bounds as MMW, up to a small constant factor. Unlike MMW, where every step requires full matrix exponentiation,…

Machine Learning · Computer Science 2019-08-14 Yair Carmon , John C. Duchi , Aaron Sidford , Kevin Tian

Streaming 3D reconstruction demands long-horizon state updates under strict latency constraints, yet stateful recurrent models often suffer from geometric drift as errors accumulate over time. We revisit this problem from a Grassmannian…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Hui Deng , Yuxin Mao , Yuxin He , Yuchao Dai

Spectral unmixing (SU) is a technique to characterize mixed pixels in hyperspectral images measured by remote sensors. Most of the spectral unmixing algorithms are developed using the linear mixing models. To estimate endmembers and…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Sara Khoshsokhan , Roozbeh Rajabi , Hadi Zayyani

We study the densest subgraph problem and give algorithms via multiplicative weights update and area convexity that converge in $O\left(\frac{\log m}{\epsilon^{2}}\right)$ and $O\left(\frac{\log m}{\epsilon}\right)$ iterations,…

Data Structures and Algorithms · Computer Science 2024-06-18 Ta Duy Nguyen , Alina Ene