English
Related papers

Related papers: Heavy-ball-based optimal thresholding algorithms f…

200 papers

In this paper, we derive a Fast Reflected Forward-Backward (Fast RFB) algorithm to solve the problem of finding a zero of the sum of a maximally monotone operator and a monotone and Lipschitz continuous operator in a real Hilbert space. Our…

Optimization and Control · Mathematics 2025-10-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

We provide a novel -- and to the best of our knowledge, the first -- algorithm for high dimensional sparse regression with constant fraction of corruptions in explanatory and/or response variables. Our algorithm recovers the true sparse…

Machine Learning · Computer Science 2019-05-31 Liu Liu , Yanyao Shen , Tianyang Li , Constantine Caramanis

In this paper, we discuss the development of a sublinear sparse Fourier algorithm for high-dimensional data. In ``Adaptive Sublinear Time Fourier Algorithm" by D. Lawlor, Y. Wang and A. Christlieb (2013), an efficient algorithm with…

Numerical Analysis · Mathematics 2019-07-02 Bosu Choi , Andrew Christlieb , Yang Wang

In this paper, a sparsity-aware adaptive algorithm for distributed learning in diffusion networks is developed. The algorithm follows the set-theoretic estimation rationale. At each time instance and at each node of the network, a closed…

Information Theory · Computer Science 2015-06-03 Symeon Chouvardas , Konstantinos Slavakis , Yannis Kopsinis , Sergios Theodoridis

In this paper we present a linear programming solution for sign pattern recovery of a sparse signal from noisy random projections of the signal. We consider two types of noise models, input noise, where noise enters before the random…

Information Theory · Computer Science 2015-03-13 V. Saligrama , M. Zhao

This paper provides a comprehensive analysis of the design of optimal structured and sparse $H_\infty$ controllers for continuous-time linear time-invariant (LTI) systems. Three problems are considered. First, designing the sparsest…

Optimization and Control · Mathematics 2025-05-07 Zhaohua Yang , Pengyu Wang , Haishan Zhang , Shiyue Jia , Nachuan Yang , Yuxing Zhong , Ling Shi

In this paper, we investigate the inverse problem on determining the spatial component of the source term in a hyperbolic equation with time-dependent principal part. Based on a newly established Carleman estimate for general hyperbolic…

Analysis of PDEs · Mathematics 2019-04-12 Daijun Jiang , Yikan Liu , Masahiro Yamamoto

We combine the fields of heuristic optimization and optimal stopping. We propose a strategy for benchmarking randomized optimization algorithms that minimizes the expected total cost for obtaining a good solution with an optimal number of…

Quantum Physics · Physics 2016-12-07 Walter Vinci , Daniel A. Lidar

The problem of the distributed recovery of jointly sparse signals has attracted much attention recently. Let us assume that the nodes of a network observe different sparse signals with common support; starting from linear, compressed…

Optimization and Control · Mathematics 2016-11-15 Sophie M. Fosson , Javier Matamoros , Carles Anton-Haro , Enrico Magli

We consider the inverse scattering problem for sparse scatterers. An image reconstruction algorithm is proposed that is based on a nonlinear generalization of iterative hard thresholding. The convergence and error of the method was analyzed…

Numerical Analysis · Mathematics 2019-03-27 Anna C. Gilbert , Howard W. Levinson , John C. Schotland

We propose a new method for reconstruction of sparse signals with and without noisy perturbations, termed the subspace pursuit algorithm. The algorithm has two important characteristics: low computational complexity, comparable to that of…

Numerical Analysis · Computer Science 2009-01-08 Wei Dai , Olgica Milenkovic

Sparse Bayesian Learning (SBL) is a powerful framework for attaining sparsity in probabilistic models. Herein, we propose a coordinate ascent algorithm for SBL termed Relevance Matching Pursuit (RMP) and show that, as its noise variance…

Machine Learning · Computer Science 2021-06-14 Sebastian Ament , Carla Gomes

We study inverse optimization (IO), where the goal is to use a parametric optimization program as the hypothesis class to infer relationships between input-decision pairs. Most of the literature focuses on learning only the objective…

Optimization and Control · Mathematics 2025-05-22 Ke Ren , Peyman Mohajerin Esfahani , Angelos Georghiou

We consider solving the $\ell_1$-regularized least-squares ($\ell_1$-LS) problem in the context of sparse recovery, for applications such as compressed sensing. The standard proximal gradient method, also known as iterative…

Optimization and Control · Mathematics 2012-03-15 Lin Xiao , Tong Zhang

We propose a novel non-randomized anytime orienteering algorithm for finding k-optimal goals that maximize reward on a specialized graph with budget constraints. This specialized graph represents a real-world scenario which is analogous to…

Artificial Intelligence · Computer Science 2020-11-03 Abhinav Sharma , Advait Deshpande , Yanming Wang , Xinyi Xu , Prashan Madumal , Anbin Hou

We consider the problem of computing the Walsh-Hadamard Transform (WHT) of some $N$-length input vector in the presence of noise, where the $N$-point Walsh spectrum is $K$-sparse with $K = {O}(N^{\delta})$ scaling sub-linearly in the input…

Information Theory · Computer Science 2015-08-27 Xiao Li , Joseph K. Bradley , Sameer Pawar , Kannan Ramchandran

This study proposes a novel method for simplifying inequality constraints in Higher-Order Binary Optimization (HOBO) formulations. The proposed method addresses challenges associated with Quadratic Unconstrained Binary Optimization (QUBO)…

Optimization and Control · Mathematics 2025-01-22 Yuichiro Minato

We present K-Means Batch Bayesian Optimization (KMBBO), a novel batch sampling algorithm for Bayesian Optimization (BO). KMBBO uses unsupervised learning to efficiently estimate peaks of the model acquisition function. We show in empirical…

Machine Learning · Statistics 2018-09-20 Matthew Groves , Edward O. Pyzer-Knapp

A linear inverse problem is proposed that requires the determination of multiple unknown signal vectors. Each unknown vector passes through a different system matrix and the results are added to yield a single observation vector. Given the…

Numerical Analysis · Computer Science 2010-09-03 Adam C. Zelinski , Vivek K Goyal , Elfar Adalsteinsson

A major enterprise in compressed sensing and sparse approximation is the design and analysis of computationally tractable algorithms for recovering sparse, exact or approximate, solutions of underdetermined linear systems of equations. Many…

Information Theory · Computer Science 2010-04-13 Jeffrey D. Blanchard , Coralia Cartis , Jared Tanner , Andrew Thompson