English
Related papers

Related papers: Newtonized Orthogonal Matching Pursuit: Frequency …

200 papers

Newton's method is a fundamental technique in optimization with quadratic convergence within a neighborhood around the optimum. However reaching this neighborhood is often slow and dominates the computational costs. We exploit two…

Machine Learning · Computer Science 2016-05-24 Hadi Daneshmand , Aurelien Lucchi , Thomas Hofmann

Compressed sensing has a wide range of applications that include error correction, imaging, radar and many more. Given a sparse signal in a high dimensional space, one wishes to reconstruct that signal accurately and efficiently from a…

Numerical Analysis · Mathematics 2009-05-28 Deanna Needell

Isotonic regression is a nonparametric approach for fitting monotonic models to data that has been widely studied from both theoretical and practical perspectives. However, this approach encounters computational and statistical overfitting…

Methodology · Statistics 2012-03-21 Ronny Luss , Saharon Rosset , Moni Shahar

This paper proposes two novel schemes of wideband compressive spectrum sensing (CSS) via block orthogonal matching pursuit (BOMP) algorithm, for achieving high sensing accuracy in real time. These schemes aim to reliably recover the…

Signal Processing · Electrical Eng. & Systems 2023-04-14 Liyang Lu , Wenbo Xu , Yue Wang , Zhi Tian

We present an algorithm for the generalized search problem (searching $k$ marked items among $N$ items) based on a continuous Hamiltonian and exploiting resonance. This resonant algorithm has the same time complexity $O(\sqrt{N/k})$ as the…

Quantum Physics · Physics 2022-02-01 Frank Wilczek , Hong-Ye Hu , Biao Wu

This paper formulates and solves a sequential detection problem that involves the mutual information (stochastic observability) of a Gaussian process observed in noise with missing measurements. The main result is that the optimal decision…

Optimization and Control · Mathematics 2015-05-30 Vikram Krishnamurthy , Robert Bitmead , Michel Gevers , Erik Miehling

Multiple Object Tracking (MOT) focuses on modeling the relationship of detected objects among consecutive frames and merge them into different trajectories. MOT remains a challenging task as noisy and confusing detection results often…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Tao Wang , Kean Chen , Weiyao Lin , John See , Zenghui Zhang , Qian Xu , Xia Jia

Many practical optimization problems involve objective function values that are corrupted by unavoidable numerical errors. In smooth nonconvex optimization, quasi-Newton methods combined with line search are widely used due to their…

Optimization and Control · Mathematics 2026-03-12 Hiroki Hamaguchi , Naoki Marumo , Akiko Takeda

Automatic Mean Opinion Score (MOS) prediction is crucial to evaluate the perceptual quality of the synthetic speech. While recent approaches using pre-trained self-supervised learning (SSL) models have shown promising results, they only…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-01 Hui Wang , Shiwan Zhao , Xiguang Zheng , Yong Qin

In this paper has been considered probability-one global convergence of NFPH (Newton-Fixed Point Homotopy) algorithm for system of nonlinear equations and has been proposed a probability-one homotopy algorithm to solve a regularized…

Optimization and Control · Mathematics 2012-07-06 Yunchol Jong , Wonil Kim

In this paper, we present a novel yet simple homotopy proximal mapping algorithm for compressive sensing. The algorithm adopts a simple proximal mapping of the $\ell_1$ norm at each iteration and gradually reduces the regularization…

Information Theory · Computer Science 2016-08-29 Tianbao Yang , Lijun Zhang , Rong Jin , Shenghuo Zhu , Zhi-Hua Zhou

This paper presents new theoretical results on sparse recovery guarantees for a greedy algorithm, Orthogonal Matching Pursuit (OMP), in the context of continuous parametric dictionaries. Here, the continuous setting means that the…

Information Theory · Computer Science 2020-12-23 Clément Elvira , Rémi Gribonval , Charles Soussen , Cédric Herzet

Greedy algorithms for feature selection are widely used for recovering sparse high-dimensional vectors in linear models. In classical procedures, the main emphasis was put on the sample complexity, with little or no consideration of the…

Machine Learning · Statistics 2021-02-11 El Mehdi Saad , Gilles Blanchard , Sylvain Arlot

The problem of interest is the minimization of a nonlinear function subject to nonlinear equality constraints using a sequential quadratic programming (SQP) method. The minimization must be performed while observing only noisy evaluations…

Optimization and Control · Mathematics 2021-10-12 Figen Oztoprak , Richard Byrd , Jorge Nocedal

Second-order Newton-type algorithms that leverage the exact Hessian or its approximation are central to solve nonlinear optimization problems. However, their applications in solving large-scale nonconvex problems are hindered by three…

Optimization and Control · Mathematics 2026-04-08 Krishan Kumar , Ashutosh Sharma , Gauransh Dingwani , Nikhil Gupta , Vaishnavi Gupta , Ishan Bajaj

This paper considers the problem of detecting the support (sparsity pattern) of a sparse vector from random noisy measurements. Conditional power of a component of the sparse vector is defined as the energy conditioned on the component…

Information Theory · Computer Science 2015-03-24 Alyson K. Fletcher , Sundeep Rangan , Vivek K Goyal

Many speech and music analysis and processing schemes rely on an estimate of the fundamental frequency $f_0$ of periodic signal components. Most established schemes apply rather unspecific signal models such as sinusoidal models to the…

Sound · Computer Science 2021-12-23 Volker Hohmann

Parameter estimation is of fundamental importance in areas from atomic spectroscopy and atomic clocks to gravitational wave detection. Entangled probes provide a significant precision gain over classical strategies in the absence of noise.…

Quantum Physics · Physics 2013-10-28 R. Chaves , J. B. Brask , M. Markiewicz , J. Kolodynski , A. Acin

Time-Optimal Path Parameterization (TOPP) is a well-studied problem in robotics and has a wide range of applications. There are two main families of methods to address TOPP: Numerical Integration (NI) and Convex Optimization (CO). NI-based…

Robotics · Computer Science 2017-11-23 Hung Pham , Quang-Cuong Pham

Non-negative signals form an important class of sparse signals. Many algorithms have already beenproposed to recover such non-negative representations, where greedy and convex relaxed algorithms are among the most popular methods. One fast…

Signal Processing · Electrical Eng. & Systems 2020-06-09 Konstantinos Voulgaris , Mike E. Davies , Mehrdad Yaghoobi