English
Related papers

Related papers: A framework for the analytical performance assessm…

200 papers

Extremum seeking (ES) optimization approach has been very popular due to its non-model based analysis and implementation. This approach has been mostly used with gradient based search algorithms. Since least squares (LS) algorithms are…

Systems and Control · Electrical Eng. & Systems 2020-03-10 Nursefa Zengin , Baris Fidan

Large sample size brings the computation bottleneck for modern data analysis. Subsampling is one of efficient strategies to handle this problem. In previous studies, researchers make more fo- cus on subsampling with replacement (SSR) than…

Machine Learning · Statistics 2015-11-24 Rong Zhu

Estimation problems with constrained parameter spaces arise in various settings. In many of these problems, the observations available to the statistician can be modelled as arising from the noisy realization of the image of a random linear…

Statistics Theory · Mathematics 2023-03-23 Reese Pathak , Martin J. Wainwright , Lin Xiao

This is an unabridged version of a journal manuscript that has been submitted for publication [1]. (Due to length restrictions, we were forced to remove substantial amounts of content from the version that was submitted to the journal,…

Signal Processing · Electrical Eng. & Systems 2023-02-28 Rodrigo A. Lobos , Chin-Cheng Chan , Justin P. Haldar

The paper proposes a systematic framework for building data-driven stochastic differential equation (SDE) models from sparse, noisy observations. Unlike traditional parametric approaches, which assume a known functional form for the drift,…

Machine Learning · Statistics 2025-08-18 Arnab Ganguly , Riten Mitra , Jinpu Zhou

We consider the problem of parameter estimation for a system of ordinary differential equations from noisy observations on a solution of the system. In case the system is nonlinear, as it typically is in practical applications, an analytic…

Statistics Theory · Mathematics 2012-07-27 Shota Gugushvili , Chris A. J. Klaassen

In this paper, we examine the parameter estimation performance of three well-known sinusoidal models for speech and audio. The first one is the standard Sinusoidal Model (SM), which is based on the Fast Fourier Transform (FFT). The second…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 George P. Kafentzis

In this paper, we study smooth stochastic multi-level composition optimization problems, where the objective function is a nested composition of $T$ functions. We assume access to noisy evaluations of the functions and their gradients,…

Optimization and Control · Mathematics 2022-02-15 Krishnakumar Balasubramanian , Saeed Ghadimi , Anthony Nguyen

This paper introduces an unsupervised framework for detecting audio patterns in musical samples (loops) through anomaly detection techniques, addressing challenges in music information retrieval (MIR). Existing methods are often constrained…

Sound · Computer Science 2025-06-02 Shayan Dadman , Bernt Arild Bremdal , Børre Bang , Rune Dalmo

In this paper, we consider a compressed sensing problem of reconstructing a sparse signal from an undersampled set of noisy linear measurements. The regularized least squares or least absolute shrinkage and selection operator (LASSO)…

Information Theory · Computer Science 2014-10-30 Chao-Kai Wen , Jun Zhang , Kai-Kit Wong , Jung-Chieh Chen , Chau Yuen

We investigate the theoretical foundations of a recently introduced entropy-based formulation of weighted least squares for the approximation of overdetermined linear systems, motivated by robust data fitting in the presence of sparse gross…

Numerical Analysis · Mathematics 2026-03-17 Felice Iavernaro , Monica Lazzo , Lorenzo Pisani

We propose a new framework -- Square Root Principal Component Pursuit -- for low-rank matrix recovery from observations corrupted with noise and outliers. Inspired by the square root Lasso, this new formulation does not require prior…

Machine Learning · Computer Science 2021-11-01 Junhui Zhang , Jingkai Yan , John Wright

The estimation of parameters in a linear model is considered under the hypothesis that the noise, with finite second order statistics, can be represented in a given deterministic basis by random coefficients. An extended underdetermined…

Statistics Theory · Mathematics 2014-05-06 Piero Barone , Isabella Lari

In an increasing number of applications, it is of interest to recover an approximately low-rank data matrix from noisy observations. This paper develops an unbiased risk estimate---holding in a Gaussian model---for any spectral estimator…

Statistics Theory · Mathematics 2015-06-11 Emmanuel J. Candes , Carlos A. Sing-Long , Joshua D. Trzasko

The stability of sparse signal reconstruction is investigated in this paper. We design efficient algorithms to verify the sufficient condition for unique $\ell_1$ sparse recovery. One of our algorithm produces comparable results with the…

Information Theory · Computer Science 2015-05-18 Gongguo Tang , Arye Nehorai

We study the problem of optimizing a function under a \emph{budgeted number of evaluations}. We only assume that the function is \emph{locally} smooth around one of its global optima. The difficulty of optimization is measured in terms of…

Machine Learning · Computer Science 2019-02-26 Peter L. Bartlett , Victor Gabillon , Michal Valko

Modern wireless communication systems operating at high carrier frequencies are characterized by a high dimensionality of the underlying parameter space (including channel gains, angles, delays, and possibly Doppler shifts). Estimating…

Signal Processing · Electrical Eng. & Systems 2021-11-16 Fan Jiang , Fuxi Wen , Yu Ge , Meifang Zhu , Henk Wymeersch , Fredrik Tufvesson

An accelerated class of adaptive scheme of iterative thresholding algorithms is studied analytically and empirically. They are based on the feedback mechanism of the null space tuning techniques (NST+HT+FB). The main contribution of this…

Information Theory · Computer Science 2020-05-15 Ningning Han , Shidong Li , Zhanjie Song

This paper proposes a novel model inference procedure to identify system matrix from a single noisy trajectory over a finite-time interval. The proposed inference procedure comprises an observation data processor, a redundant data processor…

Systems and Control · Electrical Eng. & Systems 2021-01-05 Yanbing Mao , Naira Hovakimyan , Petros Voulgaris , Lui Sha

This paper addresses the problem of deriving the asymptotic performance of adaptive Low Rank (LR) filters used in target detection embedded in a disturbance composed of a LR Gaussian noise plus a white Gaussian noise. In this context, we…

Applications · Statistics 2015-03-19 Alice Combernoux , Frederic Pascal , Guillaume Ginolhac , Marc Lesturgie