English
Related papers

Related papers: Data-Driven optimal shrinkage of singular values u…

200 papers

We develop and analyze a set of new sequential simulation-optimization algorithms for large-scale multi-dimensional discrete optimization via simulation problems with a convexity structure. The "large-scale" notion refers to that the…

Optimization and Control · Mathematics 2022-01-20 Haixiang Zhang , Zeyu Zheng , Javad Lavaei

The first order derivative of a data density can be estimated efficiently by denoising score matching, and has become an important component in many applications, such as image generation and audio synthesis. Higher order derivatives…

Machine Learning · Computer Science 2021-11-09 Chenlin Meng , Yang Song , Wenzhe Li , Stefano Ermon

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study…

Optimization and Control · Mathematics 2024-10-02 Kabir Aladin Chandrasekher , Mengqi Lou , Ashwin Pananjady

Rational approximation schemes for reconstructing periodic signals from samples with poorly separated spectral content are described. These methods are automatic and adaptive, requiring no tuning or manual parameter selection. Collectively,…

Numerical Analysis · Mathematics 2021-12-10 Heather Wilber , Anil Damle , Alex Townsend

We introduce an ordinate method for noisy data analysis, based solely on rank information and thus insensitive to outliers. The method is nonparametric, objective, and the required data processing is parsimonious. Main ingredients are a…

Data Analysis, Statistics and Probability · Physics 2019-09-11 Glenn Ierley , Alex Kostinski

In this paper, we present a data-driven controller design method for continuous-time nonlinear systems, using no model knowledge but only measured data affected by noise. While most existing approaches focus on systems with polynomial…

Systems and Control · Electrical Eng. & Systems 2022-02-11 Robin Strässer , Julian Berberich , Frank Allgöwer

With recent deep learning based approaches showing promising results in removing noise from images, the best denoising performance has been reported in a supervised learning setup that requires a large set of paired noisy images and ground…

Image and Video Processing · Electrical Eng. & Systems 2022-09-20 Rihuan Ke

We develop a data-driven approach for signal denoising that utilizes variational mode decomposition (VMD) algorithm and Cramer Von Misses (CVM) statistic. In comparison with the classical empirical mode decomposition (EMD), VMD enjoys…

Signal Processing · Electrical Eng. & Systems 2020-06-02 Khuram Naveed , Muhammad Tahir Akhtar , Muhammad Faisal Siddiqui , Naveed ur Rehman

Although the standard formulations of prediction problems involve fully-observed and noiseless data drawn in an i.i.d. manner, many applications involve noisy and/or missing data, possibly involving dependence, as well. We study these…

Statistics Theory · Mathematics 2015-03-19 Po-Ling Loh , Martin J. Wainwright

In the study of condensed matter physics, spectral information plays an important role for understand the mechanism of materials. However, it is difficult to obtain the spectrum directly through experiments or simulation. For example, the…

Computational Physics · Physics 2022-12-23 Haidong Xie , Xueshuang Xiang , Yuanqing Chen

In this work we construct an optimal linear shrinkage estimator for the covariance matrix in high dimensions. The recent results from the random matrix theory allow us to find the asymptotic deterministic equivalents of the optimal…

Statistics Theory · Mathematics 2014-10-28 Taras Bodnar , Arjun K. Gupta , Nestor Parolya

This paper develops a unified analytical framework for determinant identities under finite-rank perturbations of square matrices that remains valid without invertibility assumptions. In contrast to classical inverse-based formulations, the…

Optimization and Control · Mathematics 2026-04-07 Robert Vrabel

In this work, we address the problem of Hessian inversion bias in distributed second-order optimization algorithms. We introduce a novel shrinkage-based estimator for the resolvent of gram matrices which is asymptotically unbiased, and…

Optimization and Control · Mathematics 2024-02-06 Fangzhao Zhang , Mert Pilanci

We introduce a novel approach for discriminative classification using evolutionary algorithms. We first propose an algorithm to optimize the total loss value using a modified 0-1 loss function in a one-dimensional space for classification.…

Neural and Evolutionary Computing · Computer Science 2018-04-27 Mohammad Reza Bonyadi , David C. Reutens

We conjecture that the inherent difference in generalisation between adaptive and non-adaptive gradient methods in deep learning stems from the increased estimation noise in the flattest directions of the true loss surface. We demonstrate…

Machine Learning · Statistics 2022-03-17 Diego Granziol , Nicholas Baskerville

Classical Kullback-Leibler or entropic distances are known to enjoy certain desirable statistical properties in the context of decision-making with noiseless data. However, in most practical situations the data available to a decision maker…

Optimization and Control · Mathematics 2024-02-26 Bart P. G. Van Parys

Motivated by the poor performance of cross-validation in settings where data are scarce, we propose a novel estimator of the out-of-sample performance of a policy in data-driven optimization.Our approach exploits the optimization problem's…

Optimization and Control · Mathematics 2022-08-04 Vishal Gupta , Michael Huang , Paat Rusmevichientong

We consider the problem of reconstructing a discrete-time signal (sequence) with continuous-valued components corrupted by a known memoryless channel. When performance is measured using a per-symbol loss function satisfying mild regularity…

Information Theory · Computer Science 2008-07-23 Kamakshi Sivaramakrishnan , Tsachy Weissman

Self-supervised learning for image denoising problems in the presence of denaturation for noisy data is a crucial approach in machine learning. However, theoretical understanding of the performance of the approach that uses denatured data…

Machine Learning · Statistics 2024-12-17 Hiroki Waida , Kimihiro Yamazaki , Atsushi Tokuhisa , Mutsuyo Wada , Yuichiro Wada

In this paper we estimate the mean-variance portfolio in the high-dimensional case using the recent results from the theory of random matrices. We construct a linear shrinkage estimator which is distribution-free and is optimal in the sense…

Statistical Finance · Quantitative Finance 2023-04-19 Taras Bodnar , Yarema Okhrin , Nestor Parolya
‹ Prev 1 4 5 6 7 8 10 Next ›