English
Related papers

Related papers: A universal rank-order transform to extract signal…

200 papers

Measurement noise is an integral part while collecting data of a physical process. Thus, noise removal is necessary to draw conclusions from these data, and it often becomes essential to construct dynamical models using these data. We…

Machine Learning · Computer Science 2022-05-20 Pawan Goyal , Peter Benner

It is a big challenge in the analysis of experimental data to disentangle the unavoidable measurement noise from the intrinsic dynamical noise. Here we present a general operational method to extract measurement noise from stochastic time…

Chaotic Dynamics · Physics 2013-01-01 Pedro G. Lind , Maria Haase , Frank Böttcher , Joachim Peinke , David Kleinhans , Rudolf Friedrich

We consider the problem of estimating the state transition matrix of a linear time-invariant (LTI) system, given access to multiple independent trajectories sampled from the system. Several recent papers have conducted a non-asymptotic…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Vinay Kanakeri , Aritra Mitra

The assumption that data samples are independently identically distributed is the backbone of many learning algorithms. Nevertheless, datasets often exhibit rich structure in practice, and we argue that there exist some unknown order within…

Machine Learning · Computer Science 2019-03-06 Yao-Hung Hubert Tsai , Han Zhao , Ruslan Salakhutdinov , Nebojsa Jojic

We study the Gaussian Process regression model in the context of training data with noise in both input and output. The presence of two sources of noise makes the task of learning accurate predictive models extremely challenging. However,…

Machine Learning · Statistics 2015-07-03 Cuong Tran , Vladimir Pavlovic , Robert Kopp

We develop a data-driven optimal shrinkage algorithm for matrix denoising in the presence of high-dimensional noise with a separable covariance structure; that is, the noise is colored and dependent across samples. The algorithm, coined…

Applications · Statistics 2024-05-14 Pei-Chun Su , Hau-Tieng Wu

The efficient estimation of an approximate model order is very important for real applications with multi-dimensional data if the observed low-rank data is corrupted by additive noise. In this paper, we present a novel robust method for…

Methodology · Statistics 2022-12-21 Alexey A. Korobkov , Marina K. Diugurova , Jens Haueisen , Martin Haardt

Rank-order coding, a form of temporal coding, has emerged as a promising scheme to explain the rapid ability of the mammalian brain. Owing to its speed as well as efficiency, rank-order coding is increasingly gaining interest in diverse…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Ibrahim Alsolami , Tomoki Fukai

In this article, we develop methods for estimating a low rank tensor from noisy observations on a subset of its entries to achieve both statistical and computational efficiencies. There have been a lot of recent interests in this problem of…

Machine Learning · Statistics 2018-03-21 Dong Xia , Ming Yuan , Cun-Hui Zhang

Many applications involve estimation of a signal matrix from a noisy data matrix. In such cases, it has been observed that estimators that shrink or truncate the singular values of the data matrix perform well when the signal matrix has…

Methodology · Statistics 2018-06-20 David Gerard , Peter Hoff

In this work, we introduce a novel stochastic second-order method, within the framework of a non-monotone trust-region approach, for solving the unconstrained, nonlinear, and non-convex optimization problems arising in the training of deep…

Optimization and Control · Mathematics 2024-01-18 Natasa Krejic , Natasa Krklec Jerinkic , Angeles Martinez , Mahsa Yousefi

This paper considers the nonconvex nonsmooth problem in which the objective function is Lipschitz continuous. We focus on the stochastic setting where the algorithm can access stochastic function value evaluations with heavy-tailed noise,…

Machine Learning · Computer Science 2026-05-26 Zhuanghua Liu , Luo Luo

The aim of ordinal classification is to predict the ordered labels of the output from a set of observed inputs. Interval-valued data refers to data in the form of intervals. For the first time, interval-valued data and interval-valued…

Methodology · Statistics 2023-11-06 Aleix Alcacer , Marina Martínez-Garcia , Irene Epifanio

Estimating the rank of a corrupted data matrix is an important task in data analysis, most notably for choosing the number of components in PCA. Significant progress on this task was achieved using random matrix theory by characterizing the…

Statistics Theory · Mathematics 2023-07-12 Boris Landa , Thomas T. C. K. Zhang , Yuval Kluger

In this manuscript, a purely data driven statistical regularization method is proposed for extracting the information from big data with randomly distributed noise. Since the variance of the noise maybe large, the method can be regarded as…

Numerical Analysis · Mathematics 2021-02-19 Jin Cheng , Jiantang Zhang , Min Zhong

Deep generative models offer a natural foundation for out-of-distribution (OOD) detection, yet prior work has shown that their assigned likelihoods are notoriously unreliable indicators for in- vs out-of-distribution data. In this paper, we…

Machine Learning · Computer Science 2026-05-22 Philipp Bomatter , Jack Geary , Henry Gouk

This paper studies problems of inferring order given noisy information. In these problems there is an unknown order (permutation) $\pi$ on $n$ elements denoted by $1,...,n$. We assume that information is generated in a way correlated with…

Data Structures and Algorithms · Computer Science 2009-10-08 Mark Braverman , Elchanan Mossel

We propose a general framework for reconstructing and denoising single entries of incomplete and noisy entries. We describe: effective algorithms for deciding if and entry can be reconstructed and, if so, for reconstructing and denoising…

Machine Learning · Statistics 2013-04-02 Franz J. Király , Louis Theran

Inspired by the swarming or flocking of animal systems we study groups of agents moving in unbounded 2D space. Individual trajectories derive from a ``bottom-up'' principle: individuals reorient to maximise their future path entropy over…

Statistical Mechanics · Physics 2023-04-21 Harvey L. Devereux , Matthew S. Turner

There has been a recent surge of interest in studying permutation-based models for ranking from pairwise comparison data. Despite being structurally richer and more robust than parametric ranking models, permutation-based models are less…

Machine Learning · Statistics 2017-10-31 Cheng Mao , Jonathan Weed , Philippe Rigollet