English
Related papers

Related papers: Calculating the matrix profile from noisy data

200 papers

From neuroscience and genomics to systems biology and ecology, researchers rely on clustering similarity data to uncover modular structure. Yet widely used clustering methods, such as hierarchical clustering, k-means, and WGCNA, lack…

Machine Learning · Statistics 2025-10-20 Magnus Neuman , Jelena Smiljanić , Martin Rosvall

In practice most functional data cannot be recorded on a continuum, but rather at discrete time points. It is also quite common that these measurements come with an additive error, which one would like eliminate for the statistical…

Statistics Theory · Mathematics 2021-11-16 Siegfried Hörmann , Fatima Jammoul

Mapper is an unsupervised machine learning algorithm generalising the notion of clustering to obtain a geometric description of a dataset. The procedure splits the data into possibly overlapping bins which are then clustered. The output of…

Algebraic Topology · Mathematics 2019-06-05 Francisco Belchí , Jacek Brodzki , Matthew Burfitt , Mahesan Niranjan

The process of data mining with differential privacy produces results that are affected by two types of noise: sampling noise due to data collection and privacy noise that is designed to prevent the reconstruction of sensitive information.…

Machine Learning · Computer Science 2018-04-12 Yue Wang , Daniel Kifer , Jaewoo Lee

We study the problem of robust data augmentation for regression tasks in the presence of noisy data. Data augmentation is essential for generalizing deep learning models, but most of the techniques like the popular Mixup are primarily…

Machine Learning · Computer Science 2024-08-19 Seong-Hyeon Hwang , Minsu Kim , Steven Euijong Whang

Analyzing demographic data collected across multiple populations, time periods, and age groups is challenging due to the interplay of high dimensionality, demographic heterogeneity among groups, and stochastic variability within smaller…

Applications · Statistics 2025-12-12 Gregor Zens

Understanding the effect of uncertainty and noise in data on machine learning models (MLM) is crucial in developing trust and measuring performance. In this paper, a new model is proposed to quantify uncertainties and noise in data on MLMs.…

Machine Learning · Computer Science 2024-12-10 Usman Anjum , Chris Trentman , Elrod Caden , Justin Zhan

In many applications of machine learning (ML), updates are performed with the goal of enhancing model performance. However, current practices for updating models rely solely on isolated, aggregate performance analyses, overlooking important…

Machine Learning · Computer Science 2020-08-12 Megha Srivastava , Besmira Nushi , Ece Kamar , Shital Shah , Eric Horvitz

We investigate the problem of estimating a given real symmetric signal matrix $\textbf{C}$ from a noisy observation matrix $\textbf{M}$ in the limit of large dimension. We consider the case where the noisy measurement $\textbf{M}$ comes…

Statistical Mechanics · Physics 2016-10-28 Joël Bun , Romain Allez , Jean-Philippe Bouchaud , Marc Potters

Reconstructing the parameters that encode the influence between model variables based on time-series measurements represents an outstanding question in the theory of complex network-coupled systems. Here, we propose a solution to this…

Systems and Control · Electrical Eng. & Systems 2026-04-08 Melvyn Tyloo

We consider the frequency estimation of periodic signals using noisy time-of-arrival (TOA) information with missing (sparse) data contaminated with outliers. We tackle the problem from a mathematical optimization standpoint, formulating it…

Optimization and Control · Mathematics 2024-09-04 Romain Puech , Vincent Gouldieff

A multivariate score-driven filter is developed to extract signals from noisy vector processes. By assuming that the conditional location vector from a multivariate Student's t distribution changes over time, we construct a robust filter…

Econometrics · Economics 2022-08-31 Enzo D'Innocenzo , Alessandra Luati , Mario Mazzocchi

We develop a novel algorithm for feature extraction in time series data by leveraging tools from topological data analysis. Our algorithm provides a simple, efficient way to successfully harness topological features of the attractor of the…

Computational Geometry · Computer Science 2019-06-05 Kwangho Kim , Jisu Kim , Alessandro Rinaldo

Simplicity bias is an intriguing phenomenon prevalent in various input-output maps, characterized by a preference for simpler, more regular, or symmetric outputs. Notably, these maps typically feature high-probability outputs with simple…

Information Theory · Computer Science 2024-04-10 Boumediene Hamzi , Kamaludin Dingle

The performance of a number of different measures of nonlinearity in a time series is compared numerically. Their power to distinguish noisy chaotic data from linear stochastic surrogates is determined by Monte Carlo simulation for a number…

chao-dyn · Physics 2009-10-31 Thomas Schreiber , Andreas Schmitz

Reverse engineering of complex dynamical networks is important for a variety of fields where uncovering the full topology of unknown networks and estimating parameters characterizing the network structure and dynamical processes are of…

Data Analysis, Statistics and Probability · Physics 2012-12-19 Wen-Xu Wang , Jie Ren , Ying-Cheng Lai , Baowen Li

We assume a second-order source separation model where the observed multivariate time series is a linear mixture of latent, temporally uncorrelated time series with some components pure white noise. To avoid the modelling of noise, we…

Methodology · Statistics 2019-05-07 Markus Matilainen , Klaus Nordhausen , Joni Virta

Generating musical audio directly with neural networks is notoriously difficult because it requires coherently modeling structure at many different timescales. Fortunately, most music is also highly structured and can be represented as…

Large datasets in NLP suffer from noisy labels, due to erroneous automatic and human annotation procedures. We study the problem of text classification with label noise, and aim to capture this noise through an auxiliary noise model over…

Computation and Language · Computer Science 2022-06-22 Siddhant Garg , Goutham Ramakrishnan , Varun Thumbe

A recently proposed scheme utilizing local noise addition and matrix masking enables data collection while protecting individual privacy from all parties, including the central data manager. Statistical analysis of such privacy-preserved…

Methodology · Statistics 2026-02-24 Linh H Nghiem , Aidong A. Ding , Samuel Wu