English
Related papers

Related papers: A New Method to Estimate the Noise in Financial Co…

200 papers

We propose a novel estimation procedure for scale-by-scale lead-lag relationships of financial assets observed at high-frequency in a non-synchronous manner. The proposed estimation procedure does not require any interpolation processing of…

Methodology · Statistics 2020-05-11 Takaki Hayashi , Yuta Koike

We introduce an event based framework of directional changes and overshoots to map continuous financial data into the so-called Intrinsic Network - a state based discretisation of intrinsically dissected time series. Defining a method for…

Trading and Market Microstructure · Quantitative Finance 2014-02-11 Anton Golub , Gregor Chliamovitch , Alexandre Dupuis , Bastien Chopard

Despite extensive research, time series classification and forecasting on noisy data remain highly challenging. The main difficulties lie in finding suitable mathematical concepts to describe time series and effectively separate noise from…

Machine Learning · Computer Science 2024-11-26 Chandrajit Bajaj , Minh Nguyen

Conformal Prediction (CP) quantifies network uncertainty by building a small prediction set with a pre-defined probability that the correct class is within this set. In this study we tackle the problem of CP calibration based on a…

Machine Learning · Computer Science 2024-05-22 Coby Penso , Jacob Goldberger

Real-world measurement noise in applications like robotics is often correlated in time, but we typically assume i.i.d. Gaussian noise for filtering. We propose general Gaussian Processes as a non-parametric model for correlated measurement…

Machine Learning · Statistics 2019-09-25 Vince Kurtz , Hai Lin

Not a matter of serious contention, Pearson's correlation coefficient is still the most important statistical association measure. Restricted to just two variables, this measure sometimes doesn't live up to users' needs and expectations.…

Mathematical Finance · Quantitative Finance 2024-02-02 Reza Salimi , Kamran Pakizeh

A method for simulating power law noise in clocks and oscillators is presented based on modification of the spectrum of white phase noise, then Fourier transforming to the time domain. Symmetric real matrices are introduced whose…

Data Analysis, Statistics and Probability · Physics 2011-03-28 Neil Ashby

There have been many matching pursuit algorithms (MPAs) which handle the sparse signal recovery problem a.k.a. compressed sensing (CS). In the MPAs, the correlation computation step has a dominant computational complexity. In this letter,…

Information Theory · Computer Science 2012-05-21 Kee-Hoon Kim , Hosung Park , Seokbeom Hong , Jong-Seon No , Habong Chung

Falsely annotated samples, also known as noisy labels, can significantly harm the performance of deep learning models. Two main approaches for learning with noisy labels are global noise estimation and data filtering. Global noise…

Machine Learning · Computer Science 2025-07-31 Yuval Grinberg , Nimrod Harel , Jacob Goldberger , Ofir Lindenbaum

An efficient technique is introduced for model inference of complex nonlinear dynamical systems driven by noise. The technique does not require extensive global optimization, provides optimal compensation for noise-induced errors and is…

Data Analysis, Statistics and Probability · Physics 2007-05-23 V. N. Smelyanskiy , D. A. Timucin , A. Bandrivskyy , D. G. Luchinsky

In many applications, weighted networks are constructed based on time series data: each time series is associated to a vertex and edge weights are given by pairwise correlations. The result is a network whose edge dependency structure…

Statistics Theory · Mathematics 2026-02-25 Keith Levin

In finance, economics and many other fields, observations in a matrix form are often observed over time. For example, many economic indicators are obtained in different countries over time. Various financial characteristics of many…

Methodology · Statistics 2017-06-22 Dong Wang , Xialu Liu , Rong Chen

We discovered that past changes in the market correlation structure are significantly related with future changes in the market volatility. By using correlation-based information filtering networks we device a new tool for forecasting the…

Portfolio Management · Quantitative Finance 2016-05-31 Nicoló Musmeci , Tomaso Aste , Tiziana Di Matteo

The problem of low-rank matrix completion with heterogeneous and sub-exponential (as opposed to homogeneous and Gaussian) noise is particularly relevant to a number of applications in modern commerce. Examples include panel sales data and…

Machine Learning · Statistics 2021-10-26 Vivek F. Farias , Andrew A. Li , Tianyi Peng

Time of flight images reflect the momentum distribution of the atoms in the trap, but the spatial noise in the image holds information on more subtle correlations. Using Bosonization, we study such noise correlations in generic one…

Strongly Correlated Electrons · Physics 2013-05-29 L. Mathey , E. Altman , A. Vishwanath

Data corruption, including missing and noisy data, poses significant challenges in real-world machine learning. This study investigates the effects of data corruption on model performance and explores strategies to mitigate these effects…

Machine Learning · Computer Science 2025-05-22 Qi Liu , Wanjing Ma

With growing credit card transaction volumes, the fraud percentages are also rising, including overhead costs for institutions to combat and compensate victims. The use of machine learning into the financial sector permits more effective…

Machine Learning · Computer Science 2022-08-26 Gayan K. Kulatilleke , Sugandika Samarakoon

An industrial process includes many devices, variables, and sub-processes that are physically or electronically interconnected. These interconnections imply some level of correlation between different process variables. Since most of the…

Systems and Control · Electrical Eng. & Systems 2021-10-05 Amir Hossein Kargaran , Amir Neshastegaran , Iman Izadi , Ehsan Yazdian

We consider the problem of reconstructing a low rank matrix from noisy observations of a subset of its entries. This task has applications in statistical learning, computer vision, and signal processing. In these contexts, "noise"…

Machine Learning · Statistics 2010-01-05 Raghunandan H. Keshavan , Andrea Montanari

This paper proposes a highly accurate algorithm to estimate the signal-to-noise ratio (SNR) for a linear system from a single realization of the received signal. We assume that the linear system has a Gaussian matrix with one sided left…

Information Theory · Computer Science 2017-10-10 Mohamed A. Suliman , Ayed M. Alrashdi , Tarig Ballal , Tareq Y. Al-Naffouri