English
Related papers

Related papers: Visualizing Dependence in High-Dimensional Data: A…

200 papers

The growth of machine-readable data in finance, such as alternative data, requires new modeling techniques that can handle non-stationary and non-parametric data. Due to the underlying causal dependence and the size and complexity of the…

Computational Finance · Quantitative Finance 2022-05-04 Nicole Koenigstein

Testing (conditional) independence of multivariate random variables is a task central to statistical inference and modelling in general - though unfortunately one for which to date there does not exist a practicable workflow. State-of-art…

Machine Learning · Statistics 2018-05-01 Samuel Burkart , Franz J Király

Characterizing temporal dependence patterns is a critical step in understanding the statistical properties of sequential data. Long Range Dependence (LRD) --- referring to long-range correlations decaying as a power law rather than…

Machine Learning · Computer Science 2019-05-24 Francois Belletti , Minmin Chen , Ed H. Chi

Investigating relationships between variables in multi-dimensional data sets is a common task for data analysts and engineers. More specifically, it is often valuable to understand which ranges of which input variables lead to particular…

Machine Learning · Computer Science 2020-09-14 Johannes Knittel , Andres Lalama , Steffen Koch , Thomas Ertl

Kendall's tau and conditional Kendall's tau matrices are multivariate (conditional) dependence measures between the components of a random vector. For large dimensions, available estimators are computationally expensive and can be improved…

Statistics Theory · Mathematics 2024-12-30 Rutger van der Spek , Alexis Derumigny

Modern risk modelling approaches deal with vectors of multiple components. The components could be, for example, returns of financial instruments or losses within an insurance portfolio concerning different lines of business. One of the…

Probability · Mathematics 2021-05-12 Miriam Hägele , Jaakko Lehtomaa

Measuring a strength of dependence of random variables is an important problem in statistical practice. In this paper, we propose a new function valued measure of dependence of two random variables. It allows one to study and visualize…

Methodology · Statistics 2014-05-12 Teresa Ledwina

Constraint-based causal discovery algorithms utilize many statistical tests for conditional independence to uncover networks of causal dependencies. These approaches to causal discovery rely on an assumed correspondence between the…

Machine Learning · Computer Science 2025-04-18 Bijan Mazaheri , Jiaqi Zhang , Caroline Uhler

Understanding and forecasting changing market conditions in complex economic systems like the financial market is of great importance to various stakeholders such as financial institutions and regulatory agencies. Based on the finding that…

Statistical Finance · Quantitative Finance 2023-05-10 Tobias Wand , Martin Heßler , Oliver Kamps

The thesis is composed of three parts. Part I introduces the mathematical and statistical tools that are relevant for the study of dependences, as well as statistical tests of Goodness-of-fit for empirical probability distributions. I…

Statistical Finance · Quantitative Finance 2013-09-20 Rémy Chicheportiche

With the increasing availability of high-dimensional data, analysts often rely on exploratory data analysis to understand complex data sets. A key approach to exploring such data is dimensionality reduction, which embeds high-dimensional…

Machine Learning · Computer Science 2024-12-17 Pavlin G. Poličar , Blaž Zupan

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

Dimensionality-reduction methods are a fundamental tool in the analysis of large data sets. These algorithms work on the assumption that the "intrinsic dimension" of the data is generally much smaller than the ambient dimension in which it…

Machine Learning · Computer Science 2018-10-30 Henry Kvinge , Elin Farnell , Michael Kirby , Chris Peterson

Conditional Kendall's tau is a measure of dependence between two random variables, conditionally on some covariates. We assume a regression-type relationship between conditional Kendall's tau and some covariates, in a parametric setting…

Statistics Theory · Mathematics 2018-11-21 Alexis Derumigny , Jean-David Fermanian

Big Data involves both a large number of events but also many variables. This paper will concentrate on the challenge presented by the large number of variables in a Big Dataset. It will start with a brief review of exploratory data…

Applications · Statistics 2019-07-24 S. J. Watts , L. Crow

The study of dependence between random variables is the core of theoretical and applied statistics. Static and dynamic copula models are useful for describing the dependence structure, which is fully encrypted in the copula probability…

Methodology · Statistics 2018-03-20 Dominque Guégan , Matteo Iacopini

We develop a new statistical procedure to test whether the dependence structure is identical between two groups. Rather than relying on a single index such as Pearson's correlation coefficient or Kendall's Tau, we consider the entire…

Econometrics · Economics 2018-11-07 Juwon Seo

This dissertation investigates the ability of the Ising model to replicate statistical characteristics, or stylized facts, commonly observed in financial assets. The study specifically examines in the S&P500 index the following features:…

Statistical Finance · Quantitative Finance 2025-04-29 Bruno Giorgio

The assumption of independence between observations (units) in a dataset is prevalent across various methodologies for learning causal graphical models. However, this assumption often finds itself in conflict with real-world data, posing…

Machine Learning · Computer Science 2024-12-31 Alex Chen , Qing Zhou

This work approaches the multidimensional scaling problem from a novel angle. We introduce a scalable method based on the h-plot, which inherently accommodates asymmetric proximity data. Instead of embedding the objects themselves, the…

Applications · Statistics 2026-01-12 Aleix Alcacer , Irene Epifanio