English
Related papers

Related papers: Nonlinear Sufficient Dimension Reduction for Distr…

200 papers

Locally stationary (LSPs) constitute an essential modeling paradigm for capturing the nuanced dynamics inherent in time series data whose statistical characteristics, including mean and variance, evolve smoothly across time. In this paper,…

Statistics Theory · Mathematics 2025-08-29 Jan Nino G. Tinio , Mokhtar Z. Alaya , Salim Bouzebda

With the rapid development of data collection techniques, complex data objects that are not in the Euclidean space are frequently encountered in new statistical applications. Fr\'echet regression model (Peterson & M\"uller 2019) provides a…

Methodology · Statistics 2022-12-08 Qi Zhang , Lingzhou Xue , Bing Li

Supervised dimensionality reduction has emerged as an important theme in the last decade. Despite the plethora of models and formulations, there is a lack of a simple model which aims to project the set of patterns into a space defined by…

Machine Learning · Statistics 2016-10-28 Anthony O. Smith , Anand Rangarajan

In this work, we develop a new theory and method for sufficient dimension reduction (SDR) in single-index models, where SDR is a sub-field of supervised dimension reduction based on conditional independence. Our work is primarily motivated…

Machine Learning · Statistics 2024-05-31 Seungbeom Hong , Ilmun Kim , Jun Song

Variational Inference approximates an unnormalized distribution via the minimization of Kullback-Leibler (KL) divergence. Although this divergence is efficient for computation and has been widely used in applications, it suffers from some…

Machine Learning · Statistics 2022-07-28 Mingxuan Yi , Song Liu

Modeling observations as random distributions embedded within Wasserstein spaces is becoming increasingly popular across scientific fields, as it captures the variability and geometric structure of the data more effectively. However, the…

Statistics Theory · Mathematics 2026-04-08 François Bachoc , Alberto González-Sanz , Jean-Michel Loubes , Yisha Yao

We develop a novel clustering method for distributional data, where each data point is regarded as a probability distribution on the real line. For distributional data, it has been challenging to develop a clustering method that utilizes…

Methodology · Statistics 2025-06-24 Ryo Okano , Masaaki Imaizumi

Distance metrics and their nonlinear variant play a crucial role in machine learning based real-world problem solving. We demonstrated how Euclidean and cosine distance measures differ not only theoretically but also in real-world medical…

Machine Learning · Computer Science 2021-02-25 Der-Chen Chang , Ophir Frieder , Chi-Feng Hung , Hao-Ren Yao

Assume that we observe i.i.d.~points lying close to some unknown $d$-dimensional $\mathcal{C}^k$ submanifold $M$ in a possibly high-dimensional space. We study the problem of reconstructing the probability distribution generating the…

Statistics Theory · Mathematics 2022-02-15 Vincent Divol

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

Machine Learning · Computer Science 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros

In the field of modern high-energy physics research, there is a growing emphasis on utilizing deep learning techniques to optimize event simulation, thereby expanding the statistical sample size for more accurate physical analysis.…

Computational Physics · Physics 2025-06-16 Chu-Cheng Pan , Xiang Dong , Yu-Chang Sun , Ao-Yan Cheng , Ao-Bo Wang , Yu-Xuan Hu , Hao Cai

Existing approaches to depth or disparity estimation output a distribution over a set of pre-defined discrete values. This leads to inaccurate results when the true depth or disparity does not match any of these values. The fact that this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Divyansh Garg , Yan Wang , Bharath Hariharan , Mark Campbell , Kilian Q. Weinberger , Wei-Lun Chao

It has long been thought that high-dimensional data encountered in many practical machine learning tasks have low-dimensional structure, i.e., the manifold hypothesis holds. A natural question, thus, is to estimate the intrinsic dimension…

Machine Learning · Statistics 2022-06-01 Adam Block , Zeyu Jia , Yury Polyanskiy , Alexander Rakhlin

Resource-efficiently computing representations of probability distributions and the distances between them while only having access to the samples is a fundamental and useful problem across mathematical sciences. In this paper, we propose a…

Machine Learning · Computer Science 2025-06-19 Debabrota Basu , Debarshi Chanda

This paper studies the problem of distribution matching (DM), which is a fundamental machine learning problem seeking to robustly align two probability distributions. Our approach is established on a relaxed formulation, called partial…

Machine Learning · Computer Science 2025-05-27 Zi-Ming Wang , Nan Xue , Ling Lei , Rebecka Jörnsten , Gui-Song Xia

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

Machine Learning · Computer Science 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

This paper concerns the convergence of empirical measures in high dimensions. We propose a new class of probability metrics and show that under such metrics, the convergence is free of the curse of dimensionality (CoD). Such a feature is…

Probability · Mathematics 2023-09-19 Jiequn Han , Ruimeng Hu , Jihao Long

Algebraic topology methods have recently played an important role for statistical analysis with complicated geometric structured data such as shapes, linked twist maps, and material data. Among them, \textit{persistent homology} is a…

Machine Learning · Statistics 2018-10-30 Tam Le , Makoto Yamada

We seek a generalization of regression and principle component analysis (PCA) in a metric space where data points are distributions metrized by the Wasserstein metric. We recast these analyses as multimarginal optimal transport problems.…

Optimization and Control · Mathematics 2020-04-20 Amirhossein Karimi , Luigia Ripani , Tryphon T. Georgiou

The Wasserstein distance is a metric on a space of probability measures that has seen a surge of applications in statistics, machine learning, and applied mathematics. However, statistical aspects of Wasserstein distances are bottlenecked…

Probability · Mathematics 2022-03-02 Ziv Goldfeld , Kengo Kato , Sloan Nietert , Gabriel Rioux