English
Related papers

Related papers: Bridging linearity-based and kernel-based sufficie…

200 papers

For some years there has been uncertainty over whether regularisation by dimensional reduction (DRED) is viable for non-supersymmetric theories. We resolve this issue by showing that DRED is entirely equivalent to standard dimensional…

High Energy Physics - Phenomenology · Physics 2009-10-28 I. Jack , D. R. T. Jones , K. L. Roberts

In many clinical trials, individuals in different subgroups have experience differential treatment effects. This leads to individualized differences in treatment benefit. In this article, we introduce the general concept of predictive…

Methodology · Statistics 2018-07-11 Debashis Ghosh , Youngjoo Cho

Supervised dimensionality reduction has emerged as an important theme in the last decade. Despite the plethora of models and formulations, there is a lack of a simple model which aims to project the set of patterns into a space defined by…

Machine Learning · Statistics 2016-10-28 Anthony O. Smith , Anand Rangarajan

We study the asymptotic behavior of a class of methods for sufficient dimension reduction in high-dimension regressions, as the sample size and number of predictors grow in various alignments. It is demonstrated that these methods are…

Statistics Theory · Mathematics 2012-05-31 R. Dennis Cook , Liliana Forzani , Adam J. Rothman

State-of-the-art neural networks can be trained to become remarkable solutions to many problems. But while these architectures can express symbolic, perfect solutions, trained models often arrive at approximations instead. We show that the…

Machine Learning · Computer Science 2025-09-09 Matan Abudy , Orr Well , Emmanuel Chemla , Roni Katzir , Nur Lan

We present neural mixture distributional regression (NMDR), a holistic framework to estimate complex finite mixtures of distributional regressions defined by flexible additive predictors. Our framework is able to handle a large number of…

Computation · Statistics 2020-10-15 David Rügamer , Florian Pfisterer , Bernd Bischl

The real-life data have a complex and non-linear structure due to their nature. These non-linearities and the large number of features can usually cause problems such as the empty-space phenomenon and the well-known curse of dimensionality.…

Machine Learning · Computer Science 2025-03-13 Kadir Özçoban , Murat Manguoğlu , Emrullah Fatih Yetkin

We propose a method for the approximation of high- or even infinite-dimensional feature vectors, which play an important role in supervised learning. The goal is to reduce the size of the training data, resulting in lower storage…

Machine Learning · Statistics 2021-04-06 Patrick Gelß , Stefan Klus , Ingmar Schuster , Christof Schütte

The principal support vector machines method (Li et al., 2011) is a powerful tool for sufficient dimension reduction that replaces original predictors with their low-dimensional linear combinations without loss of information. However, the…

Machine Learning · Statistics 2019-12-02 Jun Jin , Chao Ying , Zhou Yu

Most data sets comprise of measurements on continuous and categorical variables. In regression and classification Statistics literature, modeling high-dimensional mixed predictors has received limited attention. In this paper we study the…

Statistics Theory · Mathematics 2021-10-26 Efstathia Bura , Liliana Forzani , Rodrigo García Arancibia , Pamela Llop , Diego Tomassi

Low-dimensional embeddings for data from disparate sources play critical roles in multi-modal machine learning, multimedia information retrieval, and bioinformatics. In this paper, we propose a supervised dimensionality reduction method…

Machine Learning · Computer Science 2021-01-15 Yanjun Li , Bihan Wen , Hao Cheng , Yoram Bresler

We consider the application of regularization by dimensional reduction to NLO corrections of hadronic processes. The general collinear singularity structure is discussed, the origin of the regularization-scheme dependence is identified and…

High Energy Physics - Phenomenology · Physics 2009-02-02 Adrian Signer , Dominik Stöckinger

We introduce a unified, flexible, and easy-to-implement framework of sufficient dimension reduction that can accommodate both linear and nonlinear dimension reduction, and both the conditional distribution and the conditional mean as the…

Machine Learning · Statistics 2025-06-23 Yin Tang , Bing Li

It is clear that conventional statistical inference protocols need to be revised to deal correctly with the high-dimensional data that are now common. Most recent studies aimed at achieving this revision rely on powerful approximation…

Statistics Theory · Mathematics 2021-05-05 Alexander Mozeika , Mansoor Sheikh , Fabian Aguirre-Lopez , Fabrizio Antenucci , Anthony CC Coolen

Dimensionality reduction is a crucial technique in data analysis, as it allows for the efficient visualization and understanding of high-dimensional datasets. The circular coordinate is one of the topological data analysis techniques…

Algebraic Topology · Mathematics 2023-01-31 Taejin Paik , Jaemin Park

This paper is devoted to dimensional reductions via the norm resolvent convergence. We derive explicit bounds on the resolvent difference as well as spectral asymptotics. The efficiency of our abstract tool is demonstrated by its…

Mathematical Physics · Physics 2018-11-26 David Krejcirik , Nicolas Raymond , Julien Royer , Petr Siegl

Merging the two cultures of deep and statistical learning provides insights into structured high-dimensional data. Traditional statistical modeling is still a dominant strategy for structured tabular data. Deep learning can be viewed…

Methodology · Statistics 2021-10-25 Anindya Bhadra , Jyotishka Datta , Nick Polson , Vadim Sokolov , Jianeng Xu

Dimensionality reduction is a fundamental task in modern data science. Several projection methods specifically tailored to take into account the non-linearity of the data via local embeddings have been proposed. Such methods are often based…

Machine Learning · Statistics 2026-01-28 Antonio Di Noia , Federico Ravenda , Antonietta Mira

We propose a novel and computationally efficient approach for nonparametric conditional density estimation in high-dimensional settings that achieves dimension reduction without imposing restrictive distributional or functional form…

Econometrics · Economics 2025-10-14 Jianhua Mei , Fu Ouyang , Thomas T. Yang

Dimension reduction is a common strategy to study non-linear dynamical systems composed by a large number of variables. The goal is to find a smaller version of the system whose time evolution is easier to predict while preserving some of…

Dynamical Systems · Mathematics 2022-06-23 Marina Vegué , Vincent Thibeault , Patrick Desrosiers , Antoine Allard