English
Related papers

Related papers: cardinalR: Generating Interesting High-Dimensional…

200 papers

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

We introduce a data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves…

Optimization and Control · Mathematics 2016-04-04 Jake Bouvrie , Boumediene Hamzi

Clustering aims to group unlabelled samples based on their similarities. It has become a significant tool for the analysis of high-dimensional data. However, most of the clustering methods merely generate pseudo labels and thus are unable…

Artificial Intelligence · Computer Science 2023-06-21 Tianyi Huang , Shenghui Cheng , Stan Z. Li , Zhengjun Zhang

Recent years have seen rapid progress at the intersection between causality and machine learning. Motivated by scientific applications involving high-dimensional data, in particular in biomedicine, we propose a deep neural architecture for…

Machine Learning · Computer Science 2022-12-12 Kai Lagemann , Christian Lagemann , Bernd Taschler , Sach Mukherjee

Classical dimensional analysis has two limitations: (i) the computed dimensionless groups are not unique, and (ii) the analysis does not measure relative importance of the dimensionless groups. We propose two algorithms for estimating…

Numerical Analysis · Mathematics 2017-08-16 Paul G. Constantine , Zachary del Rosario , Gianluca Iaccarino

'Big' high-dimensional data are commonly analyzed in low-dimensions, after performing a dimensionality-reduction step that inherently distorts the data structure. For the same purpose, clustering methods are also often used. These methods…

Machine Learning · Statistics 2019-02-20 Tom Lorimer , Karlis Kanders , Ruedi Stoop

Astronomical data generally consists of 2 or more high-resolution axes, e.g., X,Y position on the sky or wavelength and position-along-one-axis (long-slit spectrometer). Analyzing these multi-dimension observations requires combining 3D…

Instrumentation and Methods for Astrophysics · Physics 2009-02-11 Daniel Dewey , Michael S. Noble

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

Machine Learning · Statistics 2016-03-22 John P. Cunningham , Zoubin Ghahramani

Factor analysis is a widely used statistical tool in many scientific disciplines, such as psychology, economics, and sociology. As observations linked by networks become increasingly common, incorporating network structures into factor…

Methodology · Statistics 2024-03-27 Jinming Li , Gongjun Xu , Ji Zhu

Factor modeling is an essential tool for exploring intrinsic dependence structures among high-dimensional random variables. Much progress has been made for estimating the covariance matrix from a high-dimensional factor model. However, the…

Statistics Theory · Mathematics 2016-10-26 Quefeng Li , Guang Cheng , Jianqing Fan , Yuyan Wang

This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence…

Methodology · Statistics 2023-01-26 T. Tony Cai , Zijian Guo , Yin Xia

Generative deep learning methods built upon Convolutional Neural Networks (CNNs) provide a great tool for predicting non-linear structure in cosmology. In this work we predict high resolution dark matter halos from large scale, low…

Cosmology and Nongalactic Astrophysics · Physics 2022-04-25 David Schaurecker , Yin Li , Jeremy Tinker , Shirley Ho , Alexandre Refregier

The lack of freely available (real-life or synthetic) high or ultra-high dimensional, multi-class datasets may hamper the rapidly growing research on feature screening, especially in the field of biometrics, where the usage of such datasets…

Dimensionality reduction represents the process of generating a low dimensional representation of high dimensional data. Motivated by the formation control of mobile agents, we propose a nonlinear dynamical system for dimensionality…

Machine Learning · Computer Science 2025-01-17 Taeuk Jeong , Yoon Mo Jung , Euntack Lee

High-dimensional distributed semantic spaces have proven useful and effective for aggregating and processing visual, auditory, and lexical information for many tasks related to human-generated data. Human language makes use of a large and…

Computation and Language · Computer Science 2021-04-02 Jussi Karlgren , Pentti Kanerva

We present new findings in regard to data analysis in very high dimensional spaces. We use dimensionalities up to around one million. A particular benefit of Correspondence Analysis is its suitability for carrying out an orthonormal…

Machine Learning · Statistics 2015-12-15 Fionn Murtagh

The generation of synthetic data is an essential tool to study complex systems, allowing for example to test models of these in precisely controlled settings, or to parametrize simulation models when data is missing. This paper focuses on…

Applications · Statistics 2019-11-25 Juste Raimbault

We introduce a dimension reduction method for visualizing the clustering structure obtained from a finite mixture of Gaussian densities. Information on the dimension reduction subspace is obtained from the variation on group means and,…

Methodology · Statistics 2015-08-10 Luca Scrucca

Latent factor models that integrate data from multiple sources/studies or modalities have garnered considerable attention across various disciplines. However, existing methods predominantly focus either on multi-study integration or…

Methodology · Statistics 2025-07-15 Wei Liu , Qingzhi Zhong

It is time to renew old ways of thinking about dimensional analysis. Specifically, more than $n-r$ invariants and more than one functional relation between invariants need to be considered simultaneously. Thus generalized, dimensional…

History and Overview · Mathematics 2014-11-12 Dan Jonsson