English
Related papers

Related papers: An Experimental Study of Dimension Reduction Metho…

200 papers

Unsupervised domain adaptation (UDA) aims to improve the prediction performance in the target domain under distribution shifts from the source domain. The key principle of UDA is to minimize the divergence between the source and the target…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 JoonHo Lee , Gyemin Lee

Dimensionality reduction is often used as an initial step in data exploration, either as preprocessing for classification or regression or for visualization. Most dimensionality reduction techniques to date are unsupervised; they do not…

Machine Learning · Statistics 2020-06-17 Jake S. Rhodes , Adele Cutler , Guy Wolf , Kevin R. Moon

Dynamical systems on networks are inherently high-dimensional unless the number of nodes is extremely small. Dimension reduction methods for dynamical systems on networks aim to find a substantially lower-dimensional system that preserves…

Dynamical Systems · Mathematics 2025-03-24 Bisna Mary Eldo , Sarbendu Rakshit , Naoki Masuda

Networks of interconnected agents are essential to study complex networked systems' state evolution, stability, resilience, and control. Nevertheless, the high dimensionality and nonlinear dynamics are vital factors preventing us from…

Physics and Society · Physics 2023-08-24 Cheng Ma , Gyorgy Korniss , Boleslaw K. Szymanski , Jianxi Gao

Finding the similarities and differences between groups of datasets is a fundamental analysis task. For high-dimensional data, dimensionality reduction (DR) methods are often used to find the characteristics of each group. However, existing…

Machine Learning · Computer Science 2021-10-28 Takanori Fujiwara , Xinhai Wei , Jian Zhao , Kwan-Liu Ma

The aim of this paper is to give an overview of the recent advancements in the Unsupervised Domain Adaptation (UDA) of deep networks for semantic segmentation. This task is attracting a wide interest, since semantic segmentation models…

Computer Vision and Pattern Recognition · Computer Science 2020-05-25 Marco Toldo , Andrea Maracani , Umberto Michieli , Pietro Zanuttigh

Text documents are complex high dimensional objects. To effectively visualize such data it is important to reduce its dimensionality and visualize the low dimensional embedding as a 2-D or 3-D scatter plot. In this paper we explore…

Computation and Language · Computer Science 2010-03-03 Yi Mao , Krishnakumar Balasubramanian , Guy Lebanon

We introduce a new framework for dimension reduction in the context of high-dimensional regression. Our proposal is to aggregate an ensemble of random projections, which have been carefully chosen based on the empirical regression…

Methodology · Statistics 2024-10-08 Wenxing Zhou , Timothy I. Cannings

The statistical problem of estimating the effective dimension-reduction (EDR) subspace in the multi-index regression model with deterministic design and additive noise is considered. A new procedure for recovering the directions of the EDR…

Statistics Theory · Mathematics 2007-06-13 Arnak Dalalyan , Anatoly Juditsky , Vladimir Spokoiny

Deep learning techniques have been widely used in autonomous driving systems for the semantic understanding of urban scenes. However, they need a huge amount of labeled data for training, which is difficult and expensive to acquire. A…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Umberto Michieli , Matteo Biasetton , Gianluca Agresti , Pietro Zanuttigh

Dimensionality reduction is used as an important tool for unraveling the complexities of high-dimensional datasets in many fields of science, such as cell biology, chemical informatics, and physics. Visualizations of the dimensionally…

Human-Computer Interaction · Computer Science 2025-07-16 Dylan Cashman , Mark Keller , Hyeon Jeon , Bum Chul Kwon , Qianwen Wang

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

In this paper, we consider regression models with a Hilbert-space-valued predictor and a scalar response, where the response depends on the predictor only through a finite number of projections. The linear subspace spanned by these…

Statistics Theory · Mathematics 2010-11-12 Yehua Li , Tailen Hsing

Adversarial examples, or nearly indistinguishable inputs created by an attacker, significantly reduce machine learning accuracy. Theoretical evidence has shown that the high intrinsic dimensionality of datasets facilitates an adversary's…

Machine Learning · Computer Science 2021-12-13 Sheila Alemany , Niki Pissinou

Word embeddings have become the basic building blocks for several natural language processing and information retrieval tasks. Pre-trained word embeddings are used in several downstream applications as well as for constructing…

Computation and Language · Computer Science 2017-11-22 Vikas Raunak

We introduce an unsupervised domain adaption (UDA) strategy that combines multiple image translations, ensemble learning and self-supervised learning in one coherent approach. We focus on one of the standard tasks of UDA in which a semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-07-14 Fabrizio J. Piva , Gijs Dubbelman

High-dimensional multimodal data arises in many scientific fields. The integration of multimodal data becomes challenging when there is no known correspondence between the samples and the features of different datasets. To tackle this…

Quantitative Methods · Quantitative Biology 2023-04-11 Kathryn Dover , Zixuan Cang , Anna Ma , Qing Nie , Roman Vershynin

In this paper, the existing Scheduling Dimension Reduction (SDR) methods for Linear Parameter-Varying (LPV) models are reviewed and a Deep Neural Network (DNN) approach is developed that achieves higher model accuracy under scheduling…

Systems and Control · Electrical Eng. & Systems 2020-12-10 P. J. W. Koelewijn , R. Tóth

Deep neural networks (DNNs) have proven their capabilities in many areas in the past years, such as robotics, or automated driving, enabling technological breakthroughs. DNNs play a significant role in environment perception for the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-25 Manuel Schwonberg , Joshua Niemeijer , Jan-Aike Termöhlen , Jörg P. Schäfer , Nico M. Schmidt , Hanno Gottschalk , Tim Fingscheidt

Structured pruning and quantization are fundamental techniques used to reduce the size of deep neural networks (DNNs) and typically are applied independently. Applying these techniques jointly via co-optimization has the potential to…

Machine Learning · Computer Science 2025-02-25 Xiaoyi Qu , David Aponte , Colby Banbury , Daniel P. Robinson , Tianyu Ding , Kazuhito Koishida , Ilya Zharkov , Tianyi Chen