English
Related papers

Related papers: Sufficient Dimensionality Reduction with Irrelevan…

200 papers

Feature reduction is an important concept which is used for reducing dimensions to decrease the computation complexity and time of classification. Since now many approaches have been proposed for solving this problem, but almost all of them…

Artificial Intelligence · Computer Science 2012-06-08 Shervan Fekri Ershad , Sattar Hashemi

Deriving insights from high-dimensional data is one of the core problems in data mining. The difficulty mainly stems from the fact that there are exponentially many variable combinations to potentially consider, and there are infinitely…

Machine Learning · Statistics 2021-11-08 Jefrey Lijffijt , Bo Kang , Wouter Duivesteijn , Kai Puolamäki , Emilia Oikarinen , Tijl De Bie

Dimensionality reduction (DR) of image features plays an important role in image retrieval and classification tasks. Recently, two types of methods have been proposed to improve the both the accuracy and efficiency for the dimensionality…

Computer Vision and Pattern Recognition · Computer Science 2013-04-10 Yao Nan , Qian Feng , Sun Zuolei

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

The monitoring and management of high-volume feature-rich traffic in large networks offers significant challenges in storage, transmission and computational costs. The predominant approach to reducing these costs is based on performing a…

Machine Learning · Computer Science 2016-06-16 Tingshan Huang , Harish Sethu , Nagarajan Kandasamy

In unsupervised learning, dimensionality reduction is an important tool for data exploration and visualization. Because these aims are typically open-ended, it can be useful to frame the problem as looking for patterns that are enriched in…

Machine Learning · Statistics 2018-11-16 Kristen Severson , Soumya Ghosh , Kenney Ng

Linear dimensionality reduction methods are a cornerstone of analyzing high dimensional data, due to their simple geometric interpretations and typically attractive computational properties. These methods capture many data features of…

Machine Learning · Statistics 2016-03-22 John P. Cunningham , Zoubin Ghahramani

Many machine learning applications such as in vision, biology and social networking deal with data in high dimensions. Feature selection is typically employed to select a subset of features which im- proves generalization accuracy as well…

Machine Learning · Computer Science 2016-06-15 Yamuna Prasad , Dinesh Khandelwal , K. K. Biswas

In hyperspectral remote sensing data mining, it is important to take into account of both spectral and spatial information, such as the spectral signature, texture feature and morphological property, to improve the performances, e.g., the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Lefei Zhang , Qian Zhang , Bo Du , Xin Huang , Yuan Yan Tang , Dacheng Tao

Unsupervised dimension selection is an important problem that seeks to reduce dimensionality of data, while preserving the most useful characteristics. While dimensionality reduction is commonly utilized to construct low-dimensional…

Machine Learning · Statistics 2018-11-01 Jayaraman J. Thiagarajan , Rushil Anirudh , Rahul Sridhar , Peer-Timo Bremer

Data are not only ubiquitous in society, but are increasingly complex both in size and dimensionality. Dimension reduction offers researchers and scholars the ability to make such complex, high dimensional data spaces simpler and more…

Machine Learning · Computer Science 2021-03-15 Philip D. Waggoner

Large high-dimensional datasets are becoming more and more popular in an increasing number of research areas. Processing the high dimensional data incurs a high computational cost and is inherently inefficient since many of the values that…

Computer Vision and Pattern Recognition · Computer Science 2013-05-01 Alon Schclar

Data generated in the fields of science, technology, business and in many other fields of research are increasing in an exponential rate. The way to extract knowledge from a huge set of data is a challenging task. This paper aims to propose…

Information Retrieval · Computer Science 2010-03-23 P. G. JansiRani , R. Bhaskaran

The world is moving towards clean and renewable energy sources, such as wind energy, in an attempt to reduce greenhouse gas emissions that contribute to global warming. To enhance the analysis and storage of wind data, we introduce a deep…

Machine Learning · Computer Science 2024-11-07 Alif Bin Abdul Qayyum , Xihaier Luo , Nathan M. Urban , Xiaoning Qian , Byung-Jun Yoon

In our work, we propose a novel formulation for supervised dimensionality reduction based on a nonlinear dependency criterion called Statistical Distance Correlation, Szekely et. al. (2007). We propose an objective which is free of…

Machine Learning · Computer Science 2016-01-05 Praneeth Vepakomma , Chetan Tonde , Ahmed Elgammal

In this study, we propose a new statical approach for high-dimensionality reduction of heterogenous data that limits the curse of dimensionality and deals with missing values. To handle these latter, we propose to use the Random Forest…

Machine Learning · Computer Science 2017-07-04 Rania Mkhinini Gahar , Olfa Arfaoui , Minyar Sassi Hidri , Nejib Ben-Hadj Alouane

Dimensionality reduction is a common method for analyzing and visualizing high-dimensional data. However, reasoning dynamically about the results of a dimensionality reduction is difficult. Dimensionality-reduction algorithms use complex…

Human-Computer Interaction · Computer Science 2018-11-30 Marco Cavallo , Çağatay Demiralp

This paper introduces a new unsupervised method for dimensionality reduction via regression (DRR). The algorithm belongs to the family of invertible transforms that generalize Principal Component Analysis (PCA) by using curvilinear instead…

Machine Learning · Statistics 2016-02-02 Valero Laparra , Jesus Malo , Gustau Camps-Valls

Few-shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent…

Selecting the optimal resolution for discretizing high-dimensional data is a central problem in physics and data analysis, particularly in unsupervised settings where the underlying distribution is unknown. The Relevance-Resolution…

Statistical Mechanics · Physics 2026-03-06 Margherita Mele , Daniel Campos Moreno , Raffaello Potestio