English
Related papers

Related papers: Discriminative Dimension Reduction based on Mutual…

200 papers

The problem of finding a reduced dimensionality representation of categorical variables while preserving their most relevant characteristics is fundamental for the analysis of complex data. Specifically, given a co-occurrence matrix of two…

Machine Learning · Computer Science 2012-12-12 Amir Globerson , Gal Chechik , Naftali Tishby

We propose a new randomized optimization method for high-dimensional problems which can be seen as a generalization of coordinate descent to random subspaces. We show that an adaptive sampling strategy for the random subspace significantly…

Optimization and Control · Mathematics 2019-12-19 Jonathan Lacotte , Mert Pilanci , Marco Pavone

Spatial and temporal stream model has gained great success in video action recognition. Most existing works pay more attention to designing effective features fusion methods, which train the two-stream model in a separate way. However, it's…

Computer Vision and Pattern Recognition · Computer Science 2019-08-28 Jingran Zhang , Fumin Shen , Xing Xu , Heng Tao Shen

Clustering and dimensionality reduction have been crucial topics in machine learning and computer vision. Clustering high-dimensional data has been challenging for a long time due to the curse of dimensionality. For that reason, a more…

Machine Learning · Statistics 2026-04-16 Sida Liu , Yangzi Guo , Mingyuan Wang

A variety of real-world tasks involve the classification of images into pre-determined categories. Designing image classification algorithms that exhibit robustness to acquisition noise and image distortions, particularly when the available…

Machine Learning · Statistics 2016-03-10 Umamahesh Srinivas

Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or…

Machine Learning · Computer Science 2025-06-30 Hugues Van Assel , Cédric Vincent-Cuaz , Nicolas Courty , Rémi Flamary , Pascal Frossard , Titouan Vayer

This paper presents a novel clustering concept that is based on jointly learned nonlinear transforms (NTs) with priors on the information loss and the discrimination. We introduce a clustering principle that is based on evaluation of a…

Machine Learning · Computer Science 2019-01-31 Dimche Kostadinov , Behrooz Razeghi , Taras Holotyak , Slava Voloshynovskiy

Deep learning has been widely used for solving image reconstruction tasks but its deployability has been held back due to the shortage of high-quality training data. Unsupervised learning methods, such as the deep image prior (DIP),…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Riccardo Barbano , Javier Antorán , Johannes Leuschner , José Miguel Hernández-Lobato , Bangti Jin , Željko Kereta

In this letter, we formulate a compositional distributed learning framework for multi-view perception by leveraging the maximal coding rate reduction principle combined with subspace basis fusion. In the proposed algorithm, each agent…

Image and Video Processing · Electrical Eng. & Systems 2025-11-13 Zhuojun Tian , Mehdi Bennis

In a typical supervised machine learning setting, the predictions on all test instances are based on a common subset of features discovered during model training. However, using a different subset of features that is most informative for…

Machine Learning · Computer Science 2021-06-10 Yasitha Warahena Liyanage , Daphney-Stavroula Zois , Charalampos Chelmis

In this paper, we present a deep extension of Sparse Subspace Clustering, termed Deep Sparse Subspace Clustering (DSSC). Regularized by the unit sphere distribution assumption for the learned deep features, DSSC can infer a new data…

Computer Vision and Pattern Recognition · Computer Science 2017-09-26 Xi Peng , Jiashi Feng , Shijie Xiao , Jiwen Lu , Zhang Yi , Shuicheng Yan

Identifying a low-dimensional informed parameter subspace offers a viable path to alleviating the dimensionality challenge in the sampled-based solution to large-scale Bayesian inverse problems. This paper introduces a novel gradient-based…

Computation · Statistics 2023-03-07 Tiangang Cui , Olivier Zahm

The curse of dimensionality has remained a challenge for a wide variety of algorithms in data mining, clustering, classification and privacy. Recently, it was shown that an increasing dimensionality makes the data resistant to effective…

Databases · Computer Science 2014-01-07 Hessam Zakerzadeh , Charu C. Aggrawal , Ken Barker

Most existing person re-identification (re-id) methods focus on learning the optimal distance metrics across camera views. Typically a person's appearance is represented using features of thousands of dimensions, whilst only hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2016-03-08 Li Zhang , Tao Xiang , Shaogang Gong

Optimal dimensionality reduction methods are proposed for the Bayesian inference of a Gaussian linear model with additive noise in presence of overabundant data. Three different optimal projections of the observations are proposed based on…

Statistics Theory · Mathematics 2018-02-13 Loïc Giraldi , Olivier P. Le Maître , Ibrahim Hoteit , Omar M. Knio

Information-maximization clustering learns a probabilistic classifier in an unsupervised manner so that mutual information between feature vectors and cluster assignments is maximized. A notable advantage of this approach is that it only…

Machine Learning · Statistics 2011-12-06 Masashi Sugiyama , Makoto Yamada , Manabu Kimura , Hirotaka Hachiya

During the past decades, to study high-dimensional data in a large variety of problems, researchers have proposed many Feature Extraction algorithms. One of the most effective approaches for optimal feature extraction is based on mutual…

Machine Learning · Computer Science 2012-07-17 Ali Shadvar

Few-shot learning is a relatively new technique that specializes in problems where we have little amounts of data. The goal of these methods is to classify categories that have not been seen before with just a handful of samples. Recent…

Feature selection is a critical step in the analysis of high-dimensional data, where the number of features often vastly exceeds the number of samples. Effective feature selection not only improves model performance and interpretability but…

Machine Learning · Computer Science 2025-01-27 Raquel Espinosa , Gracia Sánchez , José Palma , Fernando Jiménez

When pre-processing observational data via matching, we seek to approximate each unit with maximally similar peers that had an alternative treatment status--essentially replicating a randomized block design. However, as one considers a…

Econometrics · Economics 2019-05-30 Gentry Johnson , Brian Quistorff , Matt Goldman