English
Related papers

Related papers: Multi-view Sparse Laplacian Eigenmaps for nonlinea…

200 papers

Motivated by the hypothesis that neural network representations encode abstract, interpretable features as linearly accessible, approximately orthogonal directions, sparse autoencoders (SAEs) have become a popular tool in interpretability.…

Machine Learning · Computer Science 2025-11-05 Valérie Costa , Thomas Fel , Ekdeep Singh Lubana , Bahareh Tolooshams , Demba Ba

Multi-view learning can cover all features of data samples more comprehensively, so multi-view learning has attracted widespread attention. Traditional subspace clustering methods, such as sparse subspace clustering (SSC) and low-ranking…

Machine Learning · Computer Science 2022-01-04 Jian-wei Liu , Hao-jie Xie , Run-kun Lu , Xiong-lin Luo

Analysis of single-cell transcriptomics often relies on clustering cells and then performing differential gene expression (DGE) to identify genes that vary between these clusters. These discrete analyses successfully determine cell types…

Quantitative Methods · Quantitative Biology 2022-10-07 Renee S. Hoekzema , Lewis Marsh , Otto Sumray , Thomas M. Carroll , Xin Lu , Helen M. Byrne , Heather A. Harrington

Recent advances in autonomous driving (AD) have highlighted the potential of hyperspectral imaging (HSI) for enhanced environmental perception, particularly in challenging weather and lighting conditions. However, efficiently processing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Imad Ali Shah , Jiarong Li , Tim Brophy , Martin Glavin , Edward Jones , Enda Ward , Brian Deegan

Learning Mahanalobis distance metrics in a high- dimensional feature space is very difficult especially when structural sparsity and low rank are enforced to improve com- putational efficiency in testing phase. This paper addresses both…

Computer Vision and Pattern Recognition · Computer Science 2012-12-27 Chang Huang , Shenghuo Zhu , Kai Yu

High-dimensional imbalanced data poses a machine learning challenge. In the absence of sufficient or high-quality labels, unsupervised feature selection methods are crucial for the success of subsequent algorithms. Therefore, we introduce a…

Machine Learning · Computer Science 2024-02-05 Guy Hay , Ohad Volk

In recent years, multi-view subspace learning has been garnering increasing attention. It aims to capture the inner relationships of the data that are collected from multiple sources by learning a unified representation. In this way,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Shizhen Chang , Michael Kopp , Pedram Ghamisi

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

Methodology · Statistics 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

Sparse Autoencoders (SAEs) have recently gained attention as a means to improve the interpretability and steerability of Large Language Models (LLMs), both of which are essential for AI safety. In this work, we extend the application of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Mateusz Pach , Shyamgopal Karthik , Quentin Bouniot , Serge Belongie , Zeynep Akata

In this paper, we present a new image segmentation method based on the concept of sparse subset selection. Starting with an over-segmentation, we adopt local spectral histogram features to encode the visual information of the small segments…

Computer Vision and Pattern Recognition · Computer Science 2018-04-10 Fariba Zohrizadeh , Mohsen Kheirandishfard , Farhad Kamangar

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Fangfang Wang , Lingli Yang , Ruiqi Liu

Modern datasets often contain large subsets of correlated features and nuisance features, which are not or loosely related to the main underlying structures of the data. Nuisance features can be identified using the Laplacian score…

Machine Learning · Statistics 2021-10-12 Uri Shaham , Ofir Lindenbaum , Jonathan Svirsky , Yuval Kluger

We introduce a novel nonlinear model, Sparse Adaptive Bottleneck Centroid-Encoder (SABCE), for determining the features that discriminate between two or more classes. The algorithm aims to extract discriminatory features in groups while…

Machine Learning · Computer Science 2023-06-12 Tomojit Ghosh , Michael Kirby

Typical LiDAR SLAM architectures feature a front-end for odometry estimation and a back-end for refining and optimizing the trajectory and map, commonly through loop closures. However, loop closure detection in large-scale missions presents…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Nikolaos Stathoulopoulos , Christoforos Kanellakis , George Nikolakopoulos

Feature-based visual simultaneous localization and mapping (SLAM) methods only estimate the depth of extracted features, generating a sparse depth map. To solve this sparsity problem, depth completion tasks that estimate a dense depth from…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Jinwoo Jeon , Hyunjun Lim , Dong-Uk Seo , Hyun Myung

Multi-view high-dimensional data become increasingly popular in the big data era. Feature selection is a useful technique for alleviating the curse of dimensionality in multi-view learning. In this paper, we study unsupervised feature…

Machine Learning · Computer Science 2017-05-03 Xiaokai Wei , Bokai Cao , Philip S. Yu

Accurate and stable feature matching is critical for computer vision tasks, particularly in applications such as Simultaneous Localization and Mapping (SLAM). While recent learning-based feature matching methods have demonstrated promising…

Robotics · Computer Science 2025-04-08 Yuqing Wang , Yan Wang , Hailiang Tang , Xiaoji Niu

We develop new stochastic gradient methods for efficiently solving sparse linear regression in a partial attribute observation setting, where learners are only allowed to observe a fixed number of actively chosen attributes per example at…

Optimization and Control · Mathematics 2018-12-04 Tomoya Murata , Taiji Suzuki

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

Methodology · Statistics 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

Sharpness-aware minimization (SAM) seeks the minima with a flat loss landscape to improve the generalization performance in machine learning tasks, including fine-tuning. However, its extra parameter perturbation step doubles the…

Machine Learning · Computer Science 2026-02-11 Yifei Cheng , Xianglin Yang , Guoxia Wang , Chao Huang , Fei Ma , Dianhai Yu , Xiaochun Cao , Li Shen