English
Related papers

Related papers: The Effects of Spectral Dimensionality Reduction o…

200 papers

Recently neural network based approaches to knowledge-intensive NLP tasks, such as question answering, started to rely heavily on the combination of neural retrievers and readers. Retrieval is typically performed over a large textual…

Information Retrieval · Computer Science 2022-04-20 Vilém Zouhar , Marius Mosbach , Miaoran Zhang , Dietrich Klakow

As a widely used method in machine learning, principal component analysis (PCA) shows excellent properties for dimensionality reduction. It is a serious problem that PCA is sensitive to outliers, which has been improved by numerous Robust…

Machine Learning · Computer Science 2020-11-24 Shenglan Liu , Yang Yu

Dense retrievers encode queries and documents and map them in an embedding space using pre-trained language models. These embeddings need to be high-dimensional to fit training signals and guarantee the retrieval effectiveness of dense…

Information Retrieval · Computer Science 2022-10-25 Zhenghao Liu , Han Zhang , Chenyan Xiong , Zhiyuan Liu , Yu Gu , Xiaohua Li

Dimensionality reduction is an important operation in information visualization, feature extraction, clustering, regression, and classification, especially for processing noisy high dimensional data. However, most existing approaches…

Machine Learning · Computer Science 2020-03-26 Zhenhua Shi , Dongrui Wu , Jian Huang , Yu-Kai Wang , Chin-Teng Lin

Recent studies try to use hyperspectral imaging (HSI) to detect foreign matters in products because it enables to visualize the invisible wavelengths including ultraviolet and infrared. Considering the enormous image channels of the HSI,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Dongeon Kim , YeongHyeon Park

Weak gravitational lensing is a promising probe of dark matter and dark energy requiring accurate measurement of the shapes of faint, distant galaxies. Such measures are hindered by the finite resolution and pixel scale of typical cameras.…

Astrophysics · Physics 2009-11-13 F. William High , Jason Rhodes , Richard Massey , Richard Ellis

Dimensionality reduction is a critical preprocessing step for clustering high-dimensional data, yet comprehensive evaluation of its impact across diverse methods and data types remains limited. In this study, we systematically assess the…

Machine Learning · Computer Science 2026-05-13 Ousmane Assani-Amate , Mohammadreza Bakhtyari , Émilie Roy , Vladimir Makarenkov

Deep Neural Networks (DNNs) have recently been achieving state-of-the-art performance on a variety of computer vision related tasks. However, their computational cost limits their ability to be implemented in embedded systems with…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Laurent Dillard , Yosuke Shinya , Taiji Suzuki

Random Projection (RP) technique has been widely applied in many scenarios because it can reduce high-dimensional features into low-dimensional space within short time and meet the need of real-time analysis of massive data. There is an…

Machine Learning · Computer Science 2017-06-20 Haozhe Xie , Jie Li , Qiaosheng Zhang , Yadong Wang

Learned image compression (LIC) methods have experienced significant progress during recent years. However, these methods are primarily dedicated to optimizing the rate-distortion (R-D) performance at medium and high bitrates (> 0.1 bits…

Computer Vision and Pattern Recognition · Computer Science 2023-06-28 Anqi Li , Feng Li , Jiaxin Han , Huihui Bai , Runmin Cong , Chunjie Zhang , Meng Wang , Weisi Lin , Yao Zhao

The most effective dimensionality reduction procedures produce interpretable features from the raw input space while also providing good performance for downstream supervised learning tasks. For many methods, this requires optimizing one or…

Machine Learning · Computer Science 2023-02-22 Leland Barnard , Farwa Ali , Hugo Botha , David T. Jones

Principal component analysis (PCA) is widely used for feature extraction and dimensionality reduction, with documented merits in diverse tasks involving high-dimensional data. Standard PCA copes with one dataset at a time, but it is…

Machine Learning · Computer Science 2019-01-30 Jia Chen , Gang Wang , Georgios B. Giannakis

In this paper we tackle the problem of stereo image compression, and leverage the fact that the two images have overlapping fields of view to further compress the representations. Our approach leverages state-of-the-art single-image…

Image and Video Processing · Electrical Eng. & Systems 2019-08-13 Jerry Liu , Shenlong Wang , Raquel Urtasun

Dimension-reduction techniques can greatly improve statistical inference in astronomy. A standard approach is to use Principal Components Analysis (PCA). In this work we apply a recently-developed technique, diffusion maps, to astronomical…

Astrophysics · Physics 2011-02-11 Joseph W. Richards , Peter E. Freeman , Ann B. Lee , Chad M. Schafer

This is a tutorial and survey paper on various methods for Sufficient Dimension Reduction (SDR). We cover these methods with both statistical high-dimensional regression perspective and machine learning approach for dimensionality…

Methodology · Statistics 2021-10-20 Benyamin Ghojogh , Ali Ghodsi , Fakhri Karray , Mark Crowley

Principal component analysis (PCA) is a classical method for dimensionality reduction based on extracting the dominant eigenvectors of the sample covariance matrix. However, PCA is well known to behave poorly in the ``large $p$, small $n$''…

Statistics Theory · Mathematics 2009-08-26 Arash A. Amini , Martin J. Wainwright

High-resolution stellar spectra offer valuable insights into atmospheric parameters and chemical compositions. However, their inherent complexity and high-dimensionality present challenges in fully utilizing the information they contain. In…

Instrumentation and Methods for Astrophysics · Physics 2024-09-20 Qianyu Fan

Domain adaptation aims to reduce the model degradation on the target domain caused by the domain shift between the source and target domains. Although encouraging performance has been achieved by combining cognitive learning with the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Xiaoke Hao , Shiyu Liu , Chuanbo Feng , Ye Zhu

This thesis proposes spatio-spectral techniques for hyperspectral image analysis. Adaptive spatio-spectral support and variable exposure hyperspectral imaging is demonstrated to improve spectral reflectance recovery from hyperspectral…

Computer Vision and Pattern Recognition · Computer Science 2014-07-30 Zohaib Khan

In our "big data" age, the size and complexity of data is steadily increasing. Methods for dimension reduction are ever more popular and useful. Two distinct types of dimension reduction are "data-oblivious" methods such as random…

Statistics Theory · Mathematics 2021-03-30 Fan Yang , Sifan Liu , Edgar Dobriban , David P. Woodruff