English
Related papers

Related papers: Supervised Quadratic Feature Analysis: Information…

200 papers

Federated learning is a distributed paradigm that allows multiple parties to collaboratively train deep models without exchanging the raw data. However, the data distribution among clients is naturally non-i.i.d., which leads to severe…

Machine Learning · Computer Science 2023-01-31 Tianfei Zhou , Ender Konukoglu

Uncertainty estimation is crucial in safety-critical applications, where robust out-of-distribution (OOD) detection is essential. Traditional Bayesian methods, though effective, are often hindered by high computational demands. As an…

Machine Learning · Computer Science 2024-11-06 Maksim Zhdanov , Stanislav Dereka , Sergey Kolesnikov

To learn distinguishable patterns, most of recent works in vehicle re-identification (ReID) struggled to redevelop official benchmarks to provide various supervisions, which requires prohibitive human labors. In this paper, we seek to…

Computer Vision and Pattern Recognition · Computer Science 2023-01-09 Ming Li , Xinming Huang , Ziming Zhang

The applications of traditional statistical feature selection methods to high-dimension, low sample-size data often struggle and encounter challenging problems, such as overfitting, curse of dimensionality, computational infeasibility, and…

Machine Learning · Statistics 2023-12-19 Kexuan Li , Fangfang Wang , Lingli Yang , Ruiqi Liu

Wasserstein-Fisher-Rao (WFR) distance is a family of metrics to gauge the discrepancy of two Radon measures, which takes into account both transportation and weight change. Spherical WFR distance is a projected version of WFR distance for…

Machine Learning · Computer Science 2022-08-26 Yang Jing , Jiaheng Chen , Lei Li , Jianfeng Lu

We present a novel, domain-agnostic, model-independent, unsupervised, and universally applicable Machine Learning approach for dimensionality reduction based on the principles of algorithmic complexity. Specifically, but without loss of…

Data Structures and Algorithms · Computer Science 2025-05-06 Hector Zenil , Narsis A. Kiani , Alyssa Adams , Felipe S. Abrahão , Antonio Rueda-Toicen , Allan A. Zea , Luan Ozelim , Jesper Tegnér

For numerous reasons there raises a need for dimension reduction that preserves certain characteristics of data. In this work we focus on data coming from a mixture of Gaussian distributions and we propose a method that preserves…

Statistics Theory · Mathematics 2014-07-30 Ewa Nowakowska , Jacek Koronacki , Stan Lipovetsky

Classification is a core topic in functional data analysis. A large number of functional classifiers have been proposed in the literature, most of which are based on functional principal component analysis or functional regression. In…

Methodology · Statistics 2025-10-14 Ruoxu Tan , Yiming Zang

Recent advancements have revealed new links between information geometry and classical stochastic thermodynamics, particularly through the Fisher information (FI) with respect to time. Recognizing the non-uniqueness of the quantum Fisher…

Quantum Physics · Physics 2025-10-07 Laetitia P. Bettmann , John Goold

The application of machine learning to image and video data often yields a high dimensional feature space. Effective feature selection techniques identify a discriminant feature subspace that lowers computational and modeling costs with…

Machine Learning · Computer Science 2022-06-22 Yijing Yang , Wei Wang , Hongyu Fu , C. -C. Jay Kuo

Implicit Neural Representations have gained prominence as a powerful framework for capturing complex data modalities, encompassing a wide range from 3D shapes to images and audio. Within the realm of 3D shape representation, Neural Signed…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Amine Ouasfi , Adnane Boukhayma

Image quality assessment (IQA) aims to estimate human perception based image visual quality. Although existing deep neural networks (DNNs) have shown significant effectiveness for tackling the IQA problem, it still needs to improve the…

Image and Video Processing · Electrical Eng. & Systems 2020-12-04 Wei Zhou , Zhibo Chen

Detection transformers have recently shown promising object detection results and attracted increasing attention. However, how to develop effective domain adaptation techniques to improve its cross-domain performance remains unexplored and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-18 Wen Wang , Yang Cao , Jing Zhang , Fengxiang He , Zheng-Jun Zha , Yonggang Wen , Dacheng Tao

Dimensionality reduction is a classical technique widely used for data analysis. One foundational instantiation is Principal Component Analysis (PCA), which minimizes the average reconstruction error. In this paper, we introduce the…

Discrete Mathematics · Computer Science 2020-06-17 Uthaipon Tantipongpipat , Samira Samadi , Mohit Singh , Jamie Morgenstern , Santosh Vempala

Dimensionality reduction is a crucial step for pattern recognition and data mining tasks to overcome the curse of dimensionality. Principal component analysis (PCA) is a traditional technique for unsupervised dimensionality reduction, which…

Machine Learning · Computer Science 2017-05-04 Zan Gao , Guotai Zhang , Feiping Nie , Hua Zhang

Feature ranking and selection is a widely used approach in various applications of supervised dimensionality reduction in discriminative machine learning. Nevertheless there exists significant evidence on feature ranking and selection…

Machine Learning · Computer Science 2021-05-04 Ozan Ozdenizci , Deniz Erdogmus

We study adaptive data-dependent dimensionality reduction in the context of supervised learning in general metric spaces. Our main statistical contribution is a generalization bound for Lipschitz functions in metric spaces that are…

Machine Learning · Computer Science 2015-03-26 Lee-Ad Gottlieb , Aryeh Kontorovich , Robert Krauthgamer

Feature selection is one of the most fundamental problems in machine learning. An extensive body of work on information-theoretic feature selection exists which is based on maximizing mutual information between subsets of features and class…

Machine Learning · Statistics 2016-06-10 Shuyang Gao , Greg Ver Steeg , Aram Galstyan

Full-reference (FR) image quality assessment (IQA) evaluates the visual quality of a distorted image by measuring its perceptual difference with pristine-quality reference, and has been widely used in low-level vision tasks. Pairwise…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Yue Cao , Zhaolin Wan , Dongwei Ren , Zifei Yan , Wangmeng Zuo

Similarity measures are widely used to interpret the representational geometries used by neural networks to solve tasks. Yet, because existing methods compare the extrinsic geometry of representations in state space, rather than their…

Machine Learning · Computer Science 2026-04-03 N Alex Cayco-Gajic , Arthur Pellegrino