English
Related papers

Related papers: Unified Framework for Spectral Dimensionality Redu…

200 papers

This paper proposes a novel kernel approach to linear dimension reduction for supervised learning. The purpose of the dimension reduction is to find directions in the input space to explain the output as effectively as possible. The…

Machine Learning · Statistics 2011-09-05 Kenji Fukumizu , Chenlei Leng

Multi-manifold modeling is increasingly used in segmentation and data representation tasks in computer vision and related fields. While the general problem, modeling data by mixtures of manifolds, is very challenging, several approaches…

Computer Vision and Pattern Recognition · Computer Science 2012-10-08 G. Chen , S. Atev , G. Lerman

We introduce Constr-DRKM, a deep kernel method for the unsupervised learning of disentangled data representations. We propose augmenting the original deep restricted kernel machine formulation for kernel PCA by orthogonality constraints on…

Machine Learning · Computer Science 2020-12-01 Francesco Tonin , Panagiotis Patrinos , Johan A. K. Suykens

Deep neural networks trained through end-to-end learning have achieved remarkable success across various domains in the past decade. However, the end-to-end learning strategy, originally designed to minimize predictive loss in a black-box…

Machine Learning · Computer Science 2025-06-11 Canlin Zhang , Xiuwen Liu

While the capabilities of generative foundational models have advanced rapidly in recent years, methods to prevent harmful and unsafe behaviors remain underdeveloped. Among the pressing challenges in AI safety, machine unlearning (MU) has…

Machine Learning · Computer Science 2025-02-12 Marcin Sendera , Łukasz Struski , Kamil Książek , Kryspin Musiol , Jacek Tabor , Dawid Rymarczyk

Spectral unmixing (SU) expresses the mixed pixels existed in hyperspectral images as the product of endmember and abundance, which has been widely used in hyperspectral imagery analysis. However, the influence of light, acquisition…

Image and Video Processing · Electrical Eng. & Systems 2022-06-27 Ge Zhang , Shaohui Mei , Mingyang Ma , Yan Feng , Qian Du

Data dimension reduction (DDR) is all about mapping data from high dimensions to low dimensions, various techniques of DDR are being used for image dimension reduction like Random Projections, Principal Component Analysis (PCA), the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Wisal Khan , Muhammad Turab , Waqas Ahmad , Syed Hasnat Ahmad , Kelash Kumar , Bin Luo

The accuracy and complexity of machine learning algorithms based on kernel optimization are determined by the set of kernels over which they are able to optimize. An ideal set of kernels should: admit a linear parameterization (for…

Machine Learning · Statistics 2024-10-30 Aleksandr Talitckii , Brendon K. Colbert , Matthew M. Peet

We present Spectral Inference Networks, a framework for learning eigenfunctions of linear operators by stochastic optimization. Spectral Inference Networks generalize Slow Feature Analysis to generic symmetric operators, and are closely…

Machine Learning · Computer Science 2020-01-17 David Pfau , Stig Petersen , Ashish Agarwal , David G. T. Barrett , Kimberly L. Stachenfeld

Kernel method is a very powerful tool in machine learning. The trick of kernel has been effectively and extensively applied in many areas of machine learning, such as support vector machine (SVM) and kernel principal component analysis…

Networking and Internet Architecture · Computer Science 2011-05-17 Shujie Hou , Robert C. Qiu

A particularly interesting instance of supervised learning with kernels is when each training example is associated with two objects, as in pairwise classification (Brunner et al., 2012), and in supervised learning of preference relations…

Machine Learning · Computer Science 2016-10-31 Giorgio Gnecco

Spectral embedding based on the Singular Value Decomposition (SVD) is a widely used "preprocessing" step in many learning tasks, typically leading to dimensionality reduction by projecting onto a number of dominant singular vectors and…

Machine Learning · Statistics 2015-09-29 Dinesh Ramasamy , Upamanyu Madhow

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

Multimodal image fusion (MMIF) integrates information from different modalities to obtain a comprehensive image, aiding downstream tasks. However, existing research focuses on complementary information fusion and training strategies,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Dan He , Guofen Wang , Weisheng Li , Yucheng Shu , Wenbo Li , Lijian Yang , Yuping Huang , Feiyan Li

Computational spectral imaging is drawing increasing attention owing to the snapshot advantage, and amplitude, phase, and wavelength encoding systems are three types of representative implementations. Fairly comparing and understanding the…

Image and Video Processing · Electrical Eng. & Systems 2023-12-22 Xinyuan Liu , Lizhi Wang , Lingen Li , Chang Chen , Xue Hu , Fenglong Song , Youliang Yan

Machine Unlearning (MU) aims to remove the information of specific training data from a trained model, ensuring compliance with privacy regulations and user requests. While one line of existing MU methods relies on linear parameter updates…

Artificial Intelligence · Computer Science 2026-05-13 Yingdan Shi , Ren Wang

The reconstruction of a high resolution image given a low resolution observation is an ill-posed inverse problem in imaging. Deep learning methods rely on training data to learn an end-to-end mapping from a low-resolution input to a…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Iman Marivani , Evaggelia Tsiligianni , Bruno Cornelis , Nikos Deligiannis

A semidefinite program (SDP) is a particular kind of convex optimization problem with applications in operations research, combinatorial optimization, quantum information science, and beyond. In this work, we propose variational quantum…

Quantum Physics · Physics 2024-06-19 Dhrumil Patel , Patrick J. Coles , Mark M. Wilde

Unsupervised dimensionality reduction is one of the commonly used techniques in the field of high dimensional data recognition problems. The deep autoencoder network which constrains the weights to be non-negative, can learn a low…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Anyong Qin , Zhaowei Shang , Zhuolin Tan , Taiping Zhang , Yuan Yan Tang

The objective of this paper is self-supervised learning of video object segmentation. We develop a unified framework which simultaneously models cross-frame dense correspondence for locally discriminative feature learning and embeds…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Liulei Li , Wenguan Wang , Tianfei Zhou , Jianwu Li , Yi Yang