English
Related papers

Related papers: Non-Redundant Spectral Dimensionality Reduction

200 papers

Spectral measures arise in numerous applications such as quantum mechanics, signal processing, resonances, and fluid stability. Similarly, spectral decompositions (pure point, absolutely continuous and singular continuous) often…

Spectral Theory · Mathematics 2021-03-02 Matthew John Colbrook

Overparameterized neural networks often contain many removable neurons, yet what makes a neuron redundant remains poorly understood. Existing pruning criteria commonly rely on local quantities such as weight magnitude, activation strength,…

Machine Learning · Computer Science 2026-05-21 Yongyu Wang

The study of resonances of the Schr\"{o}dinger operator has a long-standing tradition in mathematical physics. Extensive theoretical investigations have explored the proximity of resonances to the real axis, their distribution, and bounds…

Numerical Analysis · Mathematics 2025-04-17 Bo Gong , Takumi Sato , Jiguang Sun , Xinming Wu

Existing methods for spectral reconstruction usually learn a discrete mapping from RGB images to a number of spectral bands. However, this modeling strategy ignores the continuous nature of spectral signature. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2022-09-01 Ruikang Xu , Mingde Yao , Chang Chen , Lizhi Wang , Zhiwei Xiong

Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Sam Buchanan , Jingkai Yan , Ellie Haber , John Wright

With growing investigations into solving partial differential equations by physics-informed neural networks (PINNs), more accurate and efficient PINNs are required to meet the practical demands of scientific computing. One bottleneck of…

Machine Learning · Computer Science 2025-10-29 Tianchi Yu , Yiming Qi , Ivan Oseledets , Shiyi Chen

Deep Convolutional Neural Networks (CNNs) are widely employed in modern computer vision algorithms, where the input image is convolved iteratively by many kernels to extract the knowledge behind it. However, with the depth of convolutional…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Chih-Ting Liu , Yi-Heng Wu , Yu-Sheng Lin , Shao-Yi Chien

Structured light (SL) systems acquire high-fidelity 3D geometry with active illumination projection. Conventional systems exhibit challenges when working in environments with strong ambient illumination, global illumination and cross-device…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zhanghao Sun , Yu Zhang , Yicheng Wu , Dong Huo , Yiming Qian , Jian Wang

Dimension reduction algorithms are a crucial part of many data science pipelines, including data exploration, feature creation and selection, and denoising. Despite their wide utilization, many non-linear dimension reduction algorithms are…

Machine Learning · Statistics 2024-08-06 Ryan Murray , Adam Pickarski

Hyperspectral unmixing (HU) plays a fundamental role in a wide range of hyperspectral applications. It is still challenging due to the common presence of outlier channels and the large solution space. To address the above two issues, we…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Feiyun Zhu , Ying Wang , Bin Fan , Gaofeng Meng , Chunhong Pan

Recurrent neural network (RNN)'s architecture is a key factor influencing its performance. We propose algorithms to optimize hidden sizes under running time constraint. We convert the discrete optimization into a subset selection problem.…

Machine Learning · Statistics 2018-02-22 Junqi Jin , Ziang Yan , Kun Fu , Nan Jiang , Changshui Zhang

We propose a novel framework for learning a low-dimensional representation of data based on nonlinear dynamical systems, which we call dynamical dimension reduction (DDR). In the DDR model, each point is evolved via a nonlinear flow towards…

Machine Learning · Statistics 2022-04-19 Ryeongkyung Yoon , Braxton Osting

The joint optimization of the reconstruction and classification error is a hard non convex problem, especially when a non linear mapping is utilized. In order to overcome this obstacle, a novel optimization strategy is proposed, in which a…

Machine Learning · Computer Science 2022-11-07 Ioannis A. Nellas , Sotiris K. Tasoulis , Vassilis P. Plagianakos , Spiros V. Georgakopoulos

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

This work addresses models (e.g. potential models of directed orbital systems- the manganates) in which an effective reduction dimensionality occurs as a result of a new symmetry which is intermediate between that of global and local gauge…

Statistical Mechanics · Physics 2007-05-23 Zohar Nussinov

In recent years, manifold methods have moved into focus as tools for dimension reduction. Assuming that the high-dimensional data actually lie on or close to a low-dimensional nonlinear manifold, these methods have shown convincing results…

Machine Learning · Statistics 2020-12-23 Moritz Herrmann , Fabian Scheipl

Modeling and control of high-dimensional, nonlinear robotic systems remains a challenging task. While various model- and learning-based approaches have been proposed to address these challenges, they broadly lack generalizability to…

Robotics · Computer Science 2022-09-21 John Irvin Alora , Mattia Cenedese , Edward Schmerling , George Haller , Marco Pavone

The remarkable successes of neural networks in a huge variety of inverse problems have fueled their adoption in disciplines ranging from medical imaging to seismic analysis over the past decade. However, the high dimensionality of such…

Machine Learning · Statistics 2023-10-11 Santhosh Karnik , Rongrong Wang , Mark Iwen

High-dimensional images, or images with a high-dimensional attribute vector per pixel, are commonly explored with coordinated views of a low-dimensional embedding of the attribute space and a conventional image representation. Nowadays,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Alexander Vieth , Boudewijn Lelieveldt , Elmar Eisemann , Anna Vilanova , Thomas Höllt

We focus on a specific use case in anomaly detection where the distribution of normal samples is supported by a lower-dimensional manifold. Here, regularized autoencoders provide a popular approach by learning the identity mapping on the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Alexander Bauer , Shinichi Nakajima , Klaus-Robert Müller