English
Related papers

Related papers: TLDR: Twin Learning for Dimensionality Reduction

200 papers

Recurrent neural networks (RNNs) have proved effective at one dimensional sequence learning tasks, such as speech and online handwriting recognition. Some of the properties that make RNNs suitable for such tasks, for example robustness to…

Artificial Intelligence · Computer Science 2007-05-23 Alex Graves , Santiago Fernandez , Juergen Schmidhuber

Deep Metric Learning (DML) methods have been proven relevant for visual similarity learning. However, they sometimes lack generalization properties because they are trained often using an inappropriate sample selection strategy or due to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Jorge Gonzalez-Zapata , Ivan Reyes-Amezcua , Daniel Flores-Araiza , Mauricio Mendez-Ruiz , Gilberto Ochoa-Ruiz , Andres Mendez-Vazquez

Recent advances on unsupervised domain adaptation (UDA) rely on adversarial learning to disentangle the explanatory and transferable features for domain adaptation. However, there are two issues with the existing methods. First, the…

Machine Learning · Computer Science 2020-07-20 Yuan Wu , Diana Inkpen , Ahmed El-Roby

This review addresses the problem of learning abstract representations of the measurement data in the context of Deep Reinforcement Learning (DRL). While the data are often ambiguous, high-dimensional, and complex to interpret, many…

Machine Learning · Computer Science 2024-05-31 Nicolò Botteghi , Mannes Poel , Christoph Brune

This paper explores the extension of dimension reduction (DR) techniques to the multi-dimension case by using the Einstein product. Our focus lies on graph-based methods, encompassing both linear and nonlinear approaches, within both…

Numerical Analysis · Mathematics 2025-11-25 Alaeddine Zahir , Khalide Jbilou , Ahmed Ratnani

Training of deep models for classification tasks is hindered by local minima problems and vanishing gradients, while unsupervised layer-wise pretraining does not exploit information from class labels. Here, we propose a new regularization…

Machine Learning · Computer Science 2019-11-07 Pavel Sulimov , Elena Sukmanova , Roman Chereshnev , Attila Kertesz-Farkas

Dimension reduction (DR) is commonly utilized to capture the intrinsic structure and transform high-dimensional data into low-dimensional space while retaining meaningful properties of the original data. It is used in various applications,…

Machine Learning · Computer Science 2022-11-29 Zelin Zang , Shenghui Cheng , Linyan Lu , Hanchen Xia , Liangyu Li , Yaoting Sun , Yongjie Xu , Lei Shang , Baigui Sun , Stan Z. Li

Representation multi-task learning (MTL) has achieved tremendous success in practice. However, the theoretical understanding of these methods is still lacking. Most existing theoretical works focus on cases where all tasks share the same…

Machine Learning · Statistics 2025-07-08 Ye Tian , Yuqi Gu , Yang Feng

Deep learning (DL) has emerged as a tool for improving accelerated MRI reconstruction. A common strategy among DL methods is the physics-based approach, where a regularized iterative algorithm alternating between data consistency and a…

Image and Video Processing · Electrical Eng. & Systems 2020-07-03 Burhaneddin Yaman , Seyed Amir Hossein Hosseini , Steen Moeller , Jutta Ellermann , Kâmil Uǧurbil , Mehmet Akçakaya

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone

This paper proposes a supervised dimension reduction methodology for tensor data which has two advantages over most image-based prognostic models. First, the model does not require tensor data to be complete which expands its application to…

Machine Learning · Computer Science 2023-06-06 Chengyu Zhou , Xiaolei Fang

Most popular dimension reduction (DR) methods like t-SNE and UMAP are based on minimizing a cost between input and latent pairwise similarities. Though widely used, these approaches lack clear probabilistic foundations to enable a full…

Probability · Mathematics 2023-10-06 Hugues Van Assel , Thibault Espinasse , Julien Chiquet , Franck Picard

Deep learning is emerging as a new paradigm for solving inverse imaging problems. However, the deep learning methods often lack the assurance of traditional physics-based methods due to the lack of physical information considerations in…

Image and Video Processing · Electrical Eng. & Systems 2020-07-20 Dongdong Chen , Mike E. Davies

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Yunsheng Li , Lu Yuan , Nuno Vasconcelos

Embedding high-dimensional data onto a low-dimensional manifold is of both theoretical and practical value. In this paper, we propose to combine deep neural networks (DNN) with mathematics-guided embedding rules for high-dimensional data…

Machine Learning · Computer Science 2022-08-19 Zixia Zhou , Xinrui Zu , Yuanyuan Wang , Boudewijn P. F. Lelieveldt , Qian Tao

Deep learning has been widely used for solving image reconstruction tasks but its deployability has been held back due to the shortage of high-quality training data. Unsupervised learning methods, such as the deep image prior (DIP),…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Riccardo Barbano , Javier Antorán , Johannes Leuschner , José Miguel Hernández-Lobato , Bangti Jin , Željko Kereta

In this paper, we present a Mirroring Neural Network architecture to perform non-linear dimensionality reduction and Object Recognition using a reduced lowdimensional characteristic vector. In addition to dimensionality reduction, the…

Computer Vision and Pattern Recognition · Computer Science 2008-12-13 Dasika Ratna Deepthi , Sujeet Kuchibhotla , K. Eswaran

Classifying large-scale image data into object categories is an important problem that has received increasing research attention. Given the huge amount of data, non-parametric approaches such as nearest neighbor classifiers have shown…

Computer Vision and Pattern Recognition · Computer Science 2014-04-28 Zhaowen Wang , Jianchao Yang , Zhe Lin , Jonathan Brandt , Shiyu Chang , Thomas Huang

Despite significant advances in deep learning, models often struggle to generalize well to new, unseen domains, especially when training data is limited. To address this challenge, we propose a novel approach for distribution-aware latent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Ran Liu , Sahil Khose , Jingyun Xiao , Lakshmi Sathidevi , Keerthan Ramnath , Zsolt Kira , Eva L. Dyer

We introduce a method for fast estimation of data-adapted, spatio-temporally dependent regularization parameter-maps for variational image reconstruction, focusing on total variation (TV)-minimization. Our approach is inspired by recent…