English
Related papers

Related papers: Consistent Representation Learning for High Dimens…

200 papers

Convolutional neural networks typically consist of many convolutional layers followed by one or more fully connected layers. While convolutional layers map between high-order activation tensors, the fully connected layers operate on…

Machine Learning · Computer Science 2020-07-22 Jean Kossaifi , Zachary C. Lipton , Arinbjorn Kolbeinsson , Aran Khanna , Tommaso Furlanello , Anima Anandkumar

Counterfactual inference for continuous rather than binary treatment variables is more common in real-world causal inference tasks. While there are already some sample reweighting methods based on Marginal Structural Model for eliminating…

Machine Learning · Computer Science 2024-07-15 Yonghe Zhao , Qiang Huang , Haolong Zeng , Yun Pen , Huiyan Sun

Contrastive learning has been proven beneficial for self-supervised skeleton-based action recognition. Most contrastive learning methods utilize carefully designed augmentations to generate different movement patterns of skeletons for the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jiahang Zhang , Lilang Lin , Jiaying Liu

This paper presents SimCLR: a simple framework for contrastive learning of visual representations. We simplify recently proposed contrastive self-supervised learning algorithms without requiring specialized architectures or a memory bank.…

Machine Learning · Computer Science 2020-07-02 Ting Chen , Simon Kornblith , Mohammad Norouzi , Geoffrey Hinton

Cross-modal retrieval (CMR) typically involves learning common representations to directly measure similarities between multimodal samples. Most existing CMR methods commonly assume multimodal samples in pairs and employ joint training to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Ruitao Pu , Yang Qin , Dezhong Peng , Xiaomin Song , Huiming Zheng

Graph representation learning (GRL) has emerged as a powerful technique for solving graph analytics tasks. It can effectively convert discrete graph data into a low-dimensional space where the graph structural information and graph…

Social and Information Networks · Computer Science 2023-09-21 Chunyu Miao , Chenxuan Xie , Jiajun Zhou , Shanqing Yu , Lina Chen , Qi Xuan

Residual learning has recently surfaced as an effective means of constructing very deep neural networks for object recognition. However, current incarnations of residual networks do not allow for the modeling and integration of complex…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Brendan Jou , Shih-Fu Chang

Cross-resolution face recognition (CRFR), which is important in intelligent surveillance and biometric forensics, refers to the problem of matching a low-resolution (LR) probe face image against high-resolution (HR) gallery face images.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Guangwei Gao , Yi Yu , Jian Yang , Guo-Jun Qi , Meng Yang

A novel data representation method of convolutional neural net- work (CNN) is proposed in this paper to represent data of different modalities. We learn a CNN model for the data of each modality to map the data of differ- ent modalities to…

Machine Learning · Computer Science 2016-11-22 Yanbin Wu , Li Wang , Fan Cui , Hongbin Zhai , Baoming Dong , Jim Jing-Yan Wang

Deep neural networks have exhibited remarkable performance in image super-resolution (SR) tasks by learning a mapping from low-resolution (LR) images to high-resolution (HR) images. However, the SR problem is typically an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yong Guo , Mingkui Tan , Zeshuai Deng , Jingdong Wang , Qi Chen , Jiezhang Cao , Yanwu Xu , Jian Chen

Nonlinear dimension reduction (NLDR) techniques such as tSNE, and UMAP provide a low-dimensional representation of high-dimensional data ($p\text{-}D$) by applying a nonlinear transformation. NLDR often exaggerates random patterns. But NLDR…

Place recognition is one of the most challenging problems in computer vision, and has become a key part in mobile robotics and autonomous driving applications for performing loop closure in visual SLAM systems. Moreover, the difficulty of…

Computer Vision and Pattern Recognition · Computer Science 2015-05-28 Ruben Gomez-Ojeda , Manuel Lopez-Antequera , Nicolai Petkov , Javier Gonzalez-Jimenez

Graphs model complex relationships between entities, with nodes and edges capturing intricate connections. Node representation learning involves transforming nodes into low-dimensional embeddings. These embeddings are typically used as…

Machine Learning · Computer Science 2024-11-04 Ying-Chun Lin , Jennifer Neville

Recently, Convolutional Neural Networks (CNNs) have shown promising performance in super-resolution (SR). However, these methods operate primarily on Low Resolution (LR) inputs for memory efficiency but this limits, as we demonstrate, their…

Computer Vision and Pattern Recognition · Computer Science 2019-05-17 Muneeb Aadil , Rafia Rahim , Sibt ul Hussain

We explore two primary classes of approaches to dimensionality reduction (DR): Independent Dimensionality Reduction (IDR) and Simultaneous Dimensionality Reduction (SDR). In IDR methods, of which Principal Components Analysis is a…

Machine Learning · Statistics 2024-10-28 Eslam Abdelaleem , Ahmed Roman , K. Michael Martini , Ilya Nemenman

Common Representation Learning (CRL), wherein different descriptions (or views) of the data are embedded in a common subspace, is receiving a lot of attention recently. Two popular paradigms here are Canonical Correlation Analysis (CCA)…

Computation and Language · Computer Science 2015-10-13 Sarath Chandar , Mitesh M. Khapra , Hugo Larochelle , Balaraman Ravindran

Contrastive learning (CL) aims to learn useful representation without relying on expert annotations in the context of medical image segmentation. Existing approaches mainly contrast a single positive vector (i.e., an augmentation of the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Chenyu You , Ruihan Zhao , Lawrence Staib , James S. Duncan

Nonlinear dimensionality reduction (NLDR) algorithms such as Isomap, LLE and Laplacian Eigenmaps address the problem of representing high-dimensional nonlinear data in terms of low-dimensional coordinates which represent the intrinsic…

Algebraic Topology · Mathematics 2009-06-12 Vin de Silva , Mikael Vejdemo-Johansson

In this paper we propose a strategy for semi-supervised image classification that leverages unsupervised representation learning and co-training. The strategy, that is called CURL from Co-trained Unsupervised Representation Learning,…

Machine Learning · Computer Science 2015-09-14 Simone Bianco , Gianluigi Ciocca , Claudio Cusano

Representation learning aims to extract meaningful lower-dimensional embeddings from data, known as representations. Despite its widespread application, there is no established definition of a ``good'' representation. Typically, the…

Machine Learning · Computer Science 2024-12-05 Mahalakshmi Sabanayagam , Omar Al-Dabooni , Pascal Esser