English
Related papers

Related papers: GenURL: A General Framework for Unsupervised Repre…

200 papers

Dimensionality reduction (DR) plays a vital role in the visual analysis of high-dimensional data. One main aim of DR is to reveal hidden patterns that lie on intrinsic low-dimensional manifolds. However, DR often overlooks important…

Machine Learning · Computer Science 2023-02-28 Takanori Fujiwara , Yun-Hsin Kuo , Anders Ynnerman , Kwan-Liu Ma

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

Machine Learning · Computer Science 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

Deep models trained in supervised mode have achieved remarkable success on a variety of tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a new paradigm for making use of large amounts of unlabeled…

Machine Learning · Computer Science 2022-04-26 Yaochen Xie , Zhao Xu , Jingtun Zhang , Zhengyang Wang , Shuiwang Ji

Designing generalizable agents capable of adapting to diverse embodiments has achieved significant attention in Reinforcement Learning (RL), which is critical for deploying RL agents in various real-world applications. Previous…

Machine Learning · Computer Science 2025-05-20 Chengyang Ying , Zhongkai Hao , Xinning Zhou , Xuezhou Xu , Hang Su , Xingxing Zhang , Jun Zhu

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

Deep Reinforcement Learning (RL) has emerged as a powerful paradigm to solve a range of complex yet specific control tasks. Yet training generalist agents that can quickly adapt to new tasks remains an outstanding challenge. Recent advances…

Machine Learning · Computer Science 2021-10-29 Michael Laskin , Denis Yarats , Hao Liu , Kimin Lee , Albert Zhan , Kevin Lu , Catherine Cang , Lerrel Pinto , Pieter Abbeel

Low-rank tensor representation (LRTR) has emerged as a powerful tool for multi-dimensional data processing. However, classical LRTR-based methods face two critical limitations: (1) they typically assume that the holistic data is low-rank,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-21 Zhizhou Wang , Jianli Wang , Ruijing Zheng , Zhenyu Wu

Recent work has proven that training large language models with self-supervised tasks and fine-tuning these models to complete new tasks in a transfer learning setting is a powerful idea, enabling the creation of models with many…

Machine Learning · Computer Science 2024-11-25 Matthew Spellings , Maya Martirossyan , Julia Dshemuchadse

This paper describes an effective and efficient image classification framework nominated distributed deep representation learning model (DDRL). The aim is to strike the balance between the computational intensive deep learning approaches…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Le Dong , Na Lv , Qianni Zhang , Shanshan Xie , Ling He , Mengdie Mao

Kernel-based subspace clustering, which addresses the nonlinear structures in data, is an evolving area of research. Despite noteworthy progressions, prevailing methodologies predominantly grapple with limitations relating to (i) the…

Machine Learning · Computer Science 2025-01-22 Kunpeng Xu , Lifei Chen , Shengrui Wang

Meta-learning for algorithm selection relies on a meta-dataset in which each row corresponds to a supervised learning dataset described by meta-features and labelled with a target value that is associated with algorithm choice (typically,…

Machine Learning · Computer Science 2026-05-12 Darren Zhu , Daren Ler

Deep Learning (DL) aims at learning the \emph{meaningful representations}. A meaningful representation refers to the one that gives rise to significant performance improvement of associated Machine Learning (ML) tasks by replacing the raw…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Large amounts of labeled data are typically required to train deep learning models. For many real-world problems, however, acquiring additional data can be expensive or even impossible. We present semi-supervised deep kernel learning…

Machine Learning · Computer Science 2019-03-05 Neal Jean , Sang Michael Xie , Stefano Ermon

Inspired by the recent success of self-supervised methods applied on images, self-supervised learning on graph structured data has seen rapid growth especially centered on augmentation-based contrastive methods. However, we argue that…

Machine Learning · Computer Science 2021-12-08 Namkyeong Lee , Junseok Lee , Chanyoung Park

Deep learning has attained remarkable success in many 3D visual recognition tasks, including shape classification, object detection, and semantic segmentation. However, many of these results rely on manually collecting densely annotated…

Computer Vision and Pattern Recognition · Computer Science 2022-12-19 Fernando Julio Cendra , Lan Ma , Jiajun Shen , Xiaojuan Qi

Few-shot classification aims to recognize unseen classes when presented with only a small number of samples. We consider the problem of multi-domain few-shot image classification, where unseen classes and examples come from diverse data…

Machine Learning · Computer Science 2020-09-04 Lu Liu , William Hamilton , Guodong Long , Jing Jiang , Hugo Larochelle

Motivated by interpretability and reliability, we investigate whether large language models (LLMs) deploy universal geometric structures to encode discrete, graph-structured knowledge. To this end, we present two complementary experimental…

Machine Learning · Computer Science 2025-11-25 David D. Baek , Yuxiao Li , Max Tegmark

Point cloud data have been widely explored due to its superior accuracy and robustness under various adverse situations. Meanwhile, deep neural networks (DNNs) have achieved very impressive success in various applications such as…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Aoran Xiao , Jiaxing Huang , Dayan Guan , Xiaoqin Zhang , Shijian Lu , Ling Shao

The goal of domain generalization is to learn from multiple source domains to generalize to unseen target domains under distribution discrepancy. Current state-of-the-art methods in this area are fully supervised, but for many real-world…

Machine Learning · Computer Science 2020-10-01 Hossein Sharifi-Noghabi , Hossein Asghari , Nazanin Mehrasa , Martin Ester

In this paper, we focus on unsupervised representation learning for clustering of images. Recent advances in deep clustering and unsupervised representation learning are based on the idea that different views of an input image (generated…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Aniket Anand Deshmukh , Jayanth Reddy Regatti , Eren Manavoglu , Urun Dogan