English
Related papers

Related papers: Visual Pre-Training on Unlabeled Images using Rein…

200 papers

Recently, vision model pre-training has evolved from relying on manually annotated datasets to leveraging large-scale, web-crawled image-text data. Despite these advances, there is no pre-training method that effectively exploits the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Chenyu Yang , Xizhou Zhu , Jinguo Zhu , Weijie Su , Junjie Wang , Xuan Dong , Wenhai Wang , Lewei Lu , Bin Li , Jie Zhou , Yu Qiao , Jifeng Dai

The success of Reinforcement Learning (RL) heavily relies on the ability to learn robust representations from the observations of the environment. In most cases, the representations learned purely by the reinforcement learning loss can…

Machine Learning · Computer Science 2024-02-12 Somjit Nath , Rushiv Arora , Samira Ebrahimi Kahou

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals and learn the goal-conditioned policy. However, this procedure…

Machine Learning · Computer Science 2021-10-27 Jinxin Liu , Hao Shen , Donglin Wang , Yachen Kang , Qiangxing Tian

This paper presents CLIP-RLDrive, a new reinforcement learning (RL)-based framework for improving the decision-making of autonomous vehicles (AVs) in complex urban driving scenarios, particularly in unsignalized intersections. To achieve…

Robotics · Computer Science 2024-12-24 Erfan Doroudian , Hamid Taghavifar

Reward design is of great importance for solving complex tasks with reinforcement learning. Recent studies have explored using image-text similarity produced by vision-language models (VLMs) to augment rewards of a task with visual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

We study unsupervised video representation learning that seeks to learn both motion and appearance features from unlabeled video only, which can be reused for downstream tasks such as action recognition. This task, however, is extremely…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Peihao Chen , Deng Huang , Dongliang He , Xiang Long , Runhao Zeng , Shilei Wen , Mingkui Tan , Chuang Gan

Pre-trained vision-language models learn massive data to model unified representations of images and natural languages, which can be widely applied to downstream machine learning tasks. In addition to zero-shot inference, in order to better…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Qian-Wei Wang , Yuqiu Xie , Letian Zhang , Zimo Liu , Shu-Tao Xia

Existing methods for extracting reward signals in Reinforcement Learning typically rely on labeled data and dedicated training splits, a setup that contrasts with how humans learn directly from their environment. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-12-05 Akshit Singh , Shyam Marjit , Wei Lin , Paul Gavrikov , Serena Yeung-Levy , Hilde Kuehne , Rogerio Feris , Sivan Doveh , James Glass , M. Jehanzeb Mirza

Vision-Language Models (VLMs) often struggle with tasks that require fine-grained image understanding, such as scene-text recognition or document analysis, due to perception limitations and visual fragmentation. To address these challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Miguel Carvalho , Helder Dias , Bruno Martins

Active learning aims to alleviate the amount of labor involved in data labeling by automating the selection of unlabeled samples via an acquisition function. For example, variational adversarial active learning (VAAL) leverages an…

Machine Learning · Computer Science 2024-08-26 Zongyao Lyu , William J. Beksi

Predicting the relevance between two given videos with respect to their visual content is a key component for content-based video recommendation and retrieval. Thanks to the increasing availability of pre-trained image and video…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Jianfeng Dong , Xun Wang , Leimin Zhang , Chaoxi Xu , Gang Yang , Xirong Li

The recent history of machine learning research has taught us that machine learning methods can be most effective when they are provided with very large, high-capacity models, and trained on very large and diverse datasets. This has spurred…

Machine Learning · Computer Science 2021-10-26 Sergey Levine

Annotating a large number of training images is very time-consuming. In this background, this paper focuses on learning from easy-to-acquire web data and utilizes the learned model for fine-grained image classification in labeled datasets.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-24 Xiaoxiao Sun , Liang Zheng , Yu-Kun Lai , Jufeng Yang

Class-incremental learning requires a learning system to continually learn knowledge of new classes and meanwhile try to preserve previously learned knowledge of old classes. As current state-of-the-art methods based on Vision-Language…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jiantao Tan , Peixian Ma , Tong Yu , Wentao Zhang , Ruixuan Wang

Contrastive learning has recently shown immense potential in unsupervised visual representation learning. Existing studies in this track mainly focus on intra-image invariance learning. The learning typically uses rich intra-image…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Jiahao Xie , Xiaohang Zhan , Ziwei Liu , Yew Soon Ong , Chen Change Loy

In recent years self-supervised learning has emerged as a promising candidate for unsupervised representation learning. In the visual domain its applications are mostly studied in the context of images of natural scenes. However, its…

Computer Vision and Pattern Recognition · Computer Science 2021-06-04 Vladan Stojnić , Vladimir Risojević

A reliable reward function is essential for reinforcement learning (RL) in image generation. Most current RL approaches depend on pre-trained preference models that output scalar rewards to approximate human preferences. However, these…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Weijia Mao , Hao Chen , Zhenheng Yang , Mike Zheng Shou

We investigate the effects of the unsupervised pre-training method under the perspective of information theory. If the input distribution displays multiple views of the supervision, then unsupervised pre-training allows to learn…

Machine Learning · Computer Science 2019-05-31 Nicolas Pinchaud

To address semi-supervised learning from both labeled and unlabeled data, we present a novel meta-learning scheme. We particularly consider that labeled and unlabeled data share disjoint ground truth label sets, which can be seen tasks like…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Yun-Chun Chen , Chao-Te Chou , Yu-Chiang Frank Wang