English
Related papers

Related papers: Pre-trained Visual Dynamics Representations for Ef…

200 papers

While pre-trained visual representations have significantly advanced imitation learning, they are often task-agnostic as they remain frozen during policy learning. In this work, we explore leveraging pre-trained text-to-image diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Heeseong Shin , Byeongho Heo , Dongyoon Han , Seungryong Kim , Taekyung Kim

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

Reinforcement learning (RL)-based motion imitation methods trained on demonstration data can effectively learn natural and expressive motions with minimal reward engineering but often struggle to generalize to novel environments. We address…

Robotics · Computer Science 2025-09-01 Zewei Zhang , Chenhao Li , Takahiro Miki , Marco Hutter

Reinforcement Learning (RL)-based control system has received considerable attention in recent decades. However, in many real-world problems, such as Batch Process Control, the environment is uncertain, which requires expensive interaction…

Machine Learning · Computer Science 2022-11-03 Peng Zhang , Yawen Huang , Bingzhang Hu , Shizheng Wang , Haoran Duan , Noura Al Moubayed , Yefeng Zheng , Yang Long

Vision-based robotic policies often struggle with even minor viewpoint changes, underscoring the need for view-invariant visual representations. This challenge becomes more pronounced in real-world settings, where viewpoint variability is…

Robotics · Computer Science 2026-01-07 Youngjoon Jeong , Junha Chun , Taesup Kim

Deep reinforcement learning (DRL) has achieved groundbreaking successes in a wide variety of robotic applications. A natural consequence is the adoption of this paradigm for safety-critical tasks, where human safety and expensive hardware…

Robotics · Computer Science 2022-06-22 Davide Corsi , Raz Yerushalmi , Guy Amir , Alessandro Farinelli , David Harel , Guy Katz

Good temporal representations are crucial for video understanding, and the state-of-the-art video recognition framework is based on two-stream networks. In such framework, besides the regular ConvNets responsible for RGB frame inputs, a…

Computer Vision and Pattern Recognition · Computer Science 2018-05-22 Wanjia Liu , Huaijin Chen , Rishab Goel , Yuzhong Huang , Ashok Veeraraghavan , Ankit Patel

Video Variational Autoencoder (VAE) enables latent video generative modeling by mapping the visual world into compact spatiotemporal latent spaces, improving training efficiency and stability. While existing video VAEs achieve commendable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Yian Zhao , Feng Wang , Qiushan Guo , Chang Liu , Xiangyang Ji , Jian Zhang , Jie Chen

Reinforcement learning has demonstrated significant potential in the field of autonomous driving. However, it suffers from defects such as training instability and unsafe action outputs when faced with autonomous racing environments…

Robotics · Computer Science 2026-03-09 Bo Leng , Weiqi Zhang , Zhuoren Li , Lu Xiong , Guizhe Jin , Ran Yu , Chen Lv

We study joint video and language (VL) pre-training to enable cross-modality learning and benefit plentiful downstream VL tasks. Existing works either extract low-quality video features or learn limited text embedding, while neglecting that…

Computer Vision and Pattern Recognition · Computer Science 2022-07-11 Hongwei Xue , Tiankai Hang , Yanhong Zeng , Yuchong Sun , Bei Liu , Huan Yang , Jianlong Fu , Baining Guo

Reward function specification, which requires considerable human effort and iteration, remains a major impediment for learning behaviors through deep reinforcement learning. In contrast, providing visual demonstrations of desired behaviors…

Machine Learning · Computer Science 2022-06-29 Rafael Rafailov , Tianhe Yu , Aravind Rajeswaran , Chelsea Finn

In principle, meta-reinforcement learning algorithms leverage experience across many tasks to learn fast reinforcement learning (RL) strategies that transfer to similar tasks. However, current meta-RL approaches rely on manually-defined…

Artificial Intelligence · Computer Science 2019-12-10 Allan Jabri , Kyle Hsu , Ben Eysenbach , Abhishek Gupta , Sergey Levine , Chelsea Finn

Recent work has shown that augmenting environments with language descriptions improves policy learning. However, for environments with complex language abstractions, learning how to ground language to observations is difficult due to…

Machine Learning · Computer Science 2022-10-04 Victor Zhong , Jesse Mu , Luke Zettlemoyer , Edward Grefenstette , Tim Rocktäschel

The correlation between the vision and text is essential for video moment retrieval (VMR), however, existing methods heavily rely on separate pre-training feature extractors for visual and textual understanding. Without sufficient temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Dezhao Luo , Jiabo Huang , Shaogang Gong , Hailin Jin , Yang Liu

Visual and linguistic pre-training aims to learn vision and language representations together, which can be transferred to visual-linguistic downstream tasks. However, there exists semantic confusion between language and vision during the…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shentong Mo , Jingfei Xia , Ihor Markevych

Unlike quasi-static robotic manipulation tasks like pick-and-place, dynamic tasks such as non-prehensile manipulation pose greater challenges, especially for vision-based control. Successful control requires the extraction of features…

Developing robust vision-guided controllers for quadrupedal robots in complex environments, with various obstacles, dynamical surroundings and uneven terrains, is very challenging. While Reinforcement Learning (RL) provides a promising…

The pre-trained image-text models, like CLIP, have demonstrated the strong power of vision-language representation learned from a large scale of web-collected image-text data. In light of the well-learned visual features, some existing…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Hongwei Xue , Yuchong Sun , Bei Liu , Jianlong Fu , Ruihua Song , Houqiang Li , Jiebo Luo

Despite the recent success of deep reinforcement learning (RL), domain adaptation remains an open problem. Although the generalization ability of RL agents is critical for the real-world applicability of Deep RL, zero-shot policy transfer…

Machine Learning · Computer Science 2021-09-06 Jinwei Xing , Takashi Nagata , Kexin Chen , Xinyun Zou , Emre Neftci , Jeffrey L. Krichmar

This work concerns video-language pre-training and representation learning. In this now ubiquitous training scheme, a model first performs pre-training on paired videos and text (e.g., video clips and accompanied subtitles) from a large…

Computer Vision and Pattern Recognition · Computer Science 2021-04-14 Luowei Zhou , Jingjing Liu , Yu Cheng , Zhe Gan , Lei Zhang