English
Related papers

Related papers: What Makes Pre-Trained Visual Representations Succ…

200 papers

Procedural video representation learning is an active research area where the objective is to learn an agent which can anticipate and forecast the future given the present video input, typically in conjunction with textual annotations.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-07 Han Lin , Tushar Nagarajan , Nicolas Ballas , Mido Assran , Mojtaba Komeili , Mohit Bansal , Koustuv Sinha

A generalist robot equipped with learned skills must be able to perform many tasks in many different environments. However, zero-shot generalization to new settings is not always possible. When the robot encounters a new environment or…

Robotics · Computer Science 2021-06-15 Alexander Khazatsky , Ashvin Nair , Daniel Jing , Sergey Levine

How much does having visual priors about the world (e.g. the fact that the world is 3D) assist in learning to perform downstream motor tasks (e.g. navigating a complex environment)? What are the consequences of not utilizing such visual…

Computer Vision and Pattern Recognition · Computer Science 2019-12-25 Alexander Sax , Jeffrey O. Zhang , Bradley Emi , Amir Zamir , Silvio Savarese , Leonidas Guibas , Jitendra Malik

Motivated by the intuitive understanding humans have about the space of possible interactions, and the ease with which they can generalize this understanding to previously unseen scenes, we develop an approach for learning visual…

Robotics · Computer Science 2023-05-30 Homanga Bharadhwaj , Abhinav Gupta , Shubham Tulsiani

Our understanding of the world depends highly on our capacity to produce intuitive and simplified representations which can be easily used to solve problems. We reproduce this simplification process using a neural network to build a low…

Artificial Intelligence · Computer Science 2019-01-30 Timothée Lesort , Mathieu Seurin , Xinrui Li , Natalia Díaz-Rodríguez , David Filliat

While pre-trained visual representations have significantly advanced imitation learning, they are often task-agnostic as they remain frozen during policy learning. In this work, we explore leveraging pre-trained text-to-image diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Heeseong Shin , Byeongho Heo , Dongyoon Han , Seungryong Kim , Taekyung Kim

Learning visuomotor policies in simulation is much safer and cheaper than in the real world. However, due to discrepancies between the simulated and real data, simulator-trained policies often fail when transferred to real robots. One…

Robotics · Computer Science 2023-07-31 Ricardo Garcia , Robin Strudel , Shizhe Chen , Etienne Arlaud , Ivan Laptev , Cordelia Schmid

Building generalist robot policies that can handle diverse tasks in open-ended environments is a central challenge in robotics. To leverage knowledge from large-scale pretraining, prior work (VLA) has typically built generalist policies…

Robotics · Computer Science 2026-05-14 Jianke Zhang , Yucheng Hu , Yanjiang Guo , Xiaoyu Chen , Yichen Liu , Wenna Chen , Chaochao Lu , Jianyu Chen

Generative pre-trained models have demonstrated remarkable effectiveness in language and vision domains by learning useful representations. In this paper, we extend the scope of this effectiveness by showing that visual robot manipulation…

Robotics · Computer Science 2023-12-22 Hongtao Wu , Ya Jing , Chilam Cheang , Guangzeng Chen , Jiafeng Xu , Xinghang Li , Minghuan Liu , Hang Li , Tao Kong

Robotic grasping presents a difficult motor task in real-world scenarios, constituting a major hurdle to the deployment of capable robots across various industries. Notably, the scarcity of data makes grasping particularly challenging for…

Robotics · Computer Science 2024-06-18 Abhi Kamboj , Katherine Driggs-Campbell

Vision-language-action (VLA) models finetuned from vision-language models (VLMs) hold the promise of leveraging rich pretrained representations to build generalist robots across diverse tasks and environments. However, direct fine-tuning on…

Robotics · Computer Science 2025-09-18 Shresth Grover , Akshay Gopalkrishnan , Bo Ai , Henrik I. Christensen , Hao Su , Xuanlin Li

One of the great promises of robot learning systems is that they will be able to learn from their mistakes and continuously adapt to ever-changing environments. Despite this potential, most of the robot learning systems today are deployed…

Machine Learning · Computer Science 2020-08-03 Ryan Julian , Benjamin Swanson , Gaurav S. Sukhatme , Sergey Levine , Chelsea Finn , Karol Hausman

Perceptual understanding of the scene and the relationship between its different components is important for successful completion of robotic tasks. Representation learning has been shown to be a powerful technique for this, but most of the…

Recently, data-driven deep saliency models have achieved high performance and have outperformed classical saliency models, as demonstrated by results on datasets such as the MIT300 and SALICON. Yet, there remains a large gap between the…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Sen He , Hamed R. Tavakoli , Ali Borji , Yang Mi , Nicolas Pugeault

Does multi-view demonstration truly improve robot manipulation, or merely enhance cross-view robustness? We present a systematic study quantifying the performance gains, scaling behavior, and underlying mechanisms of multi-view data for…

Semantic Image Segmentation facilitates a multitude of real-world applications ranging from autonomous driving over industrial process supervision to vision aids for human beings. These models are usually trained in a supervised fashion…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Volker Knauthe , Arne Rak , Tristan Wirth , Thomas Pöllabauer , Simon Metzler , Arjan Kuijper , Dieter W. Fellner

Foundation models applied in robotics, particularly \textbf{Vision--Language--Action (VLA)} models, hold great promise for achieving general-purpose manipulation. Yet, systematic real-world evaluations and cross-model comparisons remain…

Robotics · Computer Science 2025-11-17 Yihao Zhang , Yuankai Qi , Xi Zheng

Embodied AI agents require a fine-grained understanding of the physical world mediated through visual and language inputs. Such capabilities are difficult to learn solely from task-specific data. This has led to the emergence of pre-trained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-12 Gunshi Gupta , Karmesh Yadav , Yarin Gal , Dhruv Batra , Zsolt Kira , Cong Lu , Tim G. J. Rudner

Pretrained models are ubiquitous in the current deep learning landscape, offering strong results on a broad range of tasks. Recent works have shown that models differing in various design choices exhibit categorically diverse generalization…

Machine Learning · Computer Science 2025-10-28 Siddharth Jain , Shyamgopal Karthik , Vineet Gandhi

In this work we explore a new approach for robots to teach themselves about the world simply by observing it. In particular we investigate the effectiveness of learning task-agnostic representations for continuous control tasks. We extend…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Debidatta Dwibedi , Jonathan Tompson , Corey Lynch , Pierre Sermanet