English
Related papers

Related papers: ReCoRe: Regularized Contrastive Representation Lea…

200 papers

Robustness is essential for deep neural networks, especially in security-sensitive applications. To this end, randomized smoothing provides theoretical guarantees for certifying robustness against adversarial perturbations. Recently,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jiachen Lei , Julius Berner , Jiongxiao Wang , Zhongzhu Chen , Zhongjia Ba , Kui Ren , Jun Zhu , Anima Anandkumar

Recent studies have shown that Transformers can perform in-context reinforcement learning (RL) by imitating existing RL algorithms, enabling sample-efficient adaptation to unseen tasks without parameter updates. However, these models also…

Machine Learning · Computer Science 2025-02-27 Jaehyeon Son , Soochan Lee , Gunhee Kim

Learning generalizable policies that can adapt to unseen environments remains challenging in visual Reinforcement Learning (RL). Existing approaches try to acquire a robust representation via diversifying the appearances of in-domain…

Machine Learning · Computer Science 2022-12-20 Zhecheng Yuan , Zhengrong Xue , Bo Yuan , Xueqian Wang , Yi Wu , Yang Gao , Huazhe Xu

Learning physical dynamics in a series of non-stationary environments is a challenging but essential task for model-based reinforcement learning (MBRL) with visual inputs. It requires the agent to consistently adapt to novel tasks without…

Machine Learning · Computer Science 2025-07-08 Minting Pan , Wendong Zhang , Geng Chen , Xiangming Zhu , Siyu Gao , Yunbo Wang , Xiaokang Yang

Mainstream 3D representation learning approaches are built upon contrastive or generative modeling pretext tasks, where great improvements in performance on various downstream tasks have been achieved. However, we find these two paradigms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Zekun Qi , Runpei Dong , Guofan Fan , Zheng Ge , Xiangyu Zhang , Kaisheng Ma , Li Yi

Robust model fitting is a core algorithm in a large number of computer vision applications. Solving this problem efficiently for datasets highly contaminated with outliers is, however, still challenging due to the underlying computational…

Computer Vision and Pattern Recognition · Computer Science 2021-03-08 Giang Truong , Huu Le , David Suter , Erchuan Zhang , Syed Zulqarnain Gilani

Modeling the world can benefit robot learning by providing a rich training signal for shaping an agent's latent state space. However, learning world models in unconstrained environments over high-dimensional observation spaces such as…

Machine Learning · Computer Science 2021-12-03 Nitish Srivastava , Walter Talbott , Martin Bertran Lopez , Shuangfei Zhai , Josh Susskind

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ruchika Chavhan , Henry Gouk , Jan Stuehmer , Calum Heggan , Mehrdad Yaghoobi , Timothy Hospedales

Medical image registration is a fundamental task in medical image analysis, enabling the alignment of images from different modalities or time points. However, intensity inconsistencies and nonlinear tissue deformations pose significant…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Eytan Kats , Christoph Grossbroehmer , Ziad Al-Haj Hemidi , Fenja Falta , Wiebke Heyer , Mattias P. Heinrich

Techniques that learn improved representations via offline data or self-supervised objectives have shown impressive results in traditional reinforcement learning (RL). Nevertheless, it is unclear how improved representation learning can…

Computation and Language · Computer Science 2024-10-25 Vaskar Nath , Dylan Slack , Jeff Da , Yuntao Ma , Hugh Zhang , Spencer Whitehead , Sean Hendryx

Contrastive, self-supervised learning of object representations recently emerged as an attractive alternative to reconstruction-based training. Prior approaches focus on contrasting individual object representations (slots) against one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Sindy Löwe , Klaus Greff , Rico Jonschkowski , Alexey Dosovitskiy , Thomas Kipf

Over the past few years, the acceleration of computing resources and research in deep learning has led to significant practical successes in a range of tasks, including in particular in computer vision. Building on these advances,…

Artificial Intelligence · Computer Science 2022-04-14 David Bertoin , Emmanuel Rachelson

In this work, we present a novel learning-based framework that combines the local accuracy of contrastive learning with the global consistency of geometric approaches, for robust non-rigid matching. We first observe that while contrastive…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Lei Li , Souhaib Attaiki , Maks Ovsjanikov

Much of model-based reinforcement learning involves learning a model of an agent's world, and training an agent to leverage this model to perform a task more efficiently. While these models are demonstrably useful for agents, every…

Neural and Evolutionary Computing · Computer Science 2019-11-01 C. Daniel Freeman , Luke Metz , David Ha

In standard reinforcement learning (RL), a learning agent seeks to optimize the overall reward. However, many key aspects of a desired behavior are more naturally expressed as constraints. For instance, the designer may want to limit the…

Machine Learning · Computer Science 2021-01-29 Sobhan Miryoosefi , Kianté Brantley , Hal Daumé , Miroslav Dudik , Robert Schapire

Model-based reinforcement learning (RL) is more sample efficient than model-free RL by using imaginary trajectories generated by the learned dynamics model. When the model is inaccurate or biased, imaginary trajectories may be deleterious…

Machine Learning · Computer Science 2021-04-12 Wenzhen Huang , Qiyue Yin , Junge Zhang , Kaiqi Huang

Predictive models have been at the core of many robotic systems, from quadrotors to walking robots. However, it has been challenging to develop and apply such models to practical robotic manipulation due to high-dimensional sensory…

Robotics · Computer Science 2020-09-14 Lucas Manuelli , Yunzhu Li , Pete Florence , Russ Tedrake

The success of Transformer-based models has encouraged many researchers to learn CAD models using sequence-based approaches. However, learning CAD models is still a challenge, because they can be represented as complex shapes with long…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Minseop Jung , Minseong Kim , Jibum Kim

In this paper, we propose Multi-View Dreaming, a novel reinforcement learning agent for integrated recognition and control from multi-view observations by extending Dreaming. Most current reinforcement learning method assumes a single-view…

Artificial Intelligence · Computer Science 2022-03-22 Akira Kinose , Masashi Okada , Ryo Okumura , Tadahiro Taniguchi

Designing a competent meta-reinforcement learning (meta-RL) algorithm in terms of data usage remains a central challenge to be tackled for its successful real-world applications. In this paper, we propose a sample-efficient meta-RL…

Machine Learning · Computer Science 2023-12-12 Jaeuk Shin , Giho Kim , Howon Lee , Joonho Han , Insoon Yang