English
Related papers

Related papers: Waypoint Transformer: Reinforcement Learning via S…

200 papers

Latent World Models enhance scene representation through temporal self-supervised learning, presenting a perception annotation-free paradigm for end-to-end autonomous driving. However, the reconstruction-oriented representation learning…

Recent advances in Vision Transformers (ViTs) have significantly advanced semantic segmentation performance. However, their adaptation to new target domains remains challenged by distribution shifts, which often disrupt global attention…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Enming Zhang , Zhengyu Li , Yanru Wu , Jingge Wang , Yang Tan , Guan Wang , Yang Li , Xiaoping Zhang

Transformers have shown strong ability to model long-term dependencies and are increasingly adopted as world models in model-based reinforcement learning (RL) under partial observability. However, unlike natural language corpora, RL…

Machine Learning · Computer Science 2025-11-11 Daniel De Dios Allegue , Jinke He , Frans A. Oliehoek

We propose world value functions (WVFs), a type of goal-oriented general value function that represents how to solve not just a given task, but any other goal-reaching task in an agent's environment. This is achieved by equipping an agent…

Artificial Intelligence · Computer Science 2022-06-27 Geraud Nangue Tasse , Benjamin Rosman , Steven James

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

The learning of Transformation-Equivariant Representations (TERs), which is introduced by Hinton et al. \cite{hinton2011transforming}, has been considered as a principle to reveal visual structures under various transformations. It contains…

Computer Vision and Pattern Recognition · Computer Science 2019-07-24 Guo-Jun Qi , Liheng Zhang , Chang Wen Chen , Qi Tian

Cross-domain shifts present a significant challenge for decision transformer (DT) policies. Existing cross-domain policy adaptation methods typically rely on a single simple filtering criterion to select source trajectory fragments and…

Machine Learning · Computer Science 2025-12-09 Guojian Wang , Quinson Hon , Xuyang Chen , Lin Zhao

In this paper, we ask whether Vision Transformers (ViTs) can serve as an underlying architecture for improving the adversarial robustness of machine learning models against evasion attacks. While earlier works have focused on improving…

Computer Vision and Pattern Recognition · Computer Science 2023-02-03 Edoardo Debenedetti , Vikash Sehwag , Prateek Mittal

Transformers use the dense self-attention mechanism which gives a lot of flexibility for long-range connectivity. Over multiple layers of a deep transformer, the number of possible connectivity patterns increases exponentially. However,…

Machine Learning · Computer Science 2023-06-05 Md Shamim Hussain , Mohammed J. Zaki , Dharmashankar Subramanian

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance, frequently without considering safety. In contrast, safe reinforcement learning seeks to reduce or avoid unsafe behavior.…

Machine Learning · Computer Science 2025-06-17 Zahra Shahrooei , Ali Baheri

We present a method for trajectory planning for autonomous driving, learning image-based context embeddings that align with motion prediction frameworks and planning-based intention input. Within our method, a ViT encoder takes raw images…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Maitrayee Keskar , Mohan Trivedi , Ross Greer

Weakly supervised object localization is a challenging task which aims to localize objects with coarse annotations such as image categories. Existing deep network approaches are mainly based on class activation map, which focuses on…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Hui Su , Yue Ye , Zhiwei Chen , Mingli Song , Lechao Cheng

Decision Transformer (DT) can learn effective policy from offline datasets by converting the offline reinforcement learning (RL) into a supervised sequence modeling task, where the trajectory elements are generated auto-regressively…

Machine Learning · Computer Science 2024-11-19 Zhihong Liu , Long Qian , Zeyang Liu , Lipeng Wan , Xingyu Chen , Xuguang Lan

The remarkable progress in deep learning (DL) showcases outstanding results in various computer vision tasks. However, adaptation to real-time variations in data distributions remains an important challenge. Test-Time Training (TTT) was…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Marco Colussi , Sergio Mascetti , Jose Dolz , Christian Desrosiers

A novel class of advanced algorithms, termed Goal-Conditioned Weighted Supervised Learning (GCWSL), has recently emerged to tackle the challenges posed by sparse rewards in goal-conditioned reinforcement learning (RL). GCWSL consistently…

Machine Learning · Computer Science 2025-06-10 Xing Lei , Xuetao Zhang , Zifeng Zhuang , Donglin Wang

Recent advancements in attention mechanisms have replaced recurrent neural networks and its variants for machine translation tasks. Transformer using attention mechanism solely achieved state-of-the-art results in sequence modeling. Neural…

Computation and Language · Computer Science 2020-04-02 Prakhar Thapak , Prodip Hore

Despite the exciting performance, Transformer is criticized for its excessive parameters and computation cost. However, compressing Transformer remains as an open problem due to its internal complexity of the layer designs, i.e., Multi-Head…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Gen Luo , Yiyi Zhou , Xiaoshuai Sun , Yan Wang , Liujuan Cao , Yongjian Wu , Feiyue Huang , Rongrong Ji

Research on applications of reinforcement learning (RL) to large language models has mostly been focused on single-turn problems, such as mathematical reasoning or single-shot code generation. While these problems can be viewed as…

Vision-Language-Action (VLA) models have shown great potential in general robotic decision-making tasks via imitation learning. However, the variable quality of training data often constrains the performance of these models. On the other…

Robotics · Computer Science 2025-05-13 Hongyin Zhang , Zifeng Zhuang , Han Zhao , Pengxiang Ding , Hongchao Lu , Donglin Wang

Recent advancements in reasoning abilities of Large Language Models (LLM) has promoted their usage in problems that require high-level planning for robots and artificial agents. However, current techniques that utilize LLMs for such…

Artificial Intelligence · Computer Science 2023-10-17 Yash Shukla , Wenchang Gao , Vasanth Sarathy , Alvaro Velasquez , Robert Wright , Jivko Sinapov