English
Related papers

Related papers: Self-Supervised Behavior Cloned Transformers are P…

200 papers

With the growing phase of artificial intelligence and autonomous learning, the self-driving car is one of the promising area of research and emerging as a center of focus for automobile industries. Behavioral cloning is the process of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-14 Uppala Sumanth , Narinder Singh Punn , Sanjay Kumar Sonbhadra , Sonali Agarwal

We present a Transformer-based framework for Constraint Satisfaction Problems (CSPs). CSPs find use in many applications and thus accelerating their solution with machine learning is of wide interest. Most existing approaches rely on…

Machine Learning · Computer Science 2025-06-11 Yudong W. Xu , Wenhao Li , Scott Sanner , Elias B. Khalil

Transformers have proven highly effective across various applications, especially in handling sequential data such as natural languages and time series. However, transformer models often lack clear interpretability, and the success of…

Machine Learning · Computer Science 2025-12-01 Wei Shi , Yuan Cao

Humans are excellent at understanding language and vision to accomplish a wide range of tasks. In contrast, creating general instruction-following embodied agents remains a difficult challenge. Prior work that uses pure language-only models…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Hao Liu , Lisa Lee , Kimin Lee , Pieter Abbeel

Learning from human demonstrations (behavior cloning) is a cornerstone of robot learning. However, most behavior cloning algorithms require a large number of demonstrations to learn a task, especially for general tasks that have a large…

Robotics · Computer Science 2023-09-20 Abraham George , Amir Barati Farimani

Text style transfer is an important task in controllable language generation. Supervised approaches have pushed performance improvement on style-oriented rewriting such as formality conversion. However, challenges remain due to the scarcity…

Computation and Language · Computer Science 2022-05-20 Zhengyuan Liu , Nancy F. Chen

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

Pre-trained word embeddings are the primary method for transfer learning in several Natural Language Processing (NLP) tasks. Recent works have focused on using unsupervised techniques such as language modeling to obtain these embeddings. In…

Computation and Language · Computer Science 2019-07-01 Mihir Kale , Aditya Siddhant , Sreyashi Nag , Radhika Parik , Matthias Grabmair , Anthony Tomasic

Methods for learning latent user representations from historical behavior logs have gained traction for recommendation tasks in e-commerce, content streaming, and other settings. However, this area still remains relatively underexplored in…

A longstanding goal of the field of AI is a method for learning a highly capable, generalist agent from diverse experience. In the subfields of vision and language, this was largely achieved by scaling up transformer-based models and…

In this work we propose for the first time a transformer-based framework for unsupervised representation learning of multivariate time series. Pre-trained models can be potentially used for downstream tasks such as regression and…

Machine Learning · Computer Science 2020-12-10 George Zerveas , Srideepika Jayaraman , Dhaval Patel , Anuradha Bhamidipaty , Carsten Eickhoff

Multiple supervised learning scenarios are composed by a sequence of classification tasks. For instance, multi-task learning and continual learning aim to learn a sequence of tasks that is either fixed or grows over time. Existing…

Machine Learning · Statistics 2025-01-10 Verónica Álvarez , Santiago Mazuelas , Jose A. Lozano

Transformers are neural network models that utilize multiple layers of self-attention heads and have exhibited enormous potential in natural language processing tasks. Meanwhile, there have been efforts to adapt transformers to visual tasks…

Machine Learning · Computer Science 2024-06-25 Li Meng , Morten Goodwin , Anis Yazidi , Paal Engelstad

Large transformer models pretrained on offline reinforcement learning datasets have demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they can make good decisions when prompted with interaction…

Machine Learning · Computer Science 2024-05-28 Licong Lin , Yu Bai , Song Mei

Imitation learning aims to extract high-performance policies from logged demonstrations of expert behavior. It is common to frame imitation learning as a supervised learning problem in which one fits a function approximator to the…

Machine Learning · Computer Science 2022-05-24 Mengjiao Yang , Dale Schuurmans , Pieter Abbeel , Ofir Nachum

Transformers demonstrate impressive performance on a range of reasoning benchmarks. To evaluate the degree to which these abilities are a result of actual reasoning, existing work has focused on developing sophisticated benchmarks for…

Machine Learning · Computer Science 2024-07-02 Jannik Brinkmann , Abhay Sheshadri , Victor Levoso , Paul Swoboda , Christian Bartelt

Behavioral cloning is an imitation learning technique that teaches an agent how to behave through expert demonstrations. Recent approaches use self-supervision of fully-observable unlabeled snapshots of the states to decode state-pairs into…

Machine Learning · Computer Science 2020-08-14 Nathan Gavenski , Juarez Monteiro , Roger Granada , Felipe Meneguzzi , Rodrigo C. Barros

Text-based games(TBG) are complex environments which allow users or computer agents to make textual interactions and achieve game goals.In TBG agent design and training process, balancing the efficiency and performance of the agent models…

Computation and Language · Computer Science 2022-09-13 Chen Chen , Yue Dai , Josiah Poon , Caren Han

Learning control policies offline from pre-recorded datasets is a promising avenue for solving challenging real-world problems. However, available datasets are typically of mixed quality, with a limited number of the trajectories that we…

In this paper, we consider the supervised pre-trained transformer for a class of sequential decision-making problems. The class of considered problems is a subset of the general formulation of reinforcement learning in that there is no…

Machine Learning · Computer Science 2024-10-03 Hanzhao Wang , Yu Pan , Fupeng Sun , Shang Liu , Kalyan Talluri , Guanting Chen , Xiaocheng Li