English
Related papers

Related papers: Beyond A*: Better Planning with Transformers via S…

200 papers

Addressing the resource waste caused by fixed computation paradigms in deep learning models under dynamic scenarios, this paper proposes a Transformer$^{-1}$ architecture based on the principle of deep adaptivity. This architecture achieves…

Machine Learning · Computer Science 2025-01-29 Lumen AI , Tengzhou No. 1 Middle School , Shihao Ji , Zihui Song , Fucheng Zhong , Jisen Jia , Zhaobo Wu , Zheyi Cao , Xu Tianhao

Large transformer models trained on diverse datasets have shown a remarkable ability to learn in-context, achieving high few-shot performance on tasks they were not explicitly trained to solve. In this paper, we study the in-context…

Machine Learning · Computer Science 2023-06-27 Jonathan N. Lee , Annie Xie , Aldo Pacchiano , Yash Chandak , Chelsea Finn , Ofir Nachum , Emma Brunskill

When trained on language data, do transformers learn some arbitrary computation that utilizes the full capacity of the architecture or do they learn a simpler, tree-like computation, hypothesized to underlie compositional meaning systems…

Computation and Language · Computer Science 2022-11-07 Shikhar Murty , Pratyusha Sharma , Jacob Andreas , Christopher D. Manning

To analyze the scaling potential of deep tabular representation learning models, we introduce a novel Transformer-based architecture specifically tailored to tabular data and cross-table representation learning by utilizing table-specific…

Machine Learning · Computer Science 2023-10-02 Maximilian Schambach , Dominique Paul , Johannes S. Otterbach

Planning is a crucial element of both human intelligence and contemporary large language models (LLMs). In this paper, we initiate a theoretical investigation into the emergence of planning capabilities in Transformer-based LLMs via their…

Machine Learning · Computer Science 2024-11-12 Siwei Wang , Yifei Shen , Shi Feng , Haoran Sun , Shang-Hua Teng , Wei Chen

Symbolic regression algorithms search a space of mathematical expressions for formulas that explain given data. Transformer-based models have emerged as a promising, scalable approach shifting the expensive combinatorial search to a…

Machine Learning · Computer Science 2025-09-25 Henrik Voigt , Paul Kahlmeyer , Kai Lawonn , Michael Habeck , Joachim Giesen

Search and planning algorithms have been a cornerstone of artificial intelligence since the field's inception. Giving reinforcement learning agents the ability to plan during execution time has resulted in significant performance…

Artificial Intelligence · Computer Science 2023-12-05 Carlos Martin , Tuomas Sandholm

Despite their remarkable success in language modeling, transformers trained to predict the next token in a sequence struggle with long-term planning. This limitation is particularly evident in tasks requiring foresight to plan multiple…

Machine Learning · Computer Science 2024-12-19 Niklas Nolte , Ouail Kitouni , Adina Williams , Mike Rabbat , Mark Ibrahim

Chain-of-thought responses from language models improve performance across most benchmarks. However, it remains unclear to what extent these performance gains can be attributed to human-like task decomposition or simply the greater…

Computation and Language · Computer Science 2024-04-25 Jacob Pfau , William Merrill , Samuel R. Bowman

An effective approach to solving long-horizon tasks in robotics domains with continuous state and action spaces is bilevel planning, wherein a high-level search over an abstraction of an environment is used to guide low-level…

Artificial Intelligence · Computer Science 2023-09-06 Nishanth Kumar , Willie McClinton , Rohan Chitnis , Tom Silver , Tomás Lozano-Pérez , Leslie Pack Kaelbling

Knowledge tracing (KT) aims to trace students' knowledge states by predicting whether students answer correctly on exercises. Despite the excellent performance of existing Transformer-based KT approaches, they are criticized for the…

Neural and Evolutionary Computing · Computer Science 2023-10-03 Shangshang Yang , Xiaoshan Yu , Ye Tian , Xueming Yan , Haiping Ma , Xingyi Zhang

Transformers have proven highly effective across various applications, especially in handling sequential data such as natural languages and time series. However, transformer models often lack clear interpretability, and the success of…

Machine Learning · Computer Science 2025-12-01 Wei Shi , Yuan Cao

Inspired by the success of the Transformer architecture in natural language processing and computer vision, we investigate the use of Transformers in Reinforcement Learning (RL), specifically in modeling the environment's dynamics using…

Machine Learning · Computer Science 2024-11-19 Mostafa Kotb , Cornelius Weber , Muhammad Burhan Hafez , Stefan Wermter

Autonomous vehicles operating in complex real-world environments require accurate predictions of interactive behaviors between traffic participants. This paper tackles the interaction prediction problem by formulating it with hierarchical…

Robotics · Computer Science 2023-08-15 Zhiyu Huang , Haochen Liu , Chen Lv

Deep imitation learning is promising for solving dexterous manipulation tasks because it does not require an environment model and pre-programmed robot behavior. However, its application to dual-arm manipulation tasks remains challenging.…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Recent advances in vision-and-language modeling have seen the development of Transformer architectures that achieve remarkable performance on multimodal reasoning tasks. Yet, the exact capabilities of these black-box models are still poorly…

Computation and Language · Computer Science 2022-10-24 Mitja Nikolaus , Emmanuelle Salin , Stephane Ayache , Abdellah Fourtassi , Benoit Favre

Selecting or designing an appropriate domain adaptation algorithm for a given problem remains challenging. This paper presents a Transformer model that can provably approximate and opt for domain adaptation methods for a given dataset in…

Machine Learning · Computer Science 2024-05-28 Ryuichiro Hataya , Kota Matsui , Masaaki Imaizumi

As environments involving both robots and humans become increasingly common, so does the need to account for people during planning. To plan effectively, robots must be able to respond to and sometimes influence what humans do. This…

Artificial Intelligence · Computer Science 2021-03-16 Arjun Sripathy , Andreea Bobu , Daniel S. Brown , Anca D. Dragan

Language models can be used to solve long-horizon planning problems in two distinct modes: a fast 'System-1' mode, directly generating plans without any explicit search or backtracking, and a slow 'System-2' mode, planning step-by-step by…

Artificial Intelligence · Computer Science 2025-04-16 Swarnadeep Saha , Archiki Prasad , Justin Chih-Yao Chen , Peter Hase , Elias Stengel-Eskin , Mohit Bansal

Language models (LMs) exhibit remarkable abilities to solve new tasks from just a few examples or textual instructions, especially at scale. They also, paradoxically, struggle with basic functionality, such as arithmetic or factual lookup,…

Computation and Language · Computer Science 2023-02-10 Timo Schick , Jane Dwivedi-Yu , Roberto Dessì , Roberta Raileanu , Maria Lomeli , Luke Zettlemoyer , Nicola Cancedda , Thomas Scialom