English
Related papers

Related papers: How do Transformers perform In-Context Autoregress…

200 papers

To predict the next token, autoregressive models ordinarily examine the past. Could they also benefit from also examining hypothetical futures? We consider a novel Transformer-based autoregressive architecture that estimates the next-token…

Computation and Language · Computer Science 2023-05-23 Li Du , Hongyuan Mei , Jason Eisner

State of the art sequence-to-sequence models for large scale tasks perform a fixed number of computations for each input sequence regardless of whether it is easy or hard to process. In this paper, we train Transformer models which can make…

Computation and Language · Computer Science 2020-02-18 Maha Elbayad , Jiatao Gu , Edouard Grave , Michael Auli

Absolute camera pose regressors estimate the position and orientation of a camera given the captured image alone. Typically, a convolutional backbone with a multi-layer perceptron (MLP) head is trained using images and pose labels to embed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Yoli Shavit , Ron Ferens , Yosi Keller

Transformers have achieved significant success in various fields, notably excelling in tasks involving sequential data like natural language processing. Despite these achievements, the theoretical understanding of transformers' capabilities…

Machine Learning · Statistics 2025-07-09 Yuan Cao , Yihan He , Dennis Wu , Hong-Yu Chen , Jianqing Fan , Han Liu

Transformer is a ubiquitous model for natural language processing and has attracted wide attentions in computer vision. The attention maps are indispensable for a transformer model to encode the dependencies among input tokens. However,…

Machine Learning · Computer Science 2021-02-26 Yujing Wang , Yaming Yang , Jiangang Bai , Mingliang Zhang , Jing Bai , Jing Yu , Ce Zhang , Gao Huang , Yunhai Tong

Chain of Thought (CoT) prompting has been shown to significantly improve the performance of large language models (LLMs), particularly in arithmetic and reasoning tasks, by instructing the model to produce intermediate reasoning steps.…

Machine Learning · Computer Science 2025-03-03 Jianhao Huang , Zixuan Wang , Jason D. Lee

Large language models have shown tremendous performance in a variety of tasks. In-context learning -- the ability to improve at a task after being provided with a number of demonstrations -- is seen as one of the main contributors to their…

Computation and Language · Computer Science 2023-05-23 Julian Coda-Forno , Marcel Binz , Zeynep Akata , Matthew Botvinick , Jane X. Wang , Eric Schulz

Deep neural networks have been successful in many reinforcement learning settings. However, compared to human learners they are overly data hungry. To build a sample-efficient world model, we apply a transformer to real-world episodes in an…

Machine Learning · Computer Science 2023-03-14 Jan Robine , Marc Höftmann , Tobias Uelwer , Stefan Harmeling

With the attention mechanism, transformers achieve significant empirical successes. Despite the intuitive understanding that transformers perform relational inference over long sequences to produce desirable representations, we lack a…

Machine Learning · Computer Science 2024-04-02 Yufeng Zhang , Boyi Liu , Qi Cai , Lingxiao Wang , Zhaoran Wang

Large Language Models (LLMs) have achieved impressive performance across diverse tasks but continue to struggle with learning transitive relations, a cornerstone for complex planning. To address this issue, we investigate the Multi-Token…

Artificial Intelligence · Computer Science 2025-09-30 Qimin Zhong , Hao Liao , Siwei Wang , Mingyang Zhou , Xiaoqun Wu , Rui Mao , Wei Chen

This paper introduces a high-order Markov chain task to investigate how transformers learn to integrate information from multiple past positions with varying statistical significance. We demonstrate that transformers learn this task…

Machine Learning · Computer Science 2026-02-24 Oğuz Kaan Yüksel , Rodrigo Alvarez Lucendo , Nicolas Flammarion

We propose ContextLM, a framework that implicitly learns multi-token prediction by augmenting standard pretraining with an intrinsic next-context prediction objective. ContextLM builds a language model on top of context embeddings that span…

Computation and Language · Computer Science 2026-02-12 Beiya Dai , Yuliang Liu , Daozheng Xue , Yunchong Song , Qipeng Guo , Kai Chen , Xinbing Wang , Bowen Zhou , Zhouhan Lin

Recently, self-attention models such as Transformers have given competitive results compared to recurrent neural network systems in speech recognition. The key factor for the outstanding performance of self-attention models is their ability…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-29 Shucong Zhang , Erfan Loweimi , Peter Bell , Steve Renals

We study how multi-head softmax attention models are trained to perform in-context learning on linear data. Through extensive empirical experiments and rigorous theoretical analysis, we demystify the emergence of elegant attention patterns:…

Machine Learning · Computer Science 2025-05-29 Jianliang He , Xintian Pan , Siyu Chen , Zhuoran Yang

In the field of medical images, although various works find Swin Transformer has promising effectiveness on pixelwise dense prediction, whether pre-training these models without using extra dataset can further boost the performance for the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xinrong Hu , Dewen Zeng , Yawen Wu , Xueyang Li , Yiyu Shi

Large language models (LLMs) are known for their exceptional performance in natural language processing, making them highly effective in many human life-related or even job-related tasks. The attention mechanism in the Transformer…

Computation and Language · Computer Science 2023-04-27 Shuai Li , Zhao Song , Yu Xia , Tong Yu , Tianyi Zhou

Despite the growing use of transformer models in computer vision, a mechanistic understanding of these networks is still needed. This work introduces a method to reverse-engineer Vision Transformers trained to solve image classification…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Martina G. Vilas , Timothy Schaumlöffel , Gemma Roig

Understanding the internal mechanisms of GPT-style transformers, particularly their capacity to perform in-context learning (ICL), is critical for advancing AI alignment and interpretability. In-context learning allows transformers to…

Machine Learning · Computer Science 2024-10-24 Samarth Bhargav , Alexander Gu

Representation learning for text via pretraining a language model on a large corpus has become a standard starting point for building NLP systems. This approach stands in contrast to autoencoders, also trained on raw text, but with the…

Computation and Language · Computer Science 2021-09-14 Ivan Montero , Nikolaos Pappas , Noah A. Smith

We present a self-supervised sensorimotor pre-training approach for robotics. Our model, called RPT, is a Transformer that operates on sequences of sensorimotor tokens. Given a sequence of camera images, proprioceptive robot states, and…

Robotics · Computer Science 2023-12-15 Ilija Radosavovic , Baifeng Shi , Letian Fu , Ken Goldberg , Trevor Darrell , Jitendra Malik