English
Related papers

Related papers: How Transformers Utilize Multi-Head Attention in I…

200 papers

Deep imitation learning is promising for solving dexterous manipulation tasks because it does not require an environment model and pre-programmed robot behavior. However, its application to dual-arm manipulation tasks remains challenging.…

Robotics · Computer Science 2025-05-23 Heecheol Kim , Yoshiyuki Ohmura , Yasuo Kuniyoshi

Self-supervised large language models have demonstrated the ability to perform Machine Translation (MT) via in-context learning, but little is known about where the model performs the task with respect to prompt instructions and…

Computation and Language · Computer Science 2024-03-08 Suzanna Sia , David Mueller , Kevin Duh

The neural attention mechanism plays an important role in many natural language processing applications. In particular, the use of multi-head attention extends single-head attention by allowing a model to jointly attend information from…

Machine Learning · Computer Science 2020-11-03 Bang An , Jie Lyu , Zhenyi Wang , Chunyuan Li , Changwei Hu , Fei Tan , Ruiyi Zhang , Yifan Hu , Changyou Chen

It is known that a deep neural network model pre-trained with large-scale data greatly improves the accuracy of various tasks, especially when there are resource constraints. However, the information needed to solve a given task can vary,…

Computation and Language · Computer Science 2019-04-17 Masahiro Kaneko , Mamoru Komachi

Learning algorithms become more powerful, often at the cost of increased complexity. In response, the demand for algorithms to be transparent is growing. In NLP tasks, attention distributions learned by attention-based deep learning models…

Computation and Language · Computer Science 2019-07-09 Joris Baan , Maartje ter Hoeve , Marlies van der Wees , Anne Schuth , Maarten de Rijke

Recently, the Transformer model that is based solely on attention mechanisms, has advanced the state-of-the-art on various machine translation tasks. However, recent studies reveal that the lack of recurrence hinders its further improvement…

Computation and Language · Computer Science 2019-04-08 Jie Hao , Xing Wang , Baosong Yang , Longyue Wang , Jinfeng Zhang , Zhaopeng Tu

We study the in-context learning (ICL) capabilities of pretrained Transformers in the setting of nonlinear regression. Specifically, we focus on a random Transformer with a nonlinear MLP head where the first layer is randomly initialized…

Machine Learning · Statistics 2025-09-19 Samet Demir , Zafer Dogan

Transformers demonstrate significant advantages as the building block of modern LLMs. In this work, we study the capacities of Transformers in performing unsupervised learning. We show that multi-layered Transformers, given a sufficiently…

Machine Learning · Statistics 2025-01-14 Yihan He , Yuan Cao , Hong-Yu Chen , Dennis Wu , Jianqing Fan , Han Liu

Multilingual generative models obtain remarkable cross-lingual in-context learning capabilities through pre-training on large-scale corpora. However, they still exhibit a performance bias toward high-resource languages and learn isolated…

Computation and Language · Computer Science 2024-06-13 Chong Li , Shaonan Wang , Jiajun Zhang , Chengqing Zong

An effective technique for obtaining high-quality representations is adding a projection head on top of the encoder during training, then discarding it and using the pre-projection representations. Despite its proven practical…

Machine Learning · Computer Science 2024-03-19 Yihao Xue , Eric Gan , Jiayi Ni , Siddharth Joshi , Baharan Mirzasoleiman

The Transformer is an extremely powerful and prominent deep learning architecture. In this work, we challenge the commonly held belief in deep learning that going deeper is better, and show an alternative design approach that is building…

Machine Learning · Computer Science 2022-11-10 Jason Ross Brown , Yiren Zhao , Ilia Shumailov , Robert D Mullins

Although transformers have demonstrated impressive capabilities for in-context learning (ICL) in practice, theoretical understanding of the underlying mechanism that allows transformers to perform ICL is still in its infancy. This work aims…

Machine Learning · Computer Science 2025-05-30 Wei Shen , Ruida Zhou , Jing Yang , Cong Shen

This thesis investigates two key phenomena in large language models (LLMs): in-context learning (ICL) and model collapse. We study ICL in a linear transformer with tied weights trained on linear regression tasks, and show that minimising…

Artificial Intelligence · Computer Science 2026-01-06 Josef Ott

Transformers can efficiently learn in-context from example demonstrations. Most existing theoretical analyses studied the in-context learning (ICL) ability of transformers for linear function classes, where it is typically shown that the…

Machine Learning · Computer Science 2024-11-06 Kazusato Oko , Yujin Song , Taiji Suzuki , Denny Wu

Recently, the attention-enhanced multi-layer encoder, such as Transformer, has been extensively studied in Machine Reading Comprehension (MRC). To predict the answer, it is common practice to employ a predictor to draw information only from…

Computation and Language · Computer Science 2021-02-03 Nuo Chen , Fenglin Liu , Chenyu You , Peilin Zhou , Yuexian Zou

Transformer architectures have achieved remarkable success across language, vision, and multimodal tasks, and there is growing demand for them to address in-context compositional learning tasks. In these tasks, models solve the target…

Machine Learning · Computer Science 2025-11-26 Wei Chen , Jingxi Yu , Zichen Miao , Qiang Qiu

Large language models exhibit a remarkable capacity for in-context learning, where they learn to solve tasks given a few examples. Recent work has shown that transformers can be trained to perform simple regression tasks in-context. This…

Machine Learning · Computer Science 2026-04-03 Hrayr Harutyunyan , Rafayel Darbinyan , Samvel Karapetyan , Hrant Khachatrian

Autoregressive decoder-only transformers have become key components for scalable sequence processing and generation models. However, the transformer's self-attention mechanism requires transferring prior token projections from the main…

Neural and Evolutionary Computing · Computer Science 2024-10-14 Jan Finkbeiner , Emre Neftci

Transformers have become the go-to architecture for language and vision tasks, yet their theoretical properties, especially memorization capacity, remain elusive. This paper investigates the memorization abilities of multi-head attention…

Machine Learning · Computer Science 2024-03-05 Sadegh Mahdavi , Renjie Liao , Christos Thrampoulidis

In this paper, we propose a simple and effective technique to allow for efficient self-supervised learning with bi-directional Transformers. Our approach is motivated by recent studies demonstrating that self-attention patterns in trained…

Computation and Language · Computer Science 2020-10-07 Ameet Deshpande , Karthik Narasimhan