English
Related papers

Related papers: Dissecting Multiplication in Transformers: Insight…

200 papers

Large language models often struggle with length generalization and solving complex problem instances beyond their training distribution. We present a self-improvement approach where models iteratively generate and learn from their own…

Machine Learning · Computer Science 2025-02-14 Nayoung Lee , Ziyang Cai , Avi Schwarzschild , Kangwook Lee , Dimitris Papailiopoulos

Transformers have significantly impacted domains like natural language processing, computer vision, and robotics, where they improve performance compared to other neural networks. This survey explores how transformers are used in…

Machine Learning · Computer Science 2023-07-13 Pranav Agarwal , Aamer Abdul Rahman , Pierre-Luc St-Charles , Simon J. D. Prince , Samira Ebrahimi Kahou

Generative Large Language Models (LLMs) have achieved remarkable advancements in various NLP tasks. However, these advances have not been reflected in the translation task, especially those with moderate model sizes (i.e., 7B or 13B…

Computation and Language · Computer Science 2024-02-07 Haoran Xu , Young Jin Kim , Amr Sharaf , Hany Hassan Awadalla

Analogical reasoning is a hallmark of human intelligence, enabling us to solve new problems by transferring knowledge from one situation to another. Yet, developing artificial intelligence systems capable of robust human-like analogical…

Machine Learning · Computer Science 2026-04-09 Philipp Hellwig , Willem Zuidema , Claire E. Stevenson , Martha Lewis

We study the error rate of LLMs on tasks like arithmetic that require a deterministic output, and repetitive processing of tokens drawn from a small set of alternatives. We argue that incorrect predictions arise when small errors in the…

Machine Learning · Computer Science 2026-01-21 Suvrat Raju , Praneeth Netrapalli

Code translation tools (transpilers) are developed for automatic source-to-source translation. Although learning-based transpilers have shown impressive enhancement against rule-based counterparts, owing to their task-specific pre-training…

Software Engineering · Computer Science 2024-05-14 Zhen Yang , Fang Liu , Zhongxing Yu , Jacky Wai Keung , Jia Li , Shuo Liu , Yifan Hong , Xiaoxue Ma , Zhi Jin , Ge Li

Despite the impressive performance in a variety of complex tasks, modern large language models (LLMs) still have trouble dealing with some math problems that are simple and intuitive for humans, such as addition. While we can easily learn…

Artificial Intelligence · Computer Science 2024-06-27 Yi Hu , Xiaojuan Tang , Haotong Yang , Muhan Zhang

It has been observed in recent years that transformers have problems with length generalization for certain types of reasoning and arithmetic tasks. In particular, the performance of a transformer model trained on tasks (say addition) up to…

Machine Learning · Computer Science 2023-10-03 Pranjal Awasthi , Anupam Gupta

There is a recent trend in artificial intelligence (AI) inference towards lower precision data formats down to 8 bits and less. As multiplication is the most complex operation in typical inference tasks, there is a large demand for…

Hardware Architecture · Computer Science 2024-05-06 Andreas Böttcher , Martin Kumm

The transformer-based pre-trained language models have been tremendously successful in most of the conventional NLP tasks. But they often struggle in those tasks where numerical understanding is required. Some possible reasons can be the…

Computation and Language · Computer Science 2021-09-13 Kuntal Kumar Pal , Chitta Baral

Transformers achieve state-of-the-art accuracy and robustness across many tasks, but an understanding of their inductive biases and how those biases differ from other neural network architectures remains elusive. In this work, we identify…

Machine Learning · Computer Science 2025-02-14 Bhavya Vasudeva , Deqing Fu , Tianyi Zhou , Elliott Kau , Youqi Huang , Vatsal Sharan

The inaccurate translation of numbers can lead to significant security issues, ranging from financial setbacks to medical inaccuracies. While large language models (LLMs) have made significant advancements in machine translation, their…

Computation and Language · Computer Science 2025-01-10 Wei Tang , Jiawei Yu , Yuang Li , Yanqing Zhao , Weidong Zhang , Wei Feng , Min Zhang , Hao Yang

In recent years, Large Language Models such as GPT-3 showed remarkable capabilities in performing NLP tasks in the zero and few shot settings. On the other hand, the experiments highlighted the difficulty of GPT-3 in carrying out tasks that…

Computation and Language · Computer Science 2023-04-24 Matteo Muffo , Aldo Cocco , Enrico Bertino

Large language models (LLMs) have reached human-like proficiency in generating diverse textual content, underscoring the necessity for effective fake text detection to avoid potential risks such as fake news in social media. Previous…

Machine Learning · Computer Science 2024-03-21 Zhixin Lai , Xuesheng Zhang , Suiyao Chen

Transformers are widely used in NLP tasks. However, current approaches to leveraging transformers to understand language expose one weak spot: Number understanding. In some scenarios, numbers frequently occur, especially in semi-structured…

Computation and Language · Computer Science 2023-03-17 Hongwei Han , Jialiang Xu , Mengyu Zhou , Yijia Shao , Shi Han , Dongmei Zhang

Large language models like GPT-4 exhibit emergent capabilities across general-purpose tasks, such as basic arithmetic, when trained on extensive text data, even though these tasks are not explicitly encoded by the unsupervised, next-token…

Machine Learning · Computer Science 2023-07-10 Nayoung Lee , Kartik Sreenivasan , Jason D. Lee , Kangwook Lee , Dimitris Papailiopoulos

With the emergence of ChatGPT, Transformer models have significantly advanced text classification and related tasks. Decoder-only models such as Llama exhibit strong performance and flexibility, yet they suffer from inefficiency on…

Computation and Language · Computer Science 2025-06-25 Lujun Li , Lama Sleem , Niccolo' Gentile , Geoffrey Nichil , Radu State

Large language models based on the transformer architecture can solve highly complex tasks, yet their fundamental limitations on simple algorithmic problems remain poorly understood. In this work, we focus on basic counting tasks and…

Computation and Language · Computer Science 2026-02-26 Gilad Yehudai , Haim Kaplan , Guy Dar , Royi Rassin , Asma Ghandeharioun , Mor Geva , Amir Globerson

Recent works attribute the capability of in-context learning (ICL) in large pre-trained language models to implicitly simulating and fine-tuning an internal model (e.g., linear or 2-layer MLP) during inference. However, such constructions…

Computation and Language · Computer Science 2024-02-09 Abhishek Panigrahi , Sadhika Malladi , Mengzhou Xia , Sanjeev Arora

Transformer networks have seen great success in natural language processing and machine vision, where task objectives such as next word prediction and image classification benefit from nuanced context sensitivity across high-dimensional…

Machine Learning · Computer Science 2022-12-13 Yuxuan Li , James L. McClelland