English
Related papers

Related papers: Multi-Token Prediction Needs Registers

200 papers

We present a new approach to encourage neural machine translation to satisfy lexical constraints. Our method acts at the training step and thereby avoiding the introduction of any extra computational overhead at inference step. The proposed…

Computation and Language · Computer Science 2021-06-08 Melissa Ailem , Jinghsu Liu , Raheel Qader

Subword tokenization introduces a computational layer in language models where many distinct token sequences decode to the same surface form and preserve meaning, yet induce different internal computations. Despite this non-uniqueness,…

Computation and Language · Computer Science 2026-01-14 Adrian Cosma , Stefan Ruseti , Emilian Radoi , Mihai Dascalu

Transformers have gained increasing popularity in a wide range of applications, including Natural Language Processing (NLP), Computer Vision and Speech Recognition, because of their powerful representational capacity. However, harnessing…

Nowadays, our mobility systems are evolving into the era of intelligent vehicles that aim to improve road safety. Due to their vulnerability, pedestrians are the users who will benefit the most from these developments. However, predicting…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Lina Achaji , Thierno Barry , Thibault Fouqueray , Julien Moreau , Francois Aioun , Francois Charpillet

Pre-trained language models are trained on large-scale unsupervised data, and they can fine-turn the model only on small-scale labeled datasets, and achieve good results. Multilingual pre-trained language models can be trained on multiple…

Computation and Language · Computer Science 2023-04-11 Junjie Deng , Hanru Shi , Xinhe Yu , Wugedele Bao , Yuan Sun , Xiaobing Zhao

This submission investigates alternative machine learning models for predicting the HTER score on the sentence level. Instead of directly predicting the HTER score, we suggest a model that jointly predicts the amount of the 4 distinct…

Computation and Language · Computer Science 2017-07-20 Eleftherios Avramidis

Current direct speech-to-speech translation methods predominantly employ speech tokens as intermediate representations. However, a single speech token is not dense in semantics, so we generally need multiple tokens to express a complete…

Computation and Language · Computer Science 2025-10-14 Jianjin Wang , Runsong Zhao , Xiaoqian Liu , Yuan Ge , Ziqiang Xu , Tong Xiao , Shengxiang Gao , Zhengtao Yu , Jingbo Zhu

Pre-trained text encoders such as BERT and its variants have recently achieved state-of-the-art performances on many NLP tasks. While being effective, these pre-training methods typically demand massive computation resources. To accelerate…

Computation and Language · Computer Science 2022-03-04 Jiaming Shen , Jialu Liu , Tianqi Liu , Cong Yu , Jiawei Han

Mixed-precision training is a crucial technique for scaling deep learning models, but successful mixedprecision training requires identifying and applying the right combination of training methods. This paper presents our preliminary study…

Machine Learning · Computer Science 2025-12-30 Bor-Yiing Su , Peter Dykas , Mike Chrzanowski , Jatin Chhugani

We introduce a linguistically enhanced combination of pre-training methods for transformers. The pre-training objectives include POS-tagging, synset prediction based on semantic knowledge graphs, and parent prediction based on dependency…

Computation and Language · Computer Science 2023-01-02 Maren Pielka , Svetlana Schmidt , Lisa Pucknat , Rafet Sifa

Multilingual text recognition (MLTR) systems typically focus on a fixed set of languages, which makes it difficult to handle newly added languages or adapt to ever-changing data distribution. In this paper, we propose the Incremental MLTR…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Tianlun Zheng , Zhineng Chen , BingChen Huang , Wei Zhang , Yu-Gang Jiang

Linguistic knowledge has brought great benefits to scene text recognition by providing semantics to refine character sequences. However, since linguistic knowledge has been applied individually on the output sequence, previous methods have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Byeonghu Na , Yoonsik Kim , Sungrae Park

Subword tokenization is a commonly used input pre-processing step in most recent NLP models. However, it limits the models' ability to leverage end-to-end task learning. Its frequency-based vocabulary creation compromises tokenization in…

Computation and Language · Computer Science 2022-04-25 Md Mofijul Islam , Gustavo Aguilar , Pragaash Ponnusamy , Clint Solomon Mathialagan , Chengyuan Ma , Chenlei Guo

Low-frequency word prediction remains a challenge in modern neural machine translation (NMT) systems. Recent adaptive training methods promote the output of infrequent words by emphasizing their weights in the overall training objectives.…

Computation and Language · Computer Science 2021-12-30 Tong Zhang , Wei Ye , Baosong Yang , Long Zhang , Xingzhang Ren , Dayiheng Liu , Jinan Sun , Shikun Zhang , Haibo Zhang , Wen Zhao

Pre-trained vision-language models are able to interpret visual concepts and language semantics. Prompt learning, a method of constructing prompts for text encoders or image encoders, elicits the potentials of pre-trained models and readily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

Improving machine translation (MT) systems with translation memories (TMs) is of great interest to practitioners in the MT community. However, previous approaches require either a significant update of the model architecture and/or…

Computation and Language · Computer Science 2023-02-08 Abudurexiti Reheman , Tao Zhou , Yingfeng Luo , Di Yang , Tong Xiao , Jingbo Zhu

Predicting future sensory states is crucial for learning agents such as robots, drones, and autonomous vehicles. In this paper, we couple multiple sensory modalities with exploratory actions and propose a predictive neural network…

Robotics · Computer Science 2021-09-17 Xiaohui Chen , Ramtin Hosseini , Karen Panetta , Jivko Sinapov

Automatic speech recognition (ASR) is widely used in consumer electronics. ASR greatly improves the utility and accessibility of technology, but usually the output is only word sequences without punctuation. This can result in ambiguity in…

Computation and Language · Computer Science 2021-02-23 Andrew Silva , Barry-John Theobald , Nicholas Apostoloff

Large language models demonstrate reasonable multilingual abilities, despite predominantly English-centric pretraining. However, the spontaneous multilingual alignment in these models is shown to be weak, leading to unsatisfactory…

Computation and Language · Computer Science 2024-11-19 Jiahuan Li , Shujian Huang , Aarron Ching , Xinyu Dai , Jiajun Chen

Every data selection method inherently has a target. In practice, these targets often emerge implicitly through benchmark-driven iteration: researchers develop selection strategies, train models, measure benchmark performance, then refine…