English
Related papers

Related papers: Tower+: Bridging Generality and Translation Specia…

200 papers

Prior work on Sign Language Translation has shown that having a mid-level sign gloss representation (effectively recognizing the individual signs) improves the translation performance drastically. In fact, the current state-of-the-art in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Necati Cihan Camgoz , Oscar Koller , Simon Hadfield , Richard Bowden

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

Computation and Language · Computer Science 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

The language ability of Large Language Models (LLMs) is often unbalanced towards English because of the imbalance in the distribution of the pre-training data. This disparity is demanded in further fine-tuning and affecting the…

Computation and Language · Computer Science 2024-10-30 Leonardo Ranaldi , Giulia Pucci , Andre Freitas

Traditional machine translation methods typically involve training models directly on large parallel corpora, with limited emphasis on specialized terminology. However, In specialized fields such as patent, finance, or biomedical domains,…

Computation and Language · Computer Science 2024-10-22 Sejoon Kim , Mingi Sung , Jeonghwan Lee , Hyunkuk Lim , Jorge Froilan Gimenez Perez

Recent studies in prompting large language model (LLM) for document-level machine translation (DMT) primarily focus on the inter-sentence context by flatting the source document into a long sequence. This approach relies solely on the…

Computation and Language · Computer Science 2025-03-18 Bin Liu , Xinglin Lyu , Junhui Li , Daimeng Wei , Min Zhang , Shimin Tao , Hao Yang

Recent advancements in large language models (LLMs) have demonstrated their remarkable capabilities across various language tasks. Inspired by the success of text-to-text translation refinement, this paper investigates how LLMs can improve…

Computation and Language · Computer Science 2025-01-28 Huaixia Dou , Xinyu Tian , Xinglin Lyu , Jie Zhu , Junhui Li , Lifan Guo

This paper introduces a multifaceted methodology for fine-tuning and evaluating large language models (LLMs) for specialized monetization tasks. The goal is to balance general language proficiency with domain-specific skills. The…

Computation and Language · Computer Science 2023-10-10 Zheng Zhang , Chen Zheng , Da Tang , Ke Sun , Yukun Ma , Yingtong Bu , Xun Zhou , Liang Zhao

Large Language Models (LLMs) have delivered impressive results in language understanding, generation, reasoning, and pushes the ability boundary of multimodal models. Transformer models, as the foundation of modern LLMs, offer a strong…

Computation and Language · Computer Science 2025-08-14 Weigao Sun , Jiaxi Hu , Yucheng Zhou , Jusen Du , Disen Lan , Kexin Wang , Tong Zhu , Xiaoye Qu , Yu Zhang , Xiaoyu Mo , Daizong Liu , Yuxuan Liang , Wenliang Chen , Guoqi Li , Yu Cheng

The integration of pretrained language models (PLMs) like BERT and GPT has revolutionized NLP, particularly for English, but it has also created linguistic imbalances. This paper strategically identifies the need for linguistic equity by…

Computation and Language · Computer Science 2025-03-19 Somnath Banerjee , Avik Halder , Rajarshi Mandal , Sayan Layek , Ian Soboroff , Rima Hazra , Animesh Mukherjee

Machine translation systems for high resource languages perform exceptionally well and produce high quality translations. Unfortunately, the vast majority of languages are not considered high resource and lack the quantity of parallel…

Computation and Language · Computer Science 2024-10-22 Jonathan Hus , Antonios Anastasopoulos

While significant progress has been made in benchmarking Large Language Models (LLMs) across various tasks, there is a lack of comprehensive evaluation of their abilities in responding to multi-turn instructions in less-commonly tested…

Computation and Language · Computer Science 2023-10-24 Sabri Boughorbel , Majd Hawasly

Multimodal Large Language Models (MLLMs) have achieved great success in Speech-to-Text Translation (S2TT) tasks. However, current research is constrained by two key challenges: language coverage and efficiency. Most of the popular S2TT…

Computation and Language · Computer Science 2026-04-14 Yexing Du , Kaiyuan Liu , Youcheng Pan , Bo Yang , Keqi Deng , Xie Chen , Yang Xiang , Ming Liu , Bing Qin , YaoWei Wang

Most current large language models (LLMs) support a wide variety of languages in addition to English, including high-resource languages (e.g. German, Chinese, French), as well as low-resource ones (e.g. Swahili, Telugu). In addition they…

Computation and Language · Computer Science 2025-11-10 Jan-Thorsten Peter , David Vilar , Tobias Domhan , Dan Malkin , Markus Freitag

For effective human-robot interaction, robots need to understand, plan, and execute complex, long-horizon tasks described by natural language. Recent advances in large language models (LLMs) have shown promise for translating natural…

Robotics · Computer Science 2024-03-25 Yongchao Chen , Jacob Arkin , Charles Dawson , Yang Zhang , Nicholas Roy , Chuchu Fan

Large language models (LLMs) have achieved state-of-the-art performance in various language processing tasks, motivating their adoption in simultaneous translation. Current fine-tuning methods to adapt LLMs for simultaneous translation…

Computation and Language · Computer Science 2024-10-10 Matthew Raffel , Victor Agostinelli , Lizhong Chen

Multilingual proficiency presents a significant challenge for large language models (LLMs). English-centric models are usually suboptimal in other languages, particularly those that are linguistically distant from English. This performance…

Computation and Language · Computer Science 2025-01-07 Geyu Lin , Bin Wang , Zhengyuan Liu , Nancy F. Chen

The emergence of Large Language Models (LLMs) has advanced the multilingual machine translation (MMT), yet the Curse of Multilinguality (CoM) remains a major challenge. Existing work in LLM-based MMT typically mitigates this issue via…

Computation and Language · Computer Science 2025-02-18 Tong Zheng , Yan Wen , Huiwen Bao , Junfeng Guo , Heng Huang

Recent advancements in massively multilingual machine translation systems have significantly enhanced translation accuracy; however, even the best performing systems still generate hallucinations, severely impacting user trust. Detecting…

Computation and Language · Computer Science 2024-10-22 Kenza Benkirane , Laura Gongas , Shahar Pelles , Naomi Fuchs , Joshua Darmon , Pontus Stenetorp , David Ifeoluwa Adelani , Eduardo Sánchez

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

Artificial Intelligence · Computer Science 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

Preference optimization techniques have become a standard final stage for training state-of-art large language models (LLMs). However, despite widespread adoption, the vast majority of work to-date has focused on first-class citizen…

Computation and Language · Computer Science 2024-07-04 John Dang , Arash Ahmadian , Kelly Marchisio , Julia Kreutzer , Ahmet Üstün , Sara Hooker