English
Related papers

Related papers: Improving Multilingual Language Models by Aligning…

200 papers

Providing high-quality feedback to Large Language Models (LLMs) on a diverse training distribution can be difficult and expensive, and providing feedback only on a narrow distribution can result in unintended generalizations. To better…

Computation and Language · Computer Science 2026-03-02 Constanza Fierro , Fabien Roger

Large language models (LLMs) are at the forefront of transforming numerous domains globally. However, their inclusivity and effectiveness remain limited for non-Latin scripts and low-resource languages. This paper tackles the imperative…

Computation and Language · Computer Science 2025-01-08 Somnath Kumar , Vaibhav Balloli , Mercy Ranjit , Kabir Ahuja , Tanuja Ganu , Sunayana Sitaram , Kalika Bali , Akshay Nambi

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

Computation and Language · Computer Science 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

Large language models (LLMs) can transform education, but their optimization for direct question-answering often undermines effective pedagogy which requires strategically withholding answers. To mitigate this, we propose an online…

Computation and Language · Computer Science 2025-10-14 David Dinucu-Jianu , Jakub Macina , Nico Daheim , Ido Hakimi , Iryna Gurevych , Mrinmaya Sachan

Text stemming is a natural language processing technique that is used to reduce words to their base form, also known as the root form. The use of stemming in IR has been shown to often improve the effectiveness of keyword-matching models…

Information Retrieval · Computer Science 2024-02-20 Shuai Wang , Shengyao Zhuang , Guido Zuccon

Large language models (LLMs) have demonstrated multilingual capabilities, yet they are mostly English-centric due to the imbalanced training corpora. While prior works have leveraged this bias to enhance multilingual performance through…

Computation and Language · Computer Science 2025-04-22 Chaoqun Liu , Wenxuan Zhang , Yiran Zhao , Anh Tuan Luu , Lidong Bing

The performance of large language models (LLMs) is significantly influenced by the quality of the prompts provided. In response, researchers have developed enormous prompt engineering strategies aimed at modifying the prompt text to enhance…

Computation and Language · Computer Science 2024-10-23 Zhiyuan He , Huiqiang Jiang , Zilong Wang , Yuqing Yang , Luna Qiu , Lili Qiu

Understanding what defines a good representation in large language models (LLMs) is fundamental to both theoretical understanding and practical applications. In this paper, we investigate the quality of intermediate representations in…

Machine Learning · Computer Science 2024-12-13 Oscar Skean , Md Rifat Arefin , Yann LeCun , Ravid Shwartz-Ziv

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

Computation and Language · Computer Science 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

Large Language Models (LLMs) have excelled in various tasks but perform better in high-resource scenarios, which presents challenges in low-resource scenarios. Data scarcity and the inherent difficulty of adapting LLMs to specific tasks…

Computation and Language · Computer Science 2024-04-02 Yuanhao Zeng , Min Wang , Yihang Wang , Yingxia Shao

Large language models (LLMs) have expanded from text to speech, giving rise to Speech Large Models (SLMs) that support recognition, translation, and synthesis. A key challenge is aligning speech and text representations, which becomes…

Computation and Language · Computer Science 2025-09-25 Pei Zhang , Andong Chen , Xi Chen , Baosong Yang , Derek F. Wong , Fei Huang

Multilingual Machine Translation promises to improve translation quality between non-English languages. This is advantageous for several reasons, namely lower latency (no need to translate twice), and reduced error cascades (e.g., avoiding…

Computation and Language · Computer Science 2023-05-05 Telmo Pessoa Pires , Robin M. Schmidt , Yi-Hsiu Liao , Stephan Peitz

Algorithmic trading requires short-term tactical decisions consistent with long-term financial objectives. Reinforcement Learning (RL) has been applied to such problems, but adoption is limited by myopic behaviour and opaque policies. Large…

Machine Learning · Computer Science 2025-10-28 Adam Darmanin , Vince Vella

Activation steering offers a promising approach to controlling the behavior of Large Language Models by directly manipulating their internal activations. However, most existing methods struggle to jointly steer multiple attributes, often…

Artificial Intelligence · Computer Science 2026-04-28 Xinyan Jiang , Lin Zhang , Jiayi Zhang , Qingsong Yang , Guimin Hu , Di Wang , Lijie Hu

Despite being pretrained on multilingual corpora, large language models (LLMs) exhibit suboptimal performance on low-resource languages. Recent approaches have leveraged multilingual encoders alongside LLMs by introducing trainable…

Computation and Language · Computer Science 2025-02-18 Zhiwen Ruan , Yixia Li , He Zhu , Longyue Wang , Weihua Luo , Kaifu Zhang , Yun Chen , Guanhua Chen

Can we improve machine translation (MT) with LLMs by rewriting their inputs automatically? Users commonly rely on the intuition that well-written text is easier to translate when using off-the-shelf MT systems. LLMs can rewrite text in many…

Computation and Language · Computer Science 2025-09-03 Dayeon Ki , Marine Carpuat

In this paper, we elaborate upon recipes for building multilingual representation models that are not only competitive with existing state-of-the-art models but are also more parameter efficient, thereby promoting better adoption in…

Computation and Language · Computer Science 2022-10-27 Barun Patra , Saksham Singhal , Shaohan Huang , Zewen Chi , Li Dong , Furu Wei , Vishrav Chaudhary , Xia Song

Multilingual proficiency presents a significant challenge for large language models (LLMs). English-centric models are usually suboptimal in other languages, particularly those that are linguistically distant from English. This performance…

Computation and Language · Computer Science 2025-01-07 Geyu Lin , Bin Wang , Zhengyuan Liu , Nancy F. Chen

Fine-tuning large language models (LLMs) for machine translation has shown improvements in overall translation quality. However, it is unclear what is the impact of fine-tuning on desirable LLM behaviors that are not present in neural…

Computation and Language · Computer Science 2024-08-07 David Stap , Eva Hasler , Bill Byrne , Christof Monz , Ke Tran