中文
相关论文

相关论文: Self-Improving Multilingual Long Reasoning via Tra…

200 篇论文

Recent developments have enabled Large Language Models (LLMs) to engage in complex reasoning tasks through deep thinking. However, the capacity of reasoning has not been successfully transferred to non-high-resource languages due to…

计算与语言 · 计算机科学 2025-10-06 Rui Qi , Zhibo Man , Yufeng Chen , Fengran Mo , Jinan Xu , Kaiyu Huang

Chain-of-thought (CoT) has proven to improve the reasoning capability of large language models (LLMs). However, due to the complexity of multimodal scenarios and the difficulty in collecting high-quality CoT data, CoT reasoning in…

机器学习 · 计算机科学 2024-11-05 Kanzhi Cheng , Yantao Li , Fangzhi Xu , Jianbing Zhang , Hao Zhou , Yang Liu

Multilingual proficiency presents a significant challenge for large language models (LLMs). English-centric models are usually suboptimal in other languages, particularly those that are linguistically distant from English. This performance…

计算与语言 · 计算机科学 2025-01-07 Geyu Lin , Bin Wang , Zhengyuan Liu , Nancy F. Chen

Large reasoning models (LRMs) increasingly rely on step-by-step Chain-of-Thought (CoT) reasoning to improve task performance, particularly in high-resource languages such as English. While recent work has examined final-answer accuracy in…

计算与语言 · 计算机科学 2025-10-13 Raoyuan Zhao , Yihong Liu , Hinrich Schütze , Michael A. Hedderich

With the increasing accessibility and utilization of multilingual documents, Cross-Lingual Information Retrieval (CLIR) has emerged as an important research area. Conventionally, CLIR tasks have been conducted under settings where the…

信息检索 · 计算机科学 2026-04-08 Seongtae Hong , Youngjoon Jang , Jungseob Lee , Hyeonseok Moon , Heuiseok Lim

Recently, O1-like models have emerged as representative examples, illustrating the effectiveness of long chain-of-thought (CoT) in reasoning tasks such as math and coding tasks. In this paper, we introduce DRT, an attempt to bring the…

计算与语言 · 计算机科学 2025-08-26 Jiaan Wang , Fandong Meng , Yunlong Liang , Jie Zhou

Reasoning language models (RLMs) achieve strong performance on complex reasoning tasks, yet they still exhibit a multilingual reasoning gap, performing better in high-resource languages than in low-resource ones. While recent efforts have…

计算与语言 · 计算机科学 2026-04-14 Deokhyung Kang , Seonjeong Hwang , Daehui Kim , Hyounghun Kim , Gary Geunbae Lee

Large language models (LLMs) exhibit in-context learning abilities which enable the same model to perform several tasks without any task-specific training. In contrast, traditional adaptation approaches, such as fine-tuning, modify the…

机器学习 · 计算机科学 2023-06-14 Kush Bhatia , Avanika Narayan , Christopher De Sa , Christopher Ré

We describe a multi-task learning approach to train a Neural Machine Translation (NMT) model with a Relevance-based Auxiliary Task (RAT) for search query translation. The translation process for Cross-lingual Information Retrieval (CLIR)…

信息检索 · 计算机科学 2019-06-18 Sheikh Muhammad Sarwar , Hamed Bonab , James Allan

Despite the significant improvements achieved by large language models (LLMs) in English reasoning tasks, these models continue to struggle with multilingual reasoning. Recent studies leverage a full-parameter and two-stage training…

计算与语言 · 计算机科学 2025-01-08 Yuchun Fan , Yongyu Mu , Yilin Wang , Lei Huang , Junhao Ruan , Bei Li , Tong Xiao , Shujian Huang , Xiaocheng Feng , Jingbo Zhu

Achieving consistent high-quality machine translation (MT) across diverse domains remains a significant challenge, primarily due to the limited and imbalanced parallel training data available in various domains. While large language models…

计算与语言 · 计算机科学 2024-10-04 Tianxiang Hu , Pei Zhang , Baosong Yang , Jun Xie , Derek F. Wong , Rui Wang

Large Language Models (LLMs), when enhanced through reasoning-oriented post-training, evolve into powerful Large Reasoning Models (LRMs). Tool-Integrated Reasoning (TIR) further extends their capabilities by incorporating external tools,…

计算与语言 · 计算机科学 2025-07-30 Yifan Wei , Xiaoyan Yu , Yixuan Weng , Tengfei Pan , Angsheng Li , Li Du

Despite recent breakthroughs in reasoning-enhanced large language models (LLMs) like DeepSeek-R1, incorporating inference-time reasoning into machine translation (MT), where human translators naturally employ structured, multi-layered…

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

计算与语言 · 计算机科学 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

While large reasoning models have shown remarkable ability to generate long chains-of-thought (CoTs) in English, we still lack understanding of how these long-form reasoning abilities transfer to the vast majority of the world's languages.…

计算与语言 · 计算机科学 2026-03-24 Josh Barua , Seun Eisape , Kayo Yin , Alane Suhr

Reasoning methods, best exemplified by the well-known Chain-of-Thought (CoT), empower the reasoning abilities of Large Language Models (LLMs) by eliciting them to solve complex tasks in a step-by-step manner. Although they are achieving…

计算与语言 · 计算机科学 2024-06-24 Leonardo Ranaldi , Giulia Pucci , Federico Ranaldi , Elena Sofia Ruzzetti , Fabio Massimo Zanzotto

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

计算与语言 · 计算机科学 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

Test-time scaling (TTS) has enhanced the performance of Reasoning Models (RMs) on various tasks such as math and coding, yet its efficacy in machine translation (MT) remains underexplored. This paper investigates whether increased…

计算与语言 · 计算机科学 2026-01-13 Zihao Li , Shaoxiong Ji , Jörg Tiedemann

Chain-of-thought (CoT) reasoning has emerged as a powerful tool for improving large language model performance on complex tasks, but recent work shows that reasoning steps often fail to causally influence the final answer, creating brittle…

Existing approaches to mathematical reasoning with large language models (LLMs) rely on Chain-of-Thought (CoT) for generalizability or Tool-Integrated Reasoning (TIR) for precise computation. While efforts have been made to combine these…

计算与语言 · 计算机科学 2026-02-13 Xin Xu , Yan Xu , Tianhao Chen , Yuchen Yan , Chengwu Liu , Zaoyu Chen , Yufei Wang , Yichun Yin , Yasheng Wang , Lifeng Shang , Qun Liu , Lu Yin