中文
相关论文

相关论文: TASER: Translation Assessment via Systematic Evalu…

200 篇论文

This paper introduces the Comprehensive AI-assisted Translation Edit Ratio (CATER), a novel and fully prompt-driven framework for evaluating machine translation (MT) quality. Leveraging large language models (LLMs) via a carefully designed…

计算与语言 · 计算机科学 2024-12-17 Kurando IIDA , Kenjiro MIMURA

Large Language Models (LLMs) have achieved impressive results in Machine Translation (MT). However, careful evaluations by human reveal that the translations produced by LLMs still contain multiple errors. Importantly, feeding back such…

计算与语言 · 计算机科学 2024-06-24 Zhaopeng Feng , Yan Zhang , Hao Li , Bei Wu , Jiayu Liao , Wenqiang Liu , Jun Lang , Yang Feng , Jian Wu , Zuozhu Liu

Large Language Models (LLMs) have emerged as powerful tools for generating coherent text, understanding context, and performing reasoning tasks. However, they struggle with temporal reasoning, which requires processing time-related…

机器学习 · 计算机科学 2025-06-02 Adrián Bazaga , Rexhina Blloshmi , Bill Byrne , Adrià de Gispert

Reasoning-oriented large language models (RLMs) achieve strong gains on tasks such as mathematics and coding by generating explicit intermediate reasoning. However, their impact on machine translation (MT) remains underexplored. We…

计算与语言 · 计算机科学 2026-02-17 Sara Rajaee , Sebastian Vincent , Alexandre Berard , Marzieh Fadaee , Kelly Marchisio , Tom Kocmi

Large language models (LLMs) have exhibited remarkable performance in various natural language processing tasks. Techniques like instruction tuning have effectively enhanced the proficiency of LLMs in the downstream task of machine…

计算与语言 · 计算机科学 2024-06-13 Yutong Wang , Jiali Zeng , Xuebo Liu , Fandong Meng , Jie Zhou , Min Zhang

Recent advances in Large Reasoning Models (LRMs), particularly those leveraging Chain-of-Thought reasoning (CoT), have opened brand new possibility for Machine Translation (MT). This position paper argues that LRMs substantially transformed…

计算与语言 · 计算机科学 2025-03-17 Sinuo Liu , Chenyang Lyu , Minghao Wu , Longyue Wang , Weihua Luo , Kaifu Zhang , Zifu Shang

Recent advancements in large reasoning models (LRMs) have introduced an intermediate "thinking" process prior to generating final answers, improving their reasoning capabilities on complex downstream tasks. However, the potential of LRMs as…

计算与语言 · 计算机科学 2025-10-24 Runzhe Zhan , Zhihong Huang , Xinyi Yang , Lidia S. Chao , Min Yang , Derek F. Wong

Traditionally, Machine Translation (MT) Evaluation has been treated as a regression problem -- producing an absolute translation-quality score. This approach has two limitations: i) the scores lack interpretability, and human annotators…

计算与语言 · 计算机科学 2024-01-31 Ibraheem Muhammad Moosa , Rui Zhang , Wenpeng Yin

Large language models (LLMs) have demonstrated strong performance in general-purpose machine translation, but their effectiveness in complex, domain-sensitive translation tasks remains underexplored. Recent advancements in Large Reasoning…

计算与语言 · 计算机科学 2025-05-27 Yongshi Ye , Biao Fu , Chongxuan Huang , Yidong Chen , Xiaodong Shi

While large language models (LLMs) have demonstrated remarkable performance on high-level semantic tasks, they often struggle with fine-grained, token-level understanding and structural reasoning--capabilities that are essential for…

计算与语言 · 计算机科学 2025-08-08 Chenzhuo Zhao , Xinda Wang , Yue Huang , Junting Lu , Ziqian Liu

State-of-the-art models in NLP are now predominantly based on deep neural networks that are opaque in terms of how they come to make predictions. This limitation has increased interest in designing more interpretable deep models for NLP…

计算与语言 · 计算机科学 2020-04-27 Jay DeYoung , Sarthak Jain , Nazneen Fatema Rajani , Eric Lehman , Caiming Xiong , Richard Socher , Byron C. Wallace

End-to-End speech-to-speech translation (S2ST) is generally evaluated with text-based metrics. This means that generated speech has to be automatically transcribed, making the evaluation dependent on the availability and quality of…

The exponential growth of digital content has generated massive textual datasets, necessitating the use of advanced analytical approaches. Large Language Models (LLMs) have emerged as tools that are capable of processing and extracting…

计算与语言 · 计算机科学 2024-05-24 Benjamin M. Ampel , Chi-Heng Yang , James Hu , Hsinchun Chen

Large language models (LLMs) empowered by chain-of-thought reasoning have achieved impressive accuracy on complex tasks but suffer from excessive inference costs and latency when applied uniformly to all problems. We propose SABER…

计算与语言 · 计算机科学 2025-08-15 Kai Zhao , Yanjun Zhao , Jiaming Song , Shien He , Lusheng Zhang , Qiang Zhang , Tianjiao Li

Large Language Models (LLMs) have demonstrated powerful reasoning capabilities through Chain-of-Thought (CoT) in various tasks, yet the inefficiency of token-by-token generation hinders real-world deployment in latency-sensitive recommender…

Enhancing reasoning capabilities remains a central focus in the LLM reasearch community. A promising direction involves requiring models to simulate code execution step-by-step to derive outputs for given inputs. However, as code is often…

计算与语言 · 计算机科学 2025-07-15 Keqin Bao , Nuo Chen , Xiaoyuan Li , Binyuan Hui , Bowen Yu , Fuli Feng , Xiangnan He , Dayiheng Liu

As Large Language Models (LLMs) become increasingly integrated into real-world, autonomous applications, relying on static, pre-annotated references for evaluation poses significant challenges in cost, scalability, and completeness. We…

计算与语言 · 计算机科学 2025-06-23 Sher Badshah , Ali Emami , Hassan Sajjad

Evaluating large language models (LLMs) on final-answer correctness is the dominant paradigm. This approach, however, provides a coarse signal for model improvement and overlooks the quality of the underlying reasoning process. We argue…

人工智能 · 计算机科学 2025-10-24 Heejin Do , Jaehui Hwang , Dongyoon Han , Seong Joon Oh , Sangdoo Yun

Test-time scaling (TTS) has enhanced the performance of Reasoning Models (RMs) on various tasks such as math and coding, yet its efficacy in machine translation (MT) remains underexplored. This paper investigates whether increased…

计算与语言 · 计算机科学 2026-01-13 Zihao Li , Shaoxiong Ji , Jörg Tiedemann

Recent advancements in reasoning-enhanced large language models (LLMs), such as DeepSeek-R1 and OpenAI-o3, have demonstrated significant progress. However, their application in professional medical contexts remains underexplored,…

计算与语言 · 计算机科学 2025-03-11 Pengcheng Qiu , Chaoyi Wu , Shuyu Liu , Weike Zhao , Zhuoxia Chen , Hongfei Gu , Chuanjin Peng , Ya Zhang , Yanfeng Wang , Weidi Xie
‹ 上一页 1 2 3 10 下一页 ›