中文
相关论文

相关论文: TASER: Translation Assessment via Systematic Evalu…

200 篇论文

Cross-modal reasoning (CMR), the intricate process of synthesizing and drawing inferences across divergent sensory modalities, is increasingly recognized as a crucial capability in the progression toward more sophisticated and…

计算与语言 · 计算机科学 2024-10-01 Shengsheng Qian , Zuyi Zhou , Dizhan Xue , Bing Wang , Changsheng Xu

Large language models (LLMs) demonstrate strong chain-of-thought (CoT) reasoning abilities, while smaller models (<= 3B parameters) significantly underperform on multi-step reasoning tasks. Based on empirical analyses of the Qwen-2.5 model…

人工智能 · 计算机科学 2026-05-29 Yang Ouyang , Shuhang Lin , Jung-Eun Kim

Evaluating machine translation (MT) for low-resource languages poses a persistent challenge, primarily due to the limited availability of high quality reference translations. This issue is further exacerbated in languages with multiple…

计算与语言 · 计算机科学 2025-05-20 Md. Atiqur Rahman , Sabrina Islam , Mushfiqul Haque Omi

Large Language Model (LLM)-based applications are increasingly deployed across various domains, including customer service, education, and mobility. However, these systems are prone to inaccurate, fictitious, or harmful responses, and their…

软件工程 · 计算机科学 2026-01-06 Lev Sorokin , Ivan Vasilev , Ken E. Friedl , Andrea Stocco

Eliciting explicit, step-by-step reasoning traces from large language models (LLMs) has emerged as a dominant paradigm for enhancing model capabilities. Although such reasoning strategies were originally designed for problems requiring…

计算与语言 · 计算机科学 2026-03-23 Xinyu Guo , Yazhou Zhang , Jing Qin

Large Language Models (LLMs) have demonstrated improved generation performance by incorporating externally retrieved knowledge, a process known as retrieval-augmented generation (RAG). Despite the potential of this approach, existing…

计算与语言 · 计算机科学 2025-11-24 Lu Dai , Yijie Xu , Jinhui Ye , Hao Liu , Hui Xiong

Despite the remarkable coherence of Large Language Models (LLMs), existing evaluation methods often suffer from fluency bias and rely heavily on multiple-choice formats, making it difficult to assess factual accuracy and complex reasoning…

计算与语言 · 计算机科学 2025-01-03 Raymond Bernard , Shaina Raza , Subhabrata Das , Rahul Murugan

Entity Linking (EL) has traditionally relied on large annotated datasets and extensive model fine-tuning. While recent few-shot methods leverage large language models (LLMs) through prompting to reduce training requirements, they often…

计算与语言 · 计算机科学 2025-11-20 Yajie Li , Albert Galimov , Mitra Datta Ganapaneni , Pujitha Thejaswi , De Meng , Priyanshu Kumar , Saloni Potdar

Simultaneous machine translation (SMT) takes streaming input utterances and incrementally produces target text. Existing SMT methods mainly use the partial utterance that has already arrived at the input and the generated hypothesis.…

计算与语言 · 计算机科学 2025-06-03 Siqi Ouyang , Oleksii Hrinchuk , Zhehuai Chen , Vitaly Lavrukhin , Jagadeesh Balam , Lei Li , Boris Ginsburg

Large Language Models (LLMs) are increasingly deployed in critical applications requiring reliable reasoning, yet their internal reasoning processes remain difficult to evaluate systematically. Existing methods focus on final-answer…

机器学习 · 计算机科学 2026-02-03 Shaima Ahmad Freja , Ferhat Ozgur Catak , Betul Yurdem , Chunming Rong

With an increasing number of parameters and pre-training data, generative large language models (LLMs) have shown remarkable capabilities to solve tasks with minimal or no task-related examples. Notably, LLMs have been successfully employed…

计算与语言 · 计算机科学 2023-10-31 Christoph Leiter , Juri Opitz , Daniel Deutsch , Yang Gao , Rotem Dror , Steffen Eger

Table reasoning tasks have shown remarkable progress with the development of large language models (LLMs), which involve interpreting and drawing conclusions from tabular data based on natural language (NL) questions. Existing solutions…

计算与语言 · 计算机科学 2024-10-11 Yuan Sui , Jiaru Zou , Mengyu Zhou , Xinyi He , Lun Du , Shi Han , Dongmei Zhang

Machine translation quality has steadily improved over the years, achieving near-perfect translations in recent benchmarks. These high-quality outputs make it difficult to distinguish between state-of-the-art models and to identify areas…

计算与语言 · 计算机科学 2025-08-29 Lorenzo Proietti , Stefano Perrella , Vilém Zouhar , Roberto Navigli , Tom Kocmi

Large Language Models (LLMs) have shown strong capabilities in document re-ranking, a key component in modern Information Retrieval (IR) systems. However, existing LLM-based approaches face notable limitations, including ranking…

信息检索 · 计算机科学 2025-10-03 Pinhuan Wang , Zhiqiu Xia , Chunhua Liao , Feiyi Wang , Hang Liu

Large language models excel at complex tasks by breaking down problems into structured reasoning steps. However, reasoning traces often extend beyond reaching a correct answer, causing wasted computation, reduced readability, and…

计算与语言 · 计算机科学 2025-05-26 Razvan-Gabriel Dumitru , Darius Peteleaza , Vikas Yadav , Liangming Pan

Large reasoning models (LRMs) enhance problem-solving capabilities by generating explicit multi-step chains of thought (CoT) reasoning; however, they incur substantial inference latency and computational overhead. To mitigate this issue,…

人工智能 · 计算机科学 2026-04-21 Jiayi Tian , Yupeng Su , Ryan Solgi , Souvik Kundu , Zheng Zhang

Evaluation of large language model (LLM) outputs requires users to make critical judgments about the best outputs across various configurations. This process is costly and takes time given the large amounts of data. LLMs are increasingly…

Large language models (LLMs) have demonstrated remarkable progress in reasoning, often through supervised fine-tuning (SFT). However, SFT is resource-intensive, relying on large curated datasets, rejection-sampled demonstrations, and…

计算与语言 · 计算机科学 2026-05-22 Jingyuan Wang , Yankai Chen , Zhonghang Li , Chao Huang

Large language models (LLMs) solve reasoning problems by first generating a rationale and then answering. We formalize reasoning as a latent variable model and derive a reward-based filtered expectation-maximization (FEM) objective for…

机器学习 · 计算机科学 2026-02-03 Junghyun Lee , Branislav Kveton , Anup Rao , Subhojyoti Mukherjee , Ryan A. Rossi , Sunav Choudhary , Alexa Siu

In this paper, we investigate the usage of large language models (LLMs) to improve the performance of competitive speech recognition systems. Different from previous LLM-based ASR error correction methods, we propose a novel multi-stage…

计算与语言 · 计算机科学 2024-06-18 Jie Pu , Thai-Son Nguyen , Sebastian Stüker