English
Related papers

Related papers: Unlocking Latent Discourse Translation in LLMs Thr…

200 papers

Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level…

Computation and Language · Computer Science 2024-01-17 Yachao Li , Junhui Li , Jing Jiang , Min Zhang

Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known…

Computation and Language · Computer Science 2024-04-16 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Knowledge conflict arises from discrepancies between information in the context of a large language model (LLM) and the knowledge stored in its parameters. This can hurt performance when using standard decoding techniques, which tend to…

Computation and Language · Computer Science 2025-04-30 Han Wang , Archiki Prasad , Elias Stengel-Eskin , Mohit Bansal

This paper presents a comprehensive evaluation of the capabilities of Large Language Models (LLMs) in metaphor interpretation across multiple datasets, tasks, and prompt configurations. Although metaphor processing has gained significant…

Computation and Language · Computer Science 2025-07-22 Elisa Sanchez-Bayona , Rodrigo Agerri

Large language models (LLMs) often benefit from intermediate steps of reasoning to generate answers to complex problems. When these intermediate steps of reasoning are used to monitor the activity of the model, it is essential that this…

Machine Learning · Computer Science 2023-11-02 Fabien Roger , Ryan Greenblatt

Concepts play a pivotal role in various human cognitive functions, including learning, reasoning and communication. However, there is very little work on endowing machines with the ability to form and reason with concepts. In particular,…

Computation and Language · Computer Science 2023-11-06 Chen Shani , Jilles Vreeken , Dafna Shahaf

Contemporary translation engines based on the encoder-decoder framework have made significant strides in development. However, the emergence of Large Language Models (LLMs) has disrupted their position by presenting the potential for…

Computation and Language · Computer Science 2024-05-28 Jiali Zeng , Fandong Meng , Yongjing Yin , Jie Zhou

The paper describes a system that uses large language model (LLM) technology to support the automatic learning of new entries in an intelligent agent's semantic lexicon. The process is bootstrapped by an existing non-toy lexicon and a…

Computation and Language · Computer Science 2023-12-29 Sanjay Oruganti , Sergei Nirenburg , Jesse English , Marjorie McShane

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

Computation and Language · Computer Science 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

The emergent few-shot reasoning capabilities of Large Language Models (LLMs) have excited the natural language and machine learning community over recent years. Despite of numerous successful applications, the underlying mechanism of such…

Computation and Language · Computer Science 2023-06-09 Xiaojuan Tang , Zilong Zheng , Jiaqi Li , Fanxu Meng , Song-Chun Zhu , Yitao Liang , Muhan Zhang

Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA…

Computation and Language · Computer Science 2025-09-23 Chuangtao Ma , Yongrui Chen , Tianxing Wu , Arijit Khan , Haofen Wang

Large language models (LLMs) demonstrate remarkable text comprehension and generation capabilities but often lack the ability to utilize up-to-date or domain-specific knowledge not included in their training data. To address this gap, we…

Computation and Language · Computer Science 2025-09-26 Bo Zhang , Hui Ma , Dailin Li , Jian Ding , Jian Wang , Bo Xu , HongFei Lin

Discourse understanding is essential for many NLP tasks, yet most existing work remains constrained by framework-dependent discourse representations. This work investigates whether large language models (LLMs) capture discourse knowledge…

Computation and Language · Computer Science 2025-06-05 Florian Eichin , Yang Janet Liu , Barbara Plank , Michael A. Hedderich

In task-oriented conversational AI evaluation, unsupervised methods poorly correlate with human judgments, and supervised approaches lack generalization. Recent advances in large language models (LLMs) show robust zeroshot and few-shot…

Computation and Language · Computer Science 2024-06-26 Jinghan Jia , Abi Komma , Timothy Leffel , Xujun Peng , Ajay Nagesh , Tamer Soliman , Aram Galstyan , Anoop Kumar

Large language models (LLMs) demonstrate remarkable ability in cross-lingual tasks. Understanding how LLMs acquire this ability is crucial for their interpretability. To quantify the cross-lingual ability of LLMs accurately, we propose a…

Computation and Language · Computer Science 2025-05-23 Kaiyu He , Tong Zhou , Yubo Chen , Delai Qiu , Shengping Liu , Kang Liu , Jun Zhao

Large language models have demonstrated exceptional capability in natural language understanding and generation. However, their generation speed is limited by the inherently sequential nature of their decoding process, posing challenges for…

Computation and Language · Computer Science 2024-05-27 Chenxi Sun , Hongzhi Zhang , Zijia Lin , Jingyuan Zhang , Fuzheng Zhang , Zhongyuan Wang , Bin Chen , Chengru Song , Di Zhang , Kun Gai , Deyi Xiong

Large Language Models (LLMs) have demonstrated remarkable progress in scaling to access massive contexts. However, the access is via the latent and uninterpretable attention mechanisms, and LLMs fail to effective process long context,…

Computation and Language · Computer Science 2026-03-24 Weili Cao , Xunjian Yin , Bhuwan Dhingra , Shuyan Zhou

Although proper handling of discourse significantly contributes to the quality of machine translation (MT), these improvements are not adequately measured in common translation quality metrics. Recent works in context-aware MT attempt to…

Computation and Language · Computer Science 2023-06-28 Patrick Fernandes , Kayo Yin , Emmy Liu , André F. T. Martins , Graham Neubig

Recent advancements in multimodal large reasoning models (MLRMs) have significantly improved performance in visual question answering. However, we observe that transition words (e.g., because, however, and wait) are closely associated with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhongxing Xu , Zhonghua Wang , Zhe Qian , Dachuan Shi , Feilong Tang , Ming Hu , Shiyan Su , Xiaocheng Zou , Wei Feng , Dwarikanath Mahapatra , Yifan Peng , Mingquan Lin , Zongyuan Ge

Over the past few years, the abilities of large language models (LLMs) have received extensive attention, which have performed exceptionally well in complicated scenarios such as logical reasoning and symbolic inference. A significant…

Computation and Language · Computer Science 2024-02-20 Junbing Yan , Chengyu Wang , Jun Huang , Wei Zhang