English
Related papers

Related papers: Context-faithful Prompting for Large Language Mode…

200 papers

Large language models (LLMs) have shown success in generating high-quality responses. In order to achieve better alignment with LLMs with human preference, various works are proposed based on specific optimization process, which, however,…

Computation and Language · Computer Science 2024-09-04 Zhuo Li , Yuhao Du , Jinpeng Hu , Xiang Wan , Anningzhe Gao

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

Software Engineering · Computer Science 2026-04-07 Rabia Iftikhar , Andreas Rausch

Factual knowledge extraction aims to explicitly extract knowledge parameterized in pre-trained language models for application in downstream tasks. While prior work has been investigating the impact of supervised fine-tuning data on the…

Computation and Language · Computer Science 2025-05-30 Xuan Gong , Hanbo Huang , Shiyu Liang

Large language models (LLMs) can be controlled at inference time through prompts (in-context learning) and internal activations (activation steering). Different accounts have been proposed to explain these methods, yet their common goal of…

Machine Learning · Computer Science 2026-03-13 Eric Bigelow , Daniel Wurgaft , YingQiao Wang , Noah Goodman , Tomer Ullman , Hidenori Tanaka , Ekdeep Singh Lubana

Prevailing large language models (LLMs) are capable of human responses simulation through its unprecedented content generation and reasoning abilities. However, it is not clear whether and how to leverage LLMs to simulate field experiments.…

Artificial Intelligence · Computer Science 2024-08-20 Yaoyu Chen , Yuheng Hu , Yingda Lu

Large Language Models (LLMs) have demonstrated remarkable capabilities in many real-world applications. Nonetheless, LLMs are often criticized for their tendency to produce hallucinations, wherein the models fabricate incorrect statements…

Computation and Language · Computer Science 2024-06-05 Qinggang Zhang , Junnan Dong , Hao Chen , Daochen Zha , Zailiang Yu , Xiao Huang

Reinforcement learning (RL) is a promising approach for aligning large language models (LLMs) knowledge with sequential decision-making tasks. However, few studies have thoroughly investigated the impact on LLM agents capabilities of…

Large Language Models (LLMs) have demonstrated remarkable proficiency across diverse tasks, exhibiting emergent properties such as semantic prompt comprehension, In-Context Learning (ICL), and Chain-of-Thought (CoT) reasoning. Despite their…

Computation and Language · Computer Science 2026-03-13 Yuling Jiao , Yanming Lai , Huazhen Lin , Wensen Ma , Houduo Qi , Defeng Sun

Despite the dramatic progress in Large Language Model (LLM) development, LLMs often provide seemingly plausible but not factual information, often referred to as hallucinations. Retrieval-augmented LLMs provide a non-parametric approach to…

Computation and Language · Computer Science 2023-11-09 Sai Munikoti , Anurag Acharya , Sridevi Wagle , Sameera Horawalavithana

Large Language Models (LLMs) are increasingly used for accessing information on the web. Their truthfulness and factuality are thus of great interest. To help users make the right decisions about the information they get, LLMs should not…

Computation and Language · Computer Science 2024-04-03 Chenglei Si , Navita Goyal , Sherry Tongshuang Wu , Chen Zhao , Shi Feng , Hal Daumé , Jordan Boyd-Graber

A critical component in the trustworthiness of LLMs is reliable uncertainty communication, yet LLMs often use assertive language when conveying false claims, leading to over-reliance and eroded trust. We present the first systematic study…

Computation and Language · Computer Science 2025-10-03 Gabrielle Kaili-May Liu , Gal Yona , Avi Caciularu , Idan Szpektor , Tim G. J. Rudner , Arman Cohan

Large Language Models (LLMs) have been widely used as general-purpose AI agents showing comparable performance on many downstream tasks. However, existing work shows that it is challenging for LLMs to integrate structured data (e.g. KG,…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Sungchul Kim , Tong Yu , Ryan A. Rossi , Xiang Chen

Despite the popularity of the large language models (LLMs), their application to machine translation is relatively underexplored, especially in context-aware settings. This work presents a literature review of context-aware translation with…

Computation and Language · Computer Science 2025-06-10 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal

Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provides a unified account…

Computation and Language · Computer Science 2026-04-06 Prakhar Bansal , Shivangi Agarwal

Generating rational and generally accurate responses to tasks, often accompanied by example demonstrations, highlights Large Language Model's (LLM's) remarkable In-Context Learning (ICL) capabilities without requiring updates to the model's…

Machine Learning · Computer Science 2025-06-17 Debanjan Dutta , Faizanuddin Ansari , Swagatam Das

In-context learning (ICL) of large language models (LLMs) has attracted increasing attention in the community where LLMs make predictions only based on instructions augmented with a few examples. Existing example selection methods for ICL…

Computation and Language · Computer Science 2024-08-26 Haowei Du , Dongyan Zhao

Recent studies demonstrated that large language models (LLMs) can excel in many tasks via in-context learning (ICL). However, recent works show that ICL-prompted models tend to produce inaccurate results when presented with adversarial…

Computation and Language · Computer Science 2024-05-21 Xuanli He , Yuxiang Wu , Oana-Maria Camburu , Pasquale Minervini , Pontus Stenetorp

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

Language Models (LMs) acquire parametric knowledge from their training process, embedding it within their weights. The increasing scalability of LMs, however, poses significant challenges for understanding a model's inner workings and…

Computation and Language · Computer Science 2026-03-11 Isabelle Augenstein

Large language models (LLMs) have been found to produce hallucinations when the question exceeds their internal knowledge boundaries. A reliable model should have a clear perception of its knowledge boundaries, providing correct answers…

Computation and Language · Computer Science 2024-08-20 Shiyu Ni , Keping Bi , Lulu Yu , Jiafeng Guo