中文
相关论文

相关论文: Enhanced Language Model Truthfulness with Learnabl…

200 篇论文

Neural language models (LMs) have achieved impressive results on various language-based reasoning tasks by utilizing latent knowledge encoded in their own pretrained parameters. To make this reasoning process more explicit, recent works…

计算与语言 · 计算机科学 2023-04-10 Peifeng Wang , Aaron Chan , Filip Ilievski , Muhao Chen , Xiang Ren

Large language models (LLMs) enable in-context learning (ICL) by conditioning on a few labeled training examples as a text-based prompt, eliminating the need for parameter updates and achieving competitive performance. In this paper, we…

计算与语言 · 计算机科学 2024-04-02 Jianing Wang , Chengyu Wang , Chuanqi Tan , Jun Huang , Ming Gao

Large Language Models (LLMs) have achieved remarkable success across various industries due to their exceptional generative capabilities. However, for safe and effective real-world deployments, ensuring honesty and helpfulness is critical.…

计算与语言 · 计算机科学 2024-12-12 Chujie Gao , Siyuan Wu , Yue Huang , Dongping Chen , Qihui Zhang , Zhengyan Fu , Yao Wan , Lichao Sun , Xiangliang Zhang

This work presents a novel systematic methodology to analyse the capabilities and limitations of Large Language Models (LLMs) with feedback from a formal inference engine, on logic theory induction. The analysis is complexity-graded w.r.t.…

计算与语言 · 计算机科学 2025-01-15 João Pedro Gandarela , Danilo S. Carvalho , André Freitas

Large Language Models (LLMs) in multi-turn conversations often suffer from a ``lost-in-conversation'' phenomenon, where they struggle to recover from early incorrect assumptions, particularly when users provide ambiguous initial…

计算与语言 · 计算机科学 2026-01-23 Zhebo Wang , Xiaohu Mu , Zijie Zhou , Mohan Li , Wenpeng Xing , Dezhang Kong , Meng Han

Ensuring contextual faithfulness in retrieval-augmented large language models (LLMs) is crucial for building trustworthy information-seeking systems, particularly in long-form question-answering (LFQA) scenarios. In this work, we identify a…

Large Language Models (LLMs) are able to improve their responses when instructed to do so, a capability known as self-correction. When instructions provide only the task's goal without specific details about potential issues in the…

计算与语言 · 计算机科学 2024-11-11 Guangliang Liu , Haitao Mao , Bochuan Cao , Zhiyu Xue , Xitong Zhang , Rongrong Wang , Jiliang Tang , Kristen Johnson

Large Language Models (LLMs) possess general world knowledge but often struggle to generate precise predictions in structured, domain-specific contexts such as simulations. These limitations arise from their inability to ground their broad,…

人工智能 · 计算机科学 2026-01-30 Guillaume Levy , Cedric Colas , Pierre-Yves Oudeyer , Thomas Carta , Clement Romac

Intent detection is a critical component of task-oriented dialogue systems (TODS) which enables the identification of suitable actions to address user utterances at each dialog turn. Traditional approaches relied on computationally…

计算与语言 · 计算机科学 2024-10-03 Gaurav Arora , Shreya Jain , Srujana Merugu

Large language models (LLMs) have shown strong capabilities, enabling concise, context-aware answers in question answering (QA) tasks. The lack of transparency in complex LLMs has inspired extensive research aimed at developing methods to…

计算与语言 · 计算机科学 2025-09-22 Yangyi Li , Mengdi Huai

Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further…

计算与语言 · 计算机科学 2024-03-22 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

As Large Language Models (LLMs) continue to advance, they are increasingly relied upon as real-time sources of information by non-expert users. To ensure the factuality of the information they provide, much research has focused on…

计算与语言 · 计算机科学 2025-04-07 Yining Wang , Yuquan Wang , Xi Li , Mi Zhang , Geng Hong , Min Yang

Numerous decision-making tasks require estimating causal effects under interventions on different parts of a system. As practitioners consider using large language models (LLMs) to automate decisions, studying their causal reasoning…

机器学习 · 计算机科学 2024-12-24 Tejas Kasetty , Divyat Mahajan , Gintare Karolina Dziugaite , Alexandre Drouin , Dhanya Sridhar

Large Language Models (LLMs) are increasingly deployed for clinical reasoning tasks, which inherently require eliciting calibrated probabilistic beliefs based on available evidence. However, real-world clinical data are frequently…

人工智能 · 计算机科学 2026-03-19 Yuta Kobayashi , Vincent Jeanselme , Shalmali Joshi

Although Large Language Models (LLMs) have demonstrated extraordinary capabilities in many domains, they still have a tendency to hallucinate and generate fictitious responses to user requests. This problem can be alleviated by augmenting…

信息检索 · 计算机科学 2023-06-09 Jiongnan Liu , Jiajie Jin , Zihan Wang , Jiehan Cheng , Zhicheng Dou , Ji-Rong Wen

Recent studies have indicated that Large Language Models (LLMs) harbor an inherent understanding of truthfulness, yet often fail to consistently express it and generate false statements. This gap between "knowing" and "telling" poses a…

计算与语言 · 计算机科学 2025-02-27 Tianlong Wang , Xianfeng Jiao , Yinghao Zhu , Zhongzhi Chen , Yifan He , Xu Chu , Junyi Gao , Yasha Wang , Liantao Ma

Large Language Models (LLMs) are increasingly deployed in business-critical domains such as finance, education, healthcare, and customer support, where users expect consistent and reliable recommendations. Yet LLMs often exhibit variability…

机器学习 · 计算机科学 2026-04-20 Sonal Prabhune , Balaji Padmanabhan , Kaushik Dutta

Large Language Models (LLMs) acquire extensive knowledge and remarkable abilities from extensive text corpora, making them powerful tools for various applications. To make LLMs more usable, aligning them with human preferences is essential.…

计算与语言 · 计算机科学 2024-10-21 Mozhi Zhang , Pengyu Wang , Chenkun Tan , Mianqiu Huang , Dong Zhang , Yaqian Zhou , Xipeng Qiu

Truthfulness (adherence to factual accuracy) and utility (satisfying human needs and instructions) are both fundamental aspects of Large Language Models, yet these goals often conflict (e.g., sell a car with known flaws), which makes it…

人工智能 · 计算机科学 2025-04-29 Zhe Su , Xuhui Zhou , Sanketh Rangreji , Anubha Kabra , Julia Mendelsohn , Faeze Brahman , Maarten Sap

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

计算与语言 · 计算机科学 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla