English
Related papers

Related papers: Harnessing RLHF for Robust Unanswerability Recogni…

200 papers

Machine unlearning offers a promising solution to privacy and safety concerns in large language models (LLMs) by selectively removing targeted knowledge while preserving utility. However, current methods are highly sensitive to downstream…

Performance of spoken language understanding (SLU) can be degraded with automatic speech recognition (ASR) errors. We propose a novel approach to improve SLU robustness by randomly corrupting clean training text with an ASR error simulator,…

Computation and Language · Computer Science 2022-11-09 Yik-Cheung Tam , Jiacheng Xu , Jiakai Zou , Zecheng Wang , Tinglong Liao , Shuhan Yuan

Reinforcement Learning from Human Feedback (RLHF) aligns Large Language Models (LLMs) with human preferences, yet the underlying reward signals they internalize remain hidden, posing a critical challenge for interpretability and safety.…

Machine Learning · Computer Science 2026-01-21 Nyal Patel , Matthieu Bou , Arjun Jagota , Satyapriya Krishna , Sonali Parbhoo

Hallucinations present a significant challenge for large language models (LLMs). The utilization of parametric knowledge in generating factual content is constrained by the limited knowledge of LLMs, potentially resulting in internal…

Computation and Language · Computer Science 2025-10-07 Hanxing Ding , Liang Pang , Zihao Wei , Huawei Shen , Xueqi Cheng

We evaluate the ability of Large Language Models (LLMs) to discern and express their internal knowledge state, a key factor in countering factual hallucination and ensuring reliable application of LLMs. We observe a robust self-awareness of…

Computation and Language · Computer Science 2024-01-30 Yuxin Liang , Zhuoyang Song , Hao Wang , Jiaxing Zhang

Spoken Language Understanding (SLU) plays a crucial role in speech-centric multimedia applications, enabling machines to comprehend spoken language in scenarios such as meetings, interviews, and customer service interactions. SLU…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-18 Zhichao Sheng , Shilin Zhou , Chen Gong , Zhenghua Li

Assessing and enhancing human learning through question-answering is vital, yet automating this process remains challenging. While large language models (LLMs) excel at summarization and query responses, their ability to generate meaningful…

Computation and Language · Computer Science 2025-02-25 Kimia Noorbakhsh , Joseph Chandler , Pantea Karimi , Mohammad Alizadeh , Hari Balakrishnan

Large language models (LLMs) exhibit enhanced capabilities in language understanding and generation. By utilizing their embedded knowledge, LLMs are increasingly used as conversational recommender systems (CRS), achieving improved…

Information Retrieval · Computer Science 2026-04-14 Zhenrui Yue , Honglei Zhuang , Zhen Qin , Zhankui He , Huimin Zeng , Julian McAuley , Dong Wang

Retrieval-augmented generation (RAG) appears as a promising method to alleviate the "hallucination" problem in large language models (LLMs), since it can incorporate external traceable resources for response generation. The essence of RAG…

Computation and Language · Computer Science 2024-10-16 Haosheng Qian , Yixing Fan , Ruqing Zhang , Jiafeng Guo

Large Language Models (LLMs) have gained widespread adoption in various natural language processing tasks, including question answering and dialogue systems. However, a major drawback of LLMs is the issue of hallucination, where they…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Qiang Fu , Yichen Yuan , Zhihao Wen , Ge Fan , Dayiheng Liu , Dongmei Zhang , Zhixu Li , Yanghua Xiao

Hallucinations in large language model (LLM) outputs severely limit their reliability in knowledge-intensive tasks such as question answering. To address this challenge, we introduce REFIND (Retrieval-augmented Factuality hallucINation…

Computation and Language · Computer Science 2025-04-09 DongGeon Lee , Hwanjo Yu

Bearing in mind the limited parametric knowledge of Large Language Models (LLMs), retrieval-augmented generation (RAG) which supplies them with the relevant external knowledge has served as an approach to mitigate the issue of…

Computation and Language · Computer Science 2025-01-10 Hanna Zubkova , Ji-Hoon Park , Seong-Whan Lee

Large Language Models (LLMs) are notorious for blending fact with fiction and generating non-factual content, known as hallucinations. To address this challenge, we propose an interactive system that helps users gain insight into the…

Human-Computer Interaction · Computer Science 2024-04-05 Furui Cheng , Vilém Zouhar , Simran Arora , Mrinmaya Sachan , Hendrik Strobelt , Mennatallah El-Assady

Large Language Models (LLMs) have shown remarkable capabilities across diverse tasks, yet they face inherent limitations such as constrained parametric knowledge and high retraining costs. Retrieval-Augmented Generation (RAG) augments the…

Information Retrieval · Computer Science 2025-08-26 Leqian Li , Dianxi Shi , Jialu Zhou , Xinyu Wei , Mingyue Yang , Songchang Jin , Shaowu Yang

The increase in computing power and the necessity of AI-assisted decision-making boost the growing application of large language models (LLMs). Along with this, the potential retention of sensitive data of LLMs has spurred increasing…

Computation and Language · Computer Science 2026-04-20 Chenchen Tan , Youyang Qu , Xinghao Li , Hui Zhang , Shujie Cui , Cunjian Chen , Longxiang Gao

Large language models (LLMs) are increasingly deployed as multi-step decision-making agents, where effective reward design is essential for guiding learning. Although recent work explores various forms of reward shaping and step-level…

Machine Learning · Computer Science 2026-02-26 Dengjia Zhang , Xiaoou Liu , Lu Cheng , Yaqing Wang , Kenton Murray , Hua Wei

Recently, multimodal large language models (MLLMs) have demonstrated strong visual understanding and decision-making capabilities, enabling the exploration of autonomously improving MLLMs in unknown environments. However, external feedback…

Machine Learning · Computer Science 2024-10-07 Boyu Li , Haobin Jiang , Ziluo Ding , Xinrun Xu , Haoran Li , Dongbin Zhao , Zongqing Lu

The deployment of large language models (LLMs) like ChatGPT and Gemini has shown their powerful natural language generation capabilities. However, these models can inadvertently learn and retain sensitive information and harmful content…

Cryptography and Security · Computer Science 2025-10-14 Shang Wang , Tianqing Zhu , Dayong Ye , Wanlei Zhou

Generative AI models face the challenge of hallucinations that can undermine users' trust in such systems. We approach the problem of conversational information seeking as a two-step process, where relevant passages in a corpus are…

Information Retrieval · Computer Science 2024-01-23 Weronika Łajewska , Krisztian Balog

Large Language Models (LLMs) showcase impressive capabilities but encounter challenges like hallucination, outdated knowledge, and non-transparent, untraceable reasoning processes. Retrieval-Augmented Generation (RAG) has emerged as a…

Computation and Language · Computer Science 2024-03-28 Yunfan Gao , Yun Xiong , Xinyu Gao , Kangxiang Jia , Jinliu Pan , Yuxi Bi , Yi Dai , Jiawei Sun , Meng Wang , Haofen Wang