中文
相关论文

相关论文: When Do LLMs Need Retrieval Augmentation? Mitigati…

200 篇论文

Large Language Models (LLMs) have shown great potential in Natural Language Processing (NLP) tasks. However, recent literature reveals that LLMs generate nonfactual responses intermittently, which impedes the LLMs' reliability for further…

计算与语言 · 计算机科学 2024-03-22 Yukun Zhao , Lingyong Yan , Weiwei Sun , Guoliang Xing , Chong Meng , Shuaiqiang Wang , Zhicong Cheng , Zhaochun Ren , Dawei Yin

In order to be deployed safely, Large Language Models (LLMs) must be capable of dynamically adapting their behavior based on their level of knowledge and uncertainty associated with specific topics. This adaptive behavior, which we refer to…

计算与语言 · 计算机科学 2024-07-04 Alexandre Piché , Aristides Milios , Dzmitry Bahdanau , Chris Pal

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly…

计算与语言 · 计算机科学 2024-06-18 Shuting Wang , Jiongnan Liu , Shiren Song , Jiehan Cheng , Yuqi Fu , Peidong Guo , Kun Fang , Yutao Zhu , Zhicheng Dou

Large Language Models (LLMs) often struggle with hallucinations and outdated information. To address this, Information Retrieval (IR) systems can be employed to augment LLMs with up-to-date knowledge. However, existing IR techniques contain…

计算与语言 · 计算机科学 2024-11-26 Danupat Khamnuansin , Tawunrat Chalothorn , Ekapol Chuangsuwanich

In the age of misinformation, hallucination - the tendency of Large Language Models (LLMs) to generate non-factual or unfaithful responses - represents the main risk for their global utility. Despite LLMs becoming increasingly multilingual,…

计算与语言 · 计算机科学 2026-02-03 Saad Obaid ul Islam , Anne Lauscher , Goran Glavaš

Large Language Models (LLMs) are powerful computational models trained on extensive corpora of human-readable text, enabling them to perform general-purpose language understanding and generation. LLMs have garnered significant attention in…

计算与语言 · 计算机科学 2024-10-28 Liam Barkley , Brink van der Merwe

Large Language Models (LLMs) have exhibited impressive generation capabilities, but they suffer from hallucinations when solely relying on their internal knowledge, especially when answering questions that require less commonly known…

计算与语言 · 计算机科学 2023-11-01 Wenting Zhao , Ye Liu , Tong Niu , Yao Wan , Philip S. Yu , Shafiq Joty , Yingbo Zhou , Semih Yavuz

Retrieval-Augmented Generation (RAG) has emerged as a powerful framework to improve factuality in large language models (LLMs) by grounding their outputs in retrieved documents. However, ensuring perfect retrieval of relevant information…

计算与语言 · 计算机科学 2025-12-04 Zhan Peng Lee , Andre Lin , Calvin Tan

Large Language Models (LLMs) are emerging as promising approaches to enhance session-based recommendation (SBR), where both prompt-based and fine-tuning-based methods have been widely investigated to align LLMs with SBR. However, the former…

人工智能 · 计算机科学 2024-04-22 Ziyan Wang , Yingpeng Du , Zhu Sun , Haoyan Chua , Kaidong Feng , Wenya Wang , Jie Zhang

Query expansion is a long-standing technique to mitigate vocabulary mismatch in ad hoc Information Retrieval. Pseudo-relevance feedback methods, such as RM3, estimate an expanded query model from the top-ranked documents, but remain…

信息检索 · 计算机科学 2026-01-19 David Otero , Javier Parapar

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

计算与语言 · 计算机科学 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

Large Language Models (LLMs) have achieved excellent performances in various tasks. However, fine-tuning an LLM requires extensive supervision. Human, on the other hand, may improve their reasoning abilities by self-thinking without…

计算与语言 · 计算机科学 2022-10-26 Jiaxin Huang , Shixiang Shane Gu , Le Hou , Yuexin Wu , Xuezhi Wang , Hongkun Yu , Jiawei Han

Retrieval-augmented generation (RAG) empowers large language models (LLMs) to utilize external knowledge sources. The increasing capacity of LLMs to process longer input sequences opens up avenues for providing more retrieved information,…

计算与语言 · 计算机科学 2024-10-10 Bowen Jin , Jinsung Yoon , Jiawei Han , Sercan O. Arik

Human relevance assessment is time-consuming and cognitively intensive, limiting the scalability of Information Retrieval evaluation. This has led to growing interest in using large language models (LLMs) as proxies for human judges.…

信息检索 · 计算机科学 2026-04-28 Chuting Yu , Hang Li , Guido Zuccon , Joel Mackenzie , Teerapong Leelanupab

A major barrier towards the practical deployment of large language models (LLMs) is their lack of reliability. Three situations where this is particularly apparent are correctness, hallucinations when given unanswerable questions, and…

计算与语言 · 计算机科学 2024-04-18 Christian Tomani , Kamalika Chaudhuri , Ivan Evtimov , Daniel Cremers , Mark Ibrahim

Recent studies have demonstrated that large language models (LLMs) exhibit significant biases in evaluation tasks, particularly in preferentially rating and favoring self-generated content. However, the extent to which this bias manifests…

计算与语言 · 计算机科学 2025-12-09 Yen-Shan Chen , Jing Jin , Peng-Ting Kuo , Chao-Wei Huang , Yun-Nung Chen

The lack of domain-specific data in the pre-training of Large Language Models (LLMs) severely limits LLM-based decision systems in specialized applications, while post-training a model in the scenarios requires significant computational…

人工智能 · 计算机科学 2025-05-05 Zongyuan Li , Pengfei Li , Runnan Qi , Yanan Ni , Lumin Jiang , Hui Wu , Xuebo Zhang , Kuihua Huang , Xian Guo

Large language models (LLMs) often produce confident yet incorrect answers, which can lead to risky failures in real-world applications. We study whether post-training can make a model's self-assessment explicit: when the model is…

机器学习 · 计算机科学 2026-05-15 Junyu Guo , Shangding Gu , Ming Jin , Costas Spanos , Javad Lavaei

Large Reasoning Models (LRMs) have demonstrated remarkable problem-solving abilities in mathematics, as evaluated by existing benchmarks exclusively on well-defined problems. However, such evaluation setup constitutes a critical gap, since…

人工智能 · 计算机科学 2025-08-18 Youcheng Huang , Bowen Qin , Chen Huang , Duanyu Feng , Xi Yang , Wenqiang Lei

Enabling large language models (LLMs) to appropriately abstain from answering questions beyond their knowledge is crucial for mitigating hallucinations. While existing reinforcement learning methods foster autonomous abstention, they often…

机器学习 · 计算机科学 2026-04-28 Cheng Gao , Cheng Huang , Kangyang Luo , Ziqing Qiao , Shuzheng Si , Huimin Chen , Chaojun Xiao , Maosong Sun