English
Related papers

Related papers: LLMs' Reading Comprehension Is Affected by Paramet…

200 papers

Ambiguity in natural language poses significant challenges to Large Language Models (LLMs) used for open-domain question answering. LLMs often struggle with the inherent uncertainties of human communication, leading to misinterpretations,…

Computation and Language · Computer Science 2024-11-20 Aryan Keluskar , Amrita Bhattacharjee , Huan Liu

Large Language Models (LLMs) have demonstrated considerable success in open-book question answering (QA), where the task requires generating answers grounded in a provided external context. A critical challenge in open-book QA is to ensure…

Computation and Language · Computer Science 2025-05-02 Ivan Vankov , Matyo Ivanov , Adriana Correia , Victor Botev

Rational speakers are supposed to know what they know and what they do not know, and to generate expressions matching the strength of evidence. In contrast, it is still a challenge for current large language models to generate corresponding…

Computation and Language · Computer Science 2025-06-03 Meng Li , Michael Vrazitulis , David Schlangen

The rise of large language models (LLMs) has significantly impacted various domains, including natural language processing (NLP) and image generation, by making complex computational tasks more accessible. While LLMs demonstrate impressive…

Databases · Computer Science 2024-10-15 Ananya Rahaman , Anny Zheng , Mostafa Milani , Fei Chiang , Rachel Pottinger

With the development of large language models (LLMs) like the GPT series, their widespread use across various application scenarios presents a myriad of challenges. This review initially explores the issue of domain specificity, where LLMs…

Computation and Language · Computer Science 2023-10-23 Xiaoliang Chen , Liangbin Li , Le Chang , Yunhe Huang , Yuxuan Zhao , Yuxiao Zhang , Dinuo Li

Large language models (LLMs) show strong reasoning abilities across diverse tasks, yet their performance on extended contexts remains inconsistent. While prior research has emphasized mid-context degradation in question answering, this…

Computation and Language · Computer Science 2026-02-25 Pietro Bernardelle , Stefano Civelli , Kevin Roitero , Gianluca Demartini

As language models (LMs) become integral to fields like healthcare, law, and journalism, their ability to differentiate between fact, belief, and knowledge is essential for reliable decision-making. Failure to grasp these distinctions can…

Computation and Language · Computer Science 2024-10-29 Mirac Suzgun , Tayfun Gur , Federico Bianchi , Daniel E. Ho , Thomas Icard , Dan Jurafsky , James Zou

Despite their impressive performance on diverse tasks, large language models (LMs) still struggle with tasks requiring rich world knowledge, implying the limitations of relying solely on their parameters to encode a wealth of world…

Computation and Language · Computer Science 2023-07-04 Alex Mallen , Akari Asai , Victor Zhong , Rajarshi Das , Daniel Khashabi , Hannaneh Hajishirzi

While LLMs have revolutionized the field of machine learning due to their high performance on a strikingly wide range of problems, they are also known to hallucinate false answers and underperform on less canonical versions of the same…

Machine Learning · Computer Science 2025-09-11 Kavi Gupta , Kate Sanders , Armando Solar-Lezama

Benchmarking modern large language models (LLMs) on complex and realistic tasks is critical to advancing their development. In this work, we evaluate the factual accuracy and citation performance of state-of-the-art LLMs on the task of…

Computation and Language · Computer Science 2024-12-25 Maya Patel , Aditi Anand

This survey provides an in-depth analysis of knowledge conflicts for large language models (LLMs), highlighting the complex challenges they encounter when blending contextual and parametric knowledge. Our focus is on three categories of…

Computation and Language · Computer Science 2024-06-25 Rongwu Xu , Zehan Qi , Zhijiang Guo , Cunxiang Wang , Hongru Wang , Yue Zhang , Wei Xu

Integrating external knowledge into large language models (LLMs) presents a promising solution to overcome the limitations imposed by their antiquated and static parametric memory. Prior studies, however, have tended to over-reliance on…

Computation and Language · Computer Science 2024-05-30 Hao Zhang , Yuyang Zhang , Xiaoguang Li , Wenxuan Shi , Haonan Xu , Huanshuo Liu , Yasheng Wang , Lifeng Shang , Qun Liu , Yong Liu , Ruiming Tang

Though large language models (LLMs) have enabled great success across a wide variety of tasks, they still appear to fall short of one of the loftier goals of artificial intelligence research: creating an artificial system that can adapt its…

Computation and Language · Computer Science 2026-05-04 Michael A. Lepori , Tal Linzen , Ann Yuan , Katja Filippova

Large Language Models (LLMs) are increasingly embedded in evaluative processes, from information filtering to assessing and addressing knowledge gaps through explanation and credibility judgments. This raises the need to examine how such…

In recent years, large-scale language models (LLMs) have gained attention for their impressive text generation capabilities. However, these models often face the challenge of "hallucination," which undermines their reliability. In this…

Computation and Language · Computer Science 2023-10-10 Yuchen Yang , Houqiang Li , Yanfeng Wang , Yu Wang

As large language models (LLMs) are applied across diverse domains, the ability to selectively unlearn specific information is becoming increasingly essential. For instance, LLMs are expected to selectively provide confidential information…

Computation and Language · Computer Science 2025-06-04 Shota Takashiro , Takeshi Kojima , Andrew Gambardella , Qi Cao , Yusuke Iwasawa , Yutaka Matsuo

Large language models (LLMs) are increasingly used in applications requiring factual accuracy, yet their outputs often contain hallucinated responses. While fact-checking can mitigate these errors, existing methods typically retrieve…

Computation and Language · Computer Science 2026-01-07 Haoran Wang , Maryam Khalid , Qiong Wu , Jian Gao , Cheng Cao

The handling of probabilities in the form of uncertainty or partial information is an essential task for LLMs in many settings and applications. A common approach to evaluate an LLM's probabilistic reasoning capabilities is to assess its…

Artificial Intelligence · Computer Science 2026-02-12 Manuel Mondal , Ljiljana Dolamic , Gérôme Bovet , Philippe Cudré-Mauroux , Julien Audiffren

Humankind's understanding of the world is fundamentally linked to our perception and cognition, with \emph{human languages} serving as one of the major carriers of \emph{world knowledge}. In this vein, \emph{Large Language Models} (LLMs)…

Artificial Intelligence · Computer Science 2024-06-27 Huajun Chen

Large language models (LLMs) have demonstrated impressive capabilities in natural language understanding and generation, but they exhibit problems with logical consistency in the output they generate. How can we harness LLMs' broad-coverage…

Artificial Intelligence · Computer Science 2025-08-04 Bradley P. Allen , Prateek Chhikara , Thomas Macaulay Ferguson , Filip Ilievski , Paul Groth