English
Related papers

Related papers: CRUSH4SQL: Collective Retrieval Using Schema Hallu…

200 papers

Large language models (LLMs) have demonstrated remarkable performance in text generation and knowledge-intensive question answering. Nevertheless, they are prone to producing hallucinated content, which severely undermines their reliability…

Computation and Language · Computer Science 2026-03-09 Shize Liang , Hongzhi Wang

Text-to-SQL is a task that converts a natural language question into a structured query language (SQL) to retrieve information from a database. Large language models (LLMs) work well in natural language generation tasks, but they are not…

Computation and Language · Computer Science 2023-09-04 Chunxi Guo , Zhiliang Tian , Jintao Tang , Pancheng Wang , Zhihua Wen , Kang Yang , Ting Wang

Large language models (LLMs) can generate fluent natural language texts when given relevant documents as background context. This ability has attracted considerable interest in developing industry applications of LLMs. However, LLMs are…

Computation and Language · Computer Science 2023-10-11 Deren Lei , Yaxi Li , Mengya Hu , Mingyu Wang , Vincent Yun , Emily Ching , Eslam Kamal

Recent advances in large language models (LLMs) have greatly improved Text-to-SQL performance for single-table queries. But, it remains challenging in multi-table databases due to complex schema and relational operations. Existing methods…

Computation and Language · Computer Science 2025-05-26 Poojah Ganesan , Rajat Aayush Jha , Dan Roth , Vivek Gupta

Large Language Models (LLMs) often hallucinate, producing unfaithful or factually incorrect outputs by misrepresenting the provided context or incorrectly recalling internal knowledge. Recent studies have identified specific attention heads…

Computation and Language · Computer Science 2024-10-25 Aryo Pradipta Gema , Chen Jin , Ahmed Abdulaal , Tom Diethe , Philip Teare , Beatrice Alex , Pasquale Minervini , Amrutha Saseendran

Relation extraction is crucial for constructing knowledge graphs, with large high-quality datasets serving as the foundation for training, fine-tuning, and evaluating models. Generative data augmentation (GDA) is a common approach to expand…

Computation and Language · Computer Science 2024-10-14 Steven Rogulsky , Nicholas Popovic , Michael Färber

Concerns regarding the propensity of Large Language Models (LLMs) to produce inaccurate outputs, also known as hallucinations, have escalated. Detecting them is vital for ensuring the reliability of applications relying on LLM-generated…

Computation and Language · Computer Science 2024-05-31 Ernesto Quevedo , Jorge Yero , Rachel Koerner , Pablo Rivas , Tomas Cerny

Large language models (LLMs) demonstrate exceptional capabilities, yet still face the hallucination issue. Typical text generation approaches adopt an auto-regressive generation without deliberate reasoning, which often results in…

Computation and Language · Computer Science 2025-01-06 Xiaoxue Cheng , Junyi Li , Wayne Xin Zhao , Ji-Rong Wen

A common and fundamental limitation of Generative AI (GenAI) is its propensity to hallucinate. While large language models (LLM) have taken the world by storm, without eliminating or at least reducing hallucinations, real-world GenAI…

Machine Learning · Computer Science 2024-12-03 Patrice Béchard , Orlando Marquez Ayala

Large language models (LLMs) frequently hallucinate on abstractive summarization tasks such as document-based question-answering, meeting summarization, and clinical report generation, even though all necessary information is included in…

Computation and Language · Computer Science 2023-11-08 Erik Jones , Hamid Palangi , Clarisse Simões , Varun Chandrasekaran , Subhabrata Mukherjee , Arindam Mitra , Ahmed Awadallah , Ece Kamar

Large Language Models (LLMs) achieve impressive performance across many tasks but remain prone to hallucination, especially in long-form generation where redundant retrieved contexts and lengthy reasoning chains amplify factual errors.…

Computation and Language · Computer Science 2026-05-29 Yujie Feng , Jian Li , Zhihan Zhou , Pengfei Xu , Yujia Zhang , Xiaoyu Li , Xiaohui Zhou , Alan Zhao , Xi Chen , Xiao-Ming Wu

Doc2Query -- the process of expanding the content of a document before indexing using a sequence-to-sequence model -- has emerged as a prominent technique for improving the first-stage retrieval effectiveness of search engines. However,…

Information Retrieval · Computer Science 2023-02-28 Mitko Gospodinov , Sean MacAvaney , Craig Macdonald

In text generation, hallucinations refer to the generation of seemingly coherent text that contradicts established knowledge. One compelling hypothesis is that hallucinations occur when a language model is given a generation task outside…

Computation and Language · Computer Science 2024-08-21 Ameya Godbole , Nicholas Monath , Seungyeon Kim , Ankit Singh Rawat , Andrew McCallum , Manzil Zaheer

Traditional similarity-based schema matching methods are incapable of resolving semantic ambiguities and conflicts in domain-specific complex mapping scenarios due to missing commonsense and domain-specific knowledge. The hallucination…

Databases · Computer Science 2025-01-16 Chuangtao Ma , Sriom Chakrabarti , Arijit Khan , Bálint Molnár

Conventional Retrieval Augmented Generation (RAG) approaches are common in text-based applications. However, they struggle with structured, interconnected datasets like knowledge graphs, where understanding underlying relationships is…

Information Retrieval · Computer Science 2025-07-15 Savini Kashmira , Jayanaka L. Dantanarayana , Krisztián Flautner , Lingjia Tang , Jason Mars

As Large Language Models (LLMs) continue to advance in their ability to write human-like text, a key challenge remains around their tendency to hallucinate generating content that appears factual but is ungrounded. This issue of…

Computation and Language · Computer Science 2024-01-09 S. M Towhidul Islam Tonmoy , S M Mehedi Zaman , Vinija Jain , Anku Rani , Vipula Rawte , Aman Chadha , Amitava Das

Large Multimodal Models (LMMs) have achieved impressive progress in visual perception and reasoning. However, when confronted with visually ambiguous or non-semantic scene text, they often struggle to accurately spot and understand the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Yan Shu , Hangui Lin , Yexin Liu , Yan Zhang , Gangyan Zeng , Yan Li , Yu Zhou , Ser-Nam Lim , Harry Yang , Nicu Sebe

Schema linking is a difficult and important step in large-scale Text-to-SQL, where systems must identify a compact yet sufficient schema context from large and ambiguous databases. Existing methods often treat schema linking as…

Computation and Language · Computer Science 2026-05-29 Huawei Zheng , Sen Yang , Zhaorui Yang , Yuhui Zhang , Haozhe Feng , Haoxuan Li , Xuan Yi , Chao Hu , Defeng Xie , Chen Hou , Danqing Huang , Wei Chen , Yingcai Wu , Peng Chen , Dazhen Deng

Large Language Models (LLMs) have facilitated structured data generation, with applications in domains like tabular data, document databases, product catalogs, etc. However, concerns persist about generation veracity due to incorrect…

Computation and Language · Computer Science 2024-06-04 Chengwei Wei , Kee Kiat Koo , Amir Tavanaei , Karim Bouyarmane

Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency,…

Information Retrieval · Computer Science 2021-08-20 Hongyin Tang , Xingwu Sun , Beihong Jin , Jingang Wang , Fuzheng Zhang , Wei Wu