English
Related papers

Related papers: On Synthesizing Data for Context Attribution in Qu…

200 papers

Long-context LLMs are increasingly in demand for applications such as retrieval-augmented generation. To defray the cost of pretraining LLMs over long contexts, recent work takes an approach of synthetic context extension: fine-tuning LLMs…

Computation and Language · Computer Science 2025-05-29 Xinyu Zhao , Fangcong Yin , Greg Durrett

Attribution is a key concept in large language models (LLMs) as it enables control over information sources and enhances the factuality of LLMs. While existing approaches utilize open book question answering to improve attribution, factual…

Computation and Language · Computer Science 2023-11-14 Abdullatif Köksal , Renat Aksitov , Chung-Ching Chang

Large Language Models (LLMs), despite extensive pretraining on broad internet corpora, often struggle to adapt effectively to specialized domains. There is growing interest in fine-tuning these models for such domains; however, progress is…

Computation and Language · Computer Science 2026-02-23 Vincent Grari , Ciprian Tomoiaga , Sylvain Lamprier , Tatsunori Hashimoto , Marcin Detyniecki

As Large Language Models (LLMs) continue to evolve, more are being designed to handle long-context inputs. Despite this advancement, most of them still face challenges in accurately handling long-context tasks, often showing the "lost in…

Computation and Language · Computer Science 2024-12-13 Yijiong Yu , Yongfeng Huang , Zhixiao Qi , Zhe Zhou

This study delves into the capabilities and limitations of Large Language Models (LLMs) in the challenging domain of conditional question-answering. Utilizing the Conditional Question Answering (CQA) dataset and focusing on generative…

Computation and Language · Computer Science 2023-12-05 Syed-Amad Hussain , Parag Pravin Dakle , SaiKrishna Rallabandi , Preethi Raghavan

Hallucination is a well-known phenomenon in text generated by large language models (LLMs). The existence of hallucinatory responses is found in almost all application scenarios e.g., summarization, question-answering (QA) etc. For…

Computation and Language · Computer Science 2023-12-11 Mobashir Sadat , Zhengyu Zhou , Lukas Lange , Jun Araki , Arsalan Gundroo , Bingqing Wang , Rakesh R Menon , Md Rizwan Parvez , Zhe Feng

Current speech-LLMs exhibit limited capability in contextual reasoning alongside paralinguistic understanding, primarily due to the lack of Question-Answer (QA) datasets that cover both aspects. We propose a novel framework for dataset…

Computation and Language · Computer Science 2025-06-04 Qiongqiong Wang , Hardik B. Sailor , Tianchi Liu , Ai Ti Aw

Personalization in Information Retrieval (IR) is a topic studied by the research community since a long time. However, there is still a lack of datasets to conduct large-scale evaluations of personalized IR; this is mainly due to the fact…

Information Retrieval · Computer Science 2024-10-30 Marco Braga , Pranav Kasela , Alessandro Raganato , Gabriella Pasi

This paper introduces UnSeenTimeQA, a novel data contamination-free time-sensitive question-answering (TSQA) benchmark. It differs from existing TSQA benchmarks by avoiding web-searchable queries grounded in the real world. We present a…

Computation and Language · Computer Science 2025-06-04 Md Nayem Uddin , Amir Saeidi , Divij Handa , Agastya Seth , Tran Cao Son , Eduardo Blanco , Steven R. Corman , Chitta Baral

The in-context learning ability of large language models (LLMs) enables them to generalize to novel downstream tasks with relatively few labeled examples. However, they require enormous computational resources to be deployed. Alternatively,…

Computation and Language · Computer Science 2024-01-09 Jean Kaddour , Qi Liu

LLMs can help humans working with long documents, but are known to hallucinate. Attribution can increase trust in LLM responses: The LLM provides evidence that supports its response, which enhances verifiability. Existing approaches to…

Computation and Language · Computer Science 2024-10-24 Jan Buchmann , Xiao Liu , Iryna Gurevych

This survey reviews how large language models (LLMs) are transforming synthetic training data generation in both natural language and code domains. By producing artificial but task-relevant examples, these models can significantly augment…

Computation and Language · Computer Science 2025-11-21 Mihai Nadas , Laura Diosan , Andreea Tomescu

Enabling farmers to access accurate agriculture-related information in their native languages in a timely manner is crucial for the success of the agriculture field. Publicly available general-purpose Large Language Models (LLMs) typically…

The success of expanded context windows in Large Language Models (LLMs) has driven increased use of broader context in retrieval-augmented generation. We investigate the use of LLMs for retrieval augmented question answering. While longer…

Computation and Language · Computer Science 2026-01-01 Dingmin Wang , Ji Ma , Shankar Kumar

Synthetic data generation has recently emerged as a promising approach for enhancing the capabilities of large language models (LLMs) without the need for expensive human annotations. However, existing methods often generate data that can…

Computation and Language · Computer Science 2025-08-21 Alisia Lupidi , Carlos Gemmell , Nicola Cancedda , Jane Dwivedi-Yu , Jason Weston , Jakob Foerster , Roberta Raileanu , Maria Lomeli

Although achieving great success, Large Language Models (LLMs) usually suffer from unreliable hallucinations. Although language attribution can be a potential solution, there are no suitable benchmarks and evaluation metrics to attribute…

Computation and Language · Computer Science 2024-05-24 Xinze Li , Yixin Cao , Liangming Pan , Yubo Ma , Aixin Sun

Multiple Choice Question Answering (MCQA) is an important problem with numerous real-world applications, such as medicine, law, and education. The high cost of building MCQA datasets makes few-shot learning pivotal in this domain. While…

Computation and Language · Computer Science 2024-12-31 Patrick Sutanto , Joan Santoso , Esther Irawati Setiawan , Aji Prasetya Wibawa

Retrieval-Augmented Generation (RAG) has emerged as a prominent method for incorporating domain knowledge into Large Language Models (LLMs). While RAG enhances response relevance by incorporating retrieved domain knowledge in the context,…

Computation and Language · Computer Science 2025-03-28 Kushagra Bhushan , Yatin Nandwani , Dinesh Khandelwal , Sonam Gupta , Gaurav Pandey , Dinesh Raghu , Sachindra Joshi

The increasing popularity of Large Language Models (LLMs) in recent years has changed the way users interact with and pose questions to AI-based conversational systems. An essential aspect for increasing the trustworthiness of generated LLM…

Computation and Language · Computer Science 2024-10-23 Juraj Vladika , Luca Mülln , Florian Matthes

In the realm of Large Language Model (LLM) functionalities, providing reliable information is paramount, yet reports suggest that LLM outputs lack consistency. This inconsistency, often at-tributed to randomness in token sampling,…

Computation and Language · Computer Science 2024-10-22 Yanggyu Lee , Jihie Kim