English
Related papers

Related papers: ExpertGenQA: Open-ended QA generation in Specializ…

200 papers

The ability of generative language models (GLMs) to generate text has improved considerably in the last few years, enabling their use for generative data augmentation. In this work, we propose CONDA, an approach to further improve GLMs'…

Computation and Language · Computer Science 2022-10-26 Dheeraj Mekala , Tu Vu , Timo Schick , Jingbo Shang

Retrieval-Augmented Generation (RAG) systems face significant performance gaps when applied to technical domains requiring precise information extraction from complex documents. Current evaluation methodologies relying on document-level…

Machine Learning · Computer Science 2025-02-25 Aryan Jadon , Avinash Patil , Shashank Kumar

Multi-paragraph reasoning is indispensable for open-domain question answering (OpenQA), which receives less attention in the current OpenQA systems. In this work, we propose a knowledge-enhanced graph neural network (KGNN), which performs…

Computation and Language · Computer Science 2019-11-07 Deming Ye , Yankai Lin , Zhenghao Liu , Zhiyuan Liu , Maosong Sun

Medical question-answering (QA) is a critical task for evaluating how effectively large language models (LLMs) encode clinical knowledge and assessing their potential applications in medicine. Despite showing promise on multiple-choice…

Computation and Language · Computer Science 2025-03-06 Guangfu Guo , Kai Zhang , Bryan Hoo , Yujun Cai , Xiaoqian Lu , Nanyun Peng , Yiwei Wang

Fine-tuning for large language models (LLMs) typically requires substantial amounts of high-quality supervised data, which is both costly and labor-intensive to acquire. While synthetic data generation has emerged as a promising solution,…

Computation and Language · Computer Science 2025-05-28 Zihong Chen , Wanli Jiang , Jinzhe Li , Zhonghang Yuan , Huanjun Kong , Wanli Ouyang , Nanqing Dong

We study the problem of few-shot Fine-grained Entity Typing (FET), where only a few annotated entity mentions with contexts are given for each entity type. Recently, prompt-based tuning has demonstrated superior performance to standard…

Computation and Language · Computer Science 2022-06-29 Jiaxin Huang , Yu Meng , Jiawei Han

We propose an end-to-end approach for synthetic QA data generation. Our model comprises a single transformer-based encoder-decoder network that is trained end-to-end to generate both answers and questions. In a nutshell, we feed a passage…

Computation and Language · Computer Science 2020-10-14 Siamak Shakeri , Cicero Nogueira dos Santos , Henry Zhu , Patrick Ng , Feng Nan , Zhiguo Wang , Ramesh Nallapati , Bing Xiang

Multi-modal open-domain question answering typically requires evidence retrieval from databases across diverse modalities, such as images, tables, passages, etc. Even Large Language Models (LLMs) like GPT-4 fall short in this task. To…

Computation and Language · Computer Science 2023-10-23 Le Zhang , Yihong Wu , Fengran Mo , Jian-Yun Nie , Aishwarya Agrawal

Generative commonsense question answering (GenCQA) is a task of automatically generating a list of answers given a question. The answer list is required to cover all reasonable answers. This presents the considerable challenges of producing…

Computation and Language · Computer Science 2023-05-16 Zhifeng Li , Bowei Zou , Yifan Fan , Yu Hong

Large Language Models (LLMs) perform well on standard reasoning and question-answering benchmarks, yet such evaluations often fail to capture their ability to handle long-tail, expertise-intensive knowledge in real-world professional…

Question answering (QA) in English has been widely explored, but multilingual datasets are relatively new, with several methods attempting to bridge the gap between high- and low-resourced languages using data augmentation through…

Computation and Language · Computer Science 2021-06-01 Arnab Debnath , Navid Rajabi , Fardina Fathmiul Alam , Antonios Anastasopoulos

Pretrained Large Language Models (LLMs) have gained significant attention for addressing open-domain Question Answering (QA). While they exhibit high accuracy in answering questions related to common knowledge, LLMs encounter difficulties…

Computation and Language · Computer Science 2024-03-05 Rohan Kumar , Youngmin Kim , Sunitha Ravi , Haitian Sun , Christos Faloutsos , Ruslan Salakhutdinov , Minji Yoon

Question Answering (QA) is a longstanding challenge in natural language processing. Existing QA works mostly focus on specific question types, knowledge domains, or reasoning skills. The specialty in QA research hinders systems from…

Computation and Language · Computer Science 2022-12-12 Wanjun Zhong , Yifan Gao , Ning Ding , Yujia Qin , Zhiyuan Liu , Ming Zhou , Jiahai Wang , Jian Yin , Nan Duan

While large language models (LLMs) have shown remarkable capabilities in natural language processing, they struggle with complex, multi-step reasoning tasks involving knowledge graphs (KGs). Existing approaches that integrate LLMs and KGs…

Computation and Language · Computer Science 2024-09-25 Zixuan Dong , Baoyun Peng , Yufei Wang , Jia Fu , Xiaodong Wang , Yongxue Shan , Xin Zhou

The availability of large, high-quality datasets has been one of the main drivers of recent progress in question answering (QA). Such annotated datasets however are difficult and costly to collect, and rarely exist in languages other than…

Computation and Language · Computer Science 2023-08-08 Priyanka Agrawal , Chris Alberti , Fantine Huot , Joshua Maynez , Ji Ma , Sebastian Ruder , Kuzman Ganchev , Dipanjan Das , Mirella Lapata

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the…

Computation and Language · Computer Science 2022-10-25 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Recent research showed promising results on combining pretrained language models (LMs) with canonical utterance for few-shot semantic parsing. The canonical utterance is often lengthy and complex due to the compositional structure of formal…

Computation and Language · Computer Science 2022-05-17 Jingfeng Yang , Haoming Jiang , Qingyu Yin , Danqing Zhang , Bing Yin , Diyi Yang

Table Question Answering (TableQA) poses a significant challenge for large language models (LLMs) because conventional linearization of tables often disrupts the two-dimensional relationships intrinsic to structured data. Existing methods,…

Computation and Language · Computer Science 2026-02-03 Seho Pyo , Jiheon Seok , Jaejin Lee

Accurate and efficient question-answering systems are essential for delivering high-quality patient care in the medical field. While Large Language Models (LLMs) have made remarkable strides across various domains, they continue to face…

Computation and Language · Computer Science 2025-01-22 Hang Yang , Hao Chen , Hui Guo , Yineng Chen , Ching-Sheng Lin , Shu Hu , Jinrong Hu , Xi Wu , Xin Wang

We introduce KG-MuLQA (Knowledge-Graph-based Multi-Level Question-Answer Extraction): a framework that (1) extracts QA pairs at multiple complexity levels (2) along three key dimensions -- multi-hop retrieval, set operations, and answer…