English
Related papers

Related papers: General-Purpose Question-Answering with Macaw

200 papers

A question-answering (QA) system is to search suitable answers within a knowledge base. Current QA systems struggle with queries requiring complex reasoning or real-time knowledge integration. They are often supplemented with retrieval…

Computation and Language · Computer Science 2025-05-21 Sizhe Yuen , Ting Su , Ziyang Wang , Yali Du , Adam J. Sobey

We introduce the Curious About Uncertain Scene (CAUS) dataset, designed to enable Large Language Models, specifically GPT-4, to emulate human cognitive processes for resolving uncertainties. Leveraging this dataset, we investigate the…

Artificial Intelligence · Computer Science 2024-05-21 Minjung Shin , Donghyun Kim , Jeh-Kwang Ryu

This paper presents a simple and cost-effective method for synthesizing data to train question-answering systems. For training, fine-tuning GPT models is a common practice in resource-rich languages like English, however, it becomes…

Computation and Language · Computer Science 2023-10-16 Kosuke Takahashi , Takahiro Omi , Kosuke Arima , Tatsuya Ishigaki

Large Language Models (LLMs) often struggle with tasks requiring mathematical reasoning, particularly multiple-choice questions (MCQs). To address this issue, we developed LLaMa-SciQ, an educational chatbot designed to assist college…

Artificial Intelligence · Computer Science 2024-09-26 Marc-Antoine Allard , Matin Ansaripour , Maria Yuffa , Paul Teiletche

Question generation (QG) is a natural language generation task where a model is trained to ask questions corresponding to some input text. Most recent approaches frame QG as a sequence-to-sequence problem and rely on additional features and…

Computation and Language · Computer Science 2021-08-16 Luis Enrico Lopez , Diane Kathryn Cruz , Jan Christian Blaise Cruz , Charibeth Cheng

Large-scale question-answer (QA) pairs are critical for advancing research areas like machine reading comprehension and question answering. To construct QA pairs from documents requires determining how to ask a question and what is the…

Computation and Language · Computer Science 2021-02-25 Shaobo Cui , Xintong Bao , Xinxing Zu , Yangyang Guo , Zhongzhou Zhao , Ji Zhang , Haiqing Chen

This paper introduces DataFrame question answering (QA), a novel task that utilizes large language models (LLMs) to generate Pandas queries for information retrieval and data analysis on dataframes, emphasizing safe and non-revealing data…

Computation and Language · Computer Science 2024-01-30 Junyi Ye , Mengnan Du , Guiling Wang

Unsupervised question answering is a promising yet challenging task, which alleviates the burden of building large-scale annotated data in a new domain. It motivates us to study the unsupervised multiple-choice question answering (MCQA)…

Computation and Language · Computer Science 2024-02-28 Qin Zhang , Hao Ge , Xiaojun Chen , Meng Fang

Question-answering (QA) is a natural approach for humans to understand a piece of music audio. However, for machines, accessing a large-scale dataset covering diverse aspects of music is crucial, yet challenging, due to the scarcity of…

Sound · Computer Science 2025-08-28 Zhihao Ouyang , Ju-Chiang Wang , Daiyu Zhang , Bin Chen , Shangjie Li , Quan Lin

Multimodal Question Answering (MMQA) is crucial as it enables comprehensive understanding and accurate responses by integrating insights from diverse data representations such as tables, charts, and text. Most existing researches in MMQA…

Computation and Language · Computer Science 2024-10-30 Bowen Zhao , Tianhao Cheng , Yuejie Zhang , Ying Cheng , Rui Feng , Xiaobo Zhang

Automatic question generation (AQG) has broad applicability in domains such as tutoring systems, conversational agents, healthcare literacy, and information retrieval. Existing efforts at AQG have been limited to short answer lengths of up…

Computation and Language · Computer Science 2020-04-16 Shlok Kumar Mishra , Pranav Goel , Abhishek Sharma , Abhyuday Jagannatha , David Jacobs , Hal Daumé

Africa is home to over one-third of the world's languages, yet remains underrepresented in AI research. We introduce Afri-MCQA, the first Multilingual Cultural Question-Answering benchmark covering 7.5k Q&A pairs across 15 African languages…

The field of visual question answering (VQA) has recently seen a surge in research focused on providing explanations for predicted answers. However, current systems mostly rely on separate models to predict answers and generate…

Computation and Language · Computer Science 2023-02-14 Chenxi Whitehouse , Tillman Weyde , Pranava Madhyastha

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

Computers and Society · Computer Science 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev

We present SimpleQA, a benchmark that evaluates the ability of language models to answer short, fact-seeking questions. We prioritized two properties in designing this eval. First, SimpleQA is challenging, as it is adversarially collected…

Computation and Language · Computer Science 2024-11-08 Jason Wei , Nguyen Karina , Hyung Won Chung , Yunxin Joy Jiao , Spencer Papay , Amelia Glaese , John Schulman , William Fedus

Supervised Question Answering systems (QA systems) rely on domain-specific human-labeled data for training. Unsupervised QA systems generate their own question-answer training pairs, typically using secondary knowledge sources to achieve…

Computation and Language · Computer Science 2023-02-06 Dinesh Nagumothu , Bahadorreza Ofoghi , Guangyan Huang , Peter W. Eklund

Building a deep learning model for a Question-Answering (QA) task requires a lot of human effort, it may need several months to carefully tune various model architectures and find a best one. It's even harder to find different excellent…

Computation and Language · Computer Science 2022-01-27 Sinan Tan , Hui Xue , Qiyu Ren , Huaping Liu , Jing Bai

Automated question generation is an important approach to enable personalisation of English comprehension assessment. Recently, transformer-based pretrained language models have demonstrated the ability to produce appropriate questions from…

Computation and Language · Computer Science 2022-09-27 Vatsal Raina , Mark Gales

Medical multiple-choice question answering (MCQA) is particularly difficult. Questions may describe patient symptoms and ask for the correct diagnosis, which requires domain knowledge and complex reasoning. Standard language modeling…

Computation and Language · Computer Science 2023-03-14 Damien Sileo , Kanimozhi Uma , Marie-Francine Moens

Recent advances in QA pair generation (QAG) have raised interest in applying this technique to the educational field. However, the diversity of QA types remains a challenge despite its contributions to comprehensive learning and assessment…

Computation and Language · Computer Science 2023-06-13 Sugyeong Eo , Hyeonseok Moon , Jinsung Kim , Yuna Hur , Jeongwook Kim , Songeun Lee , Changwoo Chun , Sungsoo Park , Heuiseok Lim