English
Related papers

Related papers: Testing Question Answering Software with Context-D…

200 papers

We present SQuAI (https://squai.scads.ai/), a scalable and trustworthy multi-agent retrieval-augmented generation (RAG) framework for scientific question answering (QA) with large language models (LLMs). SQuAI addresses key limitations of…

Information Retrieval · Computer Science 2025-10-20 Ines Besrour , Jingbo He , Tobias Schreieder , Michael Färber

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

Complex question answering (CQA) over raw text is a challenging task. A prominent approach to this task is based on the programmer-interpreter framework, where the programmer maps the question into a sequence of reasoning actions which is…

Computation and Language · Computer Science 2020-10-20 Xiao-Yu Guo , Yuan-Fang Li , Gholamreza Haffari

Large language models (LLMs) are now widely deployed in user-facing applications, reaching hundreds of millions worldwide. As they become integrated into everyday tasks, growing reliance on their outputs raises significant concerns. In…

Computers and Society · Computer Science 2025-10-16 Robin Staab , Jasper Dekoninck , Maximilian Baader , Martin Vechev

We explore question generation in the context of knowledge-grounded dialogs focusing on explainability and evaluation. Inspired by previous work on planning-based summarisation, we present a model which instead of directly generating a…

Computation and Language · Computer Science 2024-04-12 Juliette Faille , Quentin Brabant , Gwenole Lecorve , Lina M. Rojas-Barahona , Claire Gardent

Much of early literacy education happens at home with caretakers reading books to young children. Prior research demonstrates how having dialogue with children during co-reading can develop critical reading readiness skills, but most adult…

Human-Computer Interaction · Computer Science 2024-05-08 Griffin Dietz Smith , Siddhartha Prasad , Matt J. Davidson , Leah Findlater , R. Benjamin Shapiro

On-the-fly retrieval of relevant knowledge has proven an essential element of reliable systems for tasks such as open-domain question answering and fact verification. However, because retrieval systems are not perfect, generation models are…

Computation and Language · Computer Science 2023-11-15 Zhiruo Wang , Jun Araki , Zhengbao Jiang , Md Rizwan Parvez , Graham Neubig

Question Answering (QA) systems are becoming the inspiring model for the future of search engines. While recently, underlying datasets for QA systems have been promoted from unstructured datasets to structured datasets with highly…

Information Retrieval · Computer Science 2016-02-17 Saeedeh Shekarpour , Denis Lukovnikov , Ashwini Jaya Kumar , Kemele Endris , Kuldeep Singh , Harsh Thakkar , Christoph Lange

Recent advances in QA pair generation (QAG) have raised interest in applying this technique to the educational field. However, the diversity of QA types remains a challenge despite its contributions to comprehensive learning and assessment…

Computation and Language · Computer Science 2023-06-13 Sugyeong Eo , Hyeonseok Moon , Jinsung Kim , Yuna Hur , Jeongwook Kim , Songeun Lee , Changwoo Chun , Sungsoo Park , Heuiseok Lim

When interacting with Retrieval-Augmented Generation (RAG)-based conversational agents, the users must carefully craft their queries to be understood correctly. Yet, understanding the system's capabilities can be challenging for the users,…

Computation and Language · Computer Science 2024-03-19 Anuja Tayal , Aman Tyagi

Users often assume that large language models (LLMs) share their cognitive alignment of context and intent, leading them to omit critical information in question-answering (QA) and produce ambiguous queries. Responses based on misaligned…

Computation and Language · Computer Science 2025-09-12 Zongxi Li , Yang Li , Haoran Xie , S. Joe Qin

Traditional quality assurance (QA) methods face significant challenges in addressing the complexity, scale, and rapid iteration cycles of modern software systems and are strained by limited resources available, leading to substantial costs…

Software Engineering · Computer Science 2025-06-23 Ihor Pysmennyi , Roman Kyslyi , Kyrylo Kleshch

While exam-style questions are a fundamental educational tool serving a variety of purposes, manual construction of questions is a complex process that requires training, experience and resources. Automatic question generation (QG)…

Machine Learning · Computer Science 2022-04-08 Fatih Cagatay Akyon , Devrim Cavusoglu , Cemil Cengiz , Sinan Onur Altinuc , Alptekin Temizel

NLP-powered automatic question generation (QG) techniques carry great pedagogical potential of saving educators' time and benefiting student learning. Yet, QG systems have not been widely adopted in classrooms to date. In this work, we aim…

Human-Computer Interaction · Computer Science 2022-05-03 Xu Wang , Simin Fan , Jessica Houghton , Lu Wang

Automated interviewers and chatbots are common in research, recruitment, customer service, and education. Many existing systems use fixed question lists, strict rules, and limited personalization, leading to repeated conversations that…

Human-Computer Interaction · Computer Science 2026-01-22 Aisvarya Adeseye , Jouni Isoaho , Seppo Virtanen , Mohammad Tahir

The usage and amount of information available on the internet increase over the past decade. This digitization leads to the need for automated answering system to extract fruitful information from redundant and transitional knowledge…

Computation and Language · Computer Science 2022-02-03 Hariom A. Pandya , Brijesh S. Bhatt

Existing question answering (QA) techniques are created mainly to answer questions asked by humans. But in educational applications, teachers often need to decide what questions they should ask, in order to help students to improve their…

Computation and Language · Computer Science 2022-03-29 Bingsheng Yao , Dakuo Wang , Tongshuang Wu , Zheng Zhang , Toby Jia-Jun Li , Mo Yu , Ying Xu

Prior work in standardized science exams requires support from large text corpus, such as targeted science corpus fromWikipedia or SimpleWikipedia. However, retrieving knowledge from the large corpus is time-consuming and questions embedded…

Artificial Intelligence · Computer Science 2020-04-28 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

Automated GUI testing is widely used to help ensure the quality of mobile apps. However, many GUIs require appropriate text inputs to proceed to the next page which remains a prominent obstacle for testing coverage. Considering the…

Software Engineering · Computer Science 2022-12-12 Zhe Liu , Chunyang Chen , Junjie Wang , Xing Che , Yuekai Huang , Jun Hu , Qing Wang

Designing high-quality educational questions is a challenging and time-consuming task. In this work, we propose a novel approach that utilizes prompt-based techniques to generate descriptive and reasoning-based questions. However, current…

Computation and Language · Computer Science 2023-12-05 Subhankar Maity , Aniket Deroy , Sudeshna Sarkar