English
Related papers

Related papers: How much should you ask? On the question structure…

200 papers

We present a reality check on large language models and inspect the promise of retrieval augmented language models in comparison. Such language models are semi-parametric, where models integrate model parameters and knowledge from external…

Computation and Language · Computer Science 2023-06-05 Wang-Chiew Tan , Yuliang Li , Pedro Rodriguez , Richard James , Xi Victoria Lin , Alon Halevy , Scott Yih

While there has been substantial progress in factoid question-answering (QA), answering complex questions remains challenging, typically requiring both a large body of knowledge and inference techniques. Open Information Extraction (Open…

Artificial Intelligence · Computer Science 2017-04-20 Tushar Khot , Ashish Sabharwal , Peter Clark

Question answering (Q/A) can be formulated as a generative task (Mitra, 2017) where the task is to generate an answer given the question and the passage (knowledge, if available). Recent advances in QA task is focused a lot on language…

Computation and Language · Computer Science 2023-06-05 Jyothir S , Zuhaib Akhtar

Large Language Models (LLMs) have shown the impressive capability of answering questions in a wide range of scenarios. However, when LLMs face different types of questions, it is worth exploring whether LLMs are aware that some questions…

Computation and Language · Computer Science 2024-10-02 Dongjie Yang , Hai Zhao

Large language models (LLMs) have shown impressive performance on reasoning benchmarks like math and logic. While many works have largely assumed well-defined tasks, real-world queries are often underspecified and only solvable by acquiring…

Artificial Intelligence · Computer Science 2025-10-28 Belinda Z. Li , Been Kim , Zi Wang

Can a machine understand the meanings of natural language? Recent developments in the generative large language models (LLMs) of artificial intelligence have led to the belief that traditional philosophical assumptions about machine…

Computation and Language · Computer Science 2023-10-27 Vladimír Havlík

Large language models (LLMs) have been widely applied to assist in finding solutions for diverse questions. Prior work has proposed representing a method as a pair of a question and its corresponding solution, enabling method reuse.…

Computation and Language · Computer Science 2025-10-17 Hong Su

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Large language models (LLMs) transfer well to new tasks out-of-the-box simply given a natural language prompt that demonstrates how to perform the task and no additional training. Prompting is a brittle process wherein small modifications…

Computation and Language · Computer Science 2022-11-22 Simran Arora , Avanika Narayan , Mayee F. Chen , Laurel Orr , Neel Guha , Kush Bhatia , Ines Chami , Frederic Sala , Christopher Ré

When evaluating an answer choice for Reading Comprehension task, other answer choices available for the question and the answers of related questions about the same paragraph often provide valuable information. In this paper, we propose a…

Computation and Language · Computer Science 2021-01-01 Rajkumar Pujari , Dan Goldwasser

Users often ask dialogue systems ambiguous questions that require clarification. We show that current language models rarely ask users to clarify ambiguous questions and instead provide incorrect answers. To address this, we introduce CLAM:…

Computation and Language · Computer Science 2023-02-21 Lorenz Kuhn , Yarin Gal , Sebastian Farquhar

Large pre-trained language models (LMs) have been shown to perform surprisingly well when fine-tuned on tasks that require commonsense and world knowledge. However, in end-to-end architectures, it is difficult to explain what is the…

Computation and Language · Computer Science 2020-04-14 Veronica Latcinnik , Jonathan Berant

We present $\textbf{Korean SimpleQA (KoSimpleQA)}$, a benchmark for evaluating factuality in large language models (LLMs) with a focus on Korean cultural knowledge. KoSimpleQA is designed to be challenging yet easy to grade, consisting of…

Computation and Language · Computer Science 2025-10-22 Donghyeon Ko , Yeguk Jin , Kyubyung Chae , Byungwook Lee , Chansong Jo , Sookyo In , Jaehong Lee , Taesup Kim , Donghyun Kwak

Recent work in semantic parsing for question answering has focused on long and complicated questions, many of which would seem unnatural if asked in a normal conversation between two humans. In an effort to explore a conversational QA…

Computation and Language · Computer Science 2016-11-07 Mohit Iyyer , Wen-tau Yih , Ming-Wei Chang

Medical question answer (QA) assistants respond to lay users' health-related queries by synthesizing information from multiple sources using natural language processing and related techniques. They can serve as vital tools to alleviate…

Computation and Language · Computer Science 2024-10-01 Prakash Chandra Sukhwal , Vaibhav Rajan , Atreyi Kankanhalli

Large Language Models (LLMs) are revolutionizing information retrieval, with chatbots becoming an important source for answering user queries. As by their design, LLMs prioritize generating correct answers, the value of highly plausible yet…

Computation and Language · Computer Science 2025-04-22 Jamshid Mozafari , Abdelrahman Abdallah , Bhawna Piryani , Adam Jatowt

Question answering (QA) is an important natural language processing (NLP) task and has received much attention in academic research and industry communities. Existing QA studies assume that questions are raised by humans and answers are…

Computation and Language · Computer Science 2019-01-15 Qing Yin , Guan Luo , Xiaodong Zhu , Qinghua Hu , Ou Wu

Quora is one of the most popular community Q&A sites of recent times. However, many question posts on this Q&A site often do not get answered. In this paper, we quantify various linguistic activities that discriminates an answered question…

Computation and Language · Computer Science 2017-03-14 Suman Kalyan Maity , Aman Kharb , Animesh Mukherjee

The correct interpretation of quantifier statements in the context of a visual scene requires non-trivial inference mechanisms. For the example of "most", we discuss two strategies which rely on fundamentally different cognitive concepts.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-05 Alexander Kuhnle , Ann Copestake

The objective of automated Question Answering (QA) systems is to provide answers to user queries in a time efficient manner. The answers are usually found in either databases (or knowledge bases) or a collection of documents commonly…

Artificial Intelligence · Computer Science 2021-11-12 Krishanu Das Baksi