English
Related papers

Related papers: ProtoQA: A Question Answering Dataset for Prototyp…

200 papers

Existing question answering (QA) datasets fail to train QA systems to perform complex reasoning and provide explanations for answers. We introduce HotpotQA, a new dataset with 113k Wikipedia-based question-answer pairs with four key…

Computation and Language · Computer Science 2018-09-26 Zhilin Yang , Peng Qi , Saizheng Zhang , Yoshua Bengio , William W. Cohen , Ruslan Salakhutdinov , Christopher D. Manning

Commonsense reasoning deals with the implicit knowledge that is well understood by humans and typically acquired via interactions with the world. In recent times, commonsense reasoning and understanding of various LLMs have been evaluated…

Computation and Language · Computer Science 2025-04-15 Abhinav Joshi , Areeb Ahmad , Divyaksh Shukla , Ashutosh Modi

Humans gather information by engaging in conversations involving a series of interconnected questions and answers. For machines to assist in information gathering, it is therefore essential to enable them to answer conversational questions.…

Computation and Language · Computer Science 2019-04-02 Siva Reddy , Danqi Chen , Christopher D. Manning

We publicly release a new large-scale dataset, called SearchQA, for machine comprehension, or question-answering. Unlike recently released datasets, such as DeepMind CNN/DailyMail and SQuAD, the proposed SearchQA was constructed to reflect…

Computation and Language · Computer Science 2017-06-13 Matthew Dunn , Levent Sagun , Mike Higgins , V. Ugur Guney , Volkan Cirik , Kyunghyun Cho

Question Answering (QA) is a longstanding challenge in natural language processing. Existing QA works mostly focus on specific question types, knowledge domains, or reasoning skills. The specialty in QA research hinders systems from…

Computation and Language · Computer Science 2022-12-12 Wanjun Zhong , Yifan Gao , Ning Ding , Yujia Qin , Zhiyuan Liu , Ming Zhou , Jiahai Wang , Jian Yin , Nan Duan

Story generation, namely generating a reasonable story from a leading context, is an important but challenging task. In spite of the success in modeling fluency and local coherence, existing neural language generation models (e.g., GPT-2)…

Computation and Language · Computer Science 2020-01-16 Jian Guan , Fei Huang , Zhihao Zhao , Xiaoyan Zhu , Minlie Huang

Given a partial description like "she opened the hood of the car," humans can reason about the situation and anticipate what might come next ("then, she examined the engine"). In this paper, we introduce the task of grounded commonsense…

Computation and Language · Computer Science 2018-08-17 Rowan Zellers , Yonatan Bisk , Roy Schwartz , Yejin Choi

Recently, the community has achieved substantial progress on many commonsense reasoning benchmarks. However, it is still unclear what is learned from the training process: the knowledge, inference capability, or both? We argue that due to…

Computation and Language · Computer Science 2022-10-13 Hongming Zhang , Yintong Huo , Yanai Elazar , Yangqiu Song , Yoav Goldberg , Dan Roth

Most benchmark datasets targeting commonsense reasoning focus on everyday scenarios: physical knowledge like knowing that you could fill a cup under a waterfall [Talmor et al., 2019], social knowledge like bumping into someone is awkward…

Computation and Language · Computer Science 2021-09-06 Yasumasa Onoe , Michael J. Q. Zhang , Eunsol Choi , Greg Durrett

Multimodal systems have great potential to assist humans in procedural activities, where people follow instructions to achieve their goals. Despite diverse application scenarios, systems are typically evaluated on traditional classification…

Computation and Language · Computer Science 2025-11-05 Kimihiro Hasegawa , Wiradee Imrattanatrai , Zhi-Qi Cheng , Masaki Asada , Susan Holm , Yuran Wang , Ken Fukuda , Teruko Mitamura

Scholastic trivia competitions test knowledge and intelligence through mastery of question answering. Modern question answering benchmarks are one variant of the Turing test. Specifically, answering a set of questions as well as a human is…

Computation and Language · Computer Science 2021-02-15 Pedro Rodriguez , Shi Feng , Mohit Iyyer , He He , Jordan Boyd-Graber

Information-seeking questions in long-form question answering (LFQA) often prove misleading due to ambiguity or false presupposition in the question. While many existing approaches handle misleading questions, they are tailored to limited…

Computation and Language · Computer Science 2023-11-15 Wookje Han , Jinsol Park , Kyungjae Lee

Answering questions about why characters perform certain actions is central to understanding and reasoning about narratives. Despite recent progress in QA, it is not clear if existing models have the ability to answer "why" questions that…

Computation and Language · Computer Science 2021-08-18 Yash Kumar Lal , Nathanael Chambers , Raymond Mooney , Niranjan Balasubramanian

We present NewsQA, a challenging machine comprehension dataset of over 100,000 human-generated question-answer pairs. Crowdworkers supply questions and answers based on a set of over 10,000 news articles from CNN, with answers consisting of…

Computation and Language · Computer Science 2017-02-08 Adam Trischler , Tong Wang , Xingdi Yuan , Justin Harris , Alessandro Sordoni , Philip Bachman , Kaheer Suleman

Question generation (QG) is to generate natural and grammatical questions that can be answered by a specific answer for a given context. Previous sequence-to-sequence models suffer from a problem that asking high-quality questions requires…

Computation and Language · Computer Science 2021-06-22 Xin Jia , Hao Wang , Dawei Yin , Yunfang Wu

Although neural network approaches achieve remarkable success on a variety of NLP tasks, many of them struggle to answer questions that require commonsense knowledge. We believe the main reason is the lack of commonsense \mbox{connections}…

Computation and Language · Computer Science 2019-03-04 Wanjun Zhong , Duyu Tang , Nan Duan , Ming Zhou , Jiahai Wang , Jian Yin

Rationality and emotion are two fundamental elements of humans. Endowing agents with rationality and emotion has been one of the major milestones in AI. However, in the field of conversational AI, most existing models only specialize in one…

Computation and Language · Computer Science 2021-03-02 Peixiang Zhong , Di Wang , Pengfei Li , Chen Zhang , Hao Wang , Chunyan Miao

To effectively interact with the real world, Large Language Models (LLMs) require entity-based commonsense reasoning, a challenging task that necessitates integrating factual knowledge about specific entities with commonsense inference.…

Computation and Language · Computer Science 2026-05-14 Armin Toroghi , Faeze Moradi Kalarde , Scott Sanner

Recently, large-scale pre-trained language models have demonstrated impressive performance on several commonsense-reasoning benchmark datasets. However, building machines with commonsense to compose realistically plausible sentences remains…

Computation and Language · Computer Science 2020-12-01 Bill Yuchen Lin , Wangchunshu Zhou , Ming Shen , Pei Zhou , Chandra Bhagavatula , Yejin Choi , Xiang Ren

It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting,…

Computation and Language · Computer Science 2022-09-30 Jiacheng Liu , Alisa Liu , Ximing Lu , Sean Welleck , Peter West , Ronan Le Bras , Yejin Choi , Hannaneh Hajishirzi