English
Related papers

Related papers: ProtoQA: A Question Answering Dataset for Prototyp…

200 papers

Analogy is one of the core capacities of human cognition; when faced with new situations, we often transfer prior experience from other domains. Most work on computational analogy relies heavily on complex, manually crafted input. In this…

Computation and Language · Computer Science 2023-11-06 Shahar Jacob , Chen Shani , Dafna Shahaf

Recently, commonsense reasoning in text generation has attracted much attention. Generative commonsense reasoning is the task that requires machines, given a group of keywords, to compose a single coherent sentence with commonsense…

Computation and Language · Computer Science 2023-10-31 Yunxiang Zhang , Xiaojun Wan

Current QA systems can generate reasonable-sounding yet false answers without explanation or evidence for the generated answer, which is especially problematic when humans cannot readily check the model's answers. This presents a challenge…

Computation and Language · Computer Science 2022-04-14 Alicia Parrish , Harsh Trivedi , Ethan Perez , Angelica Chen , Nikita Nangia , Jason Phang , Samuel R. Bowman

This Article introduces the generative reasonable person, a new tool for estimating how ordinary people judge reasonableness. As claims about AI capabilities often outpace evidence, the Article proceeds empirically: adapting randomized…

Computers and Society · Computer Science 2026-02-18 Yonathan A. Arbel

We introduce STREET, a unified multi-task and multi-domain natural language reasoning and explanation benchmark. Unlike most existing question-answering (QA) datasets, we expect models to not only answer questions, but also produce…

Retrieval-based code question answering seeks to match user queries in natural language to relevant code snippets. Previous approaches typically rely on pretraining models using crafted bi-modal and uni-modal datasets to align text and code…

Computation and Language · Computer Science 2024-03-26 Zehan Li , Jianfei Zhang , Chuantao Yin , Yuanxin Ouyang , Wenge Rong

We present QuAC, a dataset for Question Answering in Context that contains 14K information-seeking QA dialogs (100K questions in total). The dialogs involve two crowd workers: (1) a student who poses a sequence of freeform questions to…

Computation and Language · Computer Science 2018-08-29 Eunsol Choi , He He , Mohit Iyyer , Mark Yatskar , Wen-tau Yih , Yejin Choi , Percy Liang , Luke Zettlemoyer

Recent years have witnessed an increasing interest in training machines with reasoning ability, which deeply relies on accurately and clearly presented clue forms. The clues are usually modeled as entity-aware knowledge in existing studies.…

Computation and Language · Computer Science 2023-05-29 Siru Ouyang , Zhuosheng Zhang , Hai Zhao

Successful completion of reasoning task requires the agent to have relevant prior knowledge or some given context of the world dynamics. Usually, the information provided to the system for a reasoning task is just the query or some…

Artificial Intelligence · Computer Science 2019-11-18 Vatsal Mahajan

Question-answering datasets require a broad set of reasoning skills. We show how to use question decompositions to teach language models these broad reasoning skills in a robust fashion. Specifically, we use widely available QDMR…

Computation and Language · Computer Science 2022-11-07 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, current datasets do not provide a complete explanation for the…

Computation and Language · Computer Science 2020-11-13 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

Commonsense reasoning is a pivotal skill for large language models, yet it presents persistent challenges in specific tasks requiring this competence. Traditional fine-tuning approaches can be resource-intensive and potentially compromise a…

Computation and Language · Computer Science 2023-09-26 Chenin Li , Qianglong Chen , Yin Zhang , Yifei Zhang , Hongxiang Yao

Automated rationale generation is an approach for real-time explanation generation whereby a computational model learns to translate an autonomous agent's internal state and action data representations into natural language. Training on…

Artificial Intelligence · Computer Science 2019-01-15 Upol Ehsan , Pradyumna Tambwekar , Larry Chan , Brent Harrison , Mark Riedl

When Question-Answering (QA) systems are deployed in the real world, users query them through a variety of interfaces, such as speaking to voice assistants, typing questions into a search engine, or even translating questions to languages…

Computation and Language · Computer Science 2021-02-17 Abhilasha Ravichander , Siddharth Dalmia , Maria Ryskina , Florian Metze , Eduard Hovy , Alan W Black

Providing plausible responses to why questions is a challenging but critical goal for language based human-machine interaction. Explanations are challenging in that they require many different forms of abstract knowledge and reasoning.…

Computation and Language · Computer Science 2019-06-05 Allen Nie , Erin D. Bennett , Noah D. Goodman

The zero-shot chain of thought (CoT) approach is often used in question answering (QA) by language models (LMs) for tasks that require multiple reasoning steps. However, some QA tasks hinge more on accessing relevant knowledge than on…

Computation and Language · Computer Science 2025-05-27 Jiacan Yu , Hannah An , Lenhart K. Schubert

Reading comprehension (RC)---in contrast to information retrieval---requires integrating information and reasoning about events, entities, and their relations across a full document. Question answering is conventionally used to assess RC…

Computation and Language · Computer Science 2017-12-20 Tomáš Kočiský , Jonathan Schwarz , Phil Blunsom , Chris Dyer , Karl Moritz Hermann , Gábor Melis , Edward Grefenstette

When writing and talking, people sometimes pause to think. Although reasoning-focused works have often framed reasoning as a method of answering questions or completing agentic tasks, reasoning is implicit in almost all written text. For…

Computation and Language · Computer Science 2024-03-19 Eric Zelikman , Georges Harik , Yijia Shao , Varuna Jayasiri , Nick Haber , Noah D. Goodman

Recent approaches to empathetic response generation try to incorporate commonsense knowledge or reasoning about the causes of emotions to better understand the user's experiences and feelings. However, these approaches mainly focus on…

Computation and Language · Computer Science 2023-09-06 Yahui Fu , Koji Inoue , Chenhui Chu , Tatsuya Kawahara

Pretrained language models have demonstrated outstanding performance in many NLP tasks recently. However, their social intelligence, which requires commonsense reasoning about the current situation and mental states of others, is still…

Computation and Language · Computer Science 2021-05-14 Ting-Yun Chang , Yang Liu , Karthik Gopalakrishnan , Behnam Hedayatnia , Pei Zhou , Dilek Hakkani-Tur