English
Related papers

Related papers: Winograd Schema - Knowledge Extraction Using Narra…

200 papers

We introduce an automatic system that achieves state-of-the-art results on the Winograd Schema Challenge (WSC), a common sense reasoning task that requires diverse, complex forms of inference and knowledge. Our method uses a knowledge…

Computation and Language · Computer Science 2018-10-03 Ali Emami , Noelia De La Cruz , Adam Trischler , Kaheer Suleman , Jackie Chi Kit Cheung

The Winograd Schema Challenge (WSC) is a common-sense reasoning task that requires background knowledge. In this paper, we contribute to tackling WSC in four ways. Firstly, we suggest a keyword method to define a restricted domain where…

Computation and Language · Computer Science 2020-11-25 Suk Joon Hong , Brandon Bennett

In this paper, we present the first comprehensive categorization of essential commonsense knowledge for answering the Winograd Schema Challenge (WSC). For each of the questions, we invite annotators to first provide reasons for making…

Artificial Intelligence · Computer Science 2020-05-13 Hongming Zhang , Xinran Zhao , Yangqiu Song

The Winograd Schema Challenge (WSC) is a natural language understanding task proposed as an alternative to the Turing test in 2011. In this work we attempt to solve WSC problems by reasoning with additional knowledge. By using an approach…

Artificial Intelligence · Computer Science 2019-07-26 Arpit Sharma

The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a pair of sentences differing in one or two words with a…

Computation and Language · Computer Science 2020-04-30 Vid Kocijan , Thomas Lukasiewicz , Ernest Davis , Gary Marcus , Leora Morgenstern

Winograd Schema Challenge (WSC) was proposed as an AI-hard problem in testing computers' intelligence on common sense representation and reasoning. This paper presents the new state-of-theart on WSC, achieving an accuracy of 71.1%. We…

Computation and Language · Computer Science 2019-04-23 Yu-Ping Ruan , Xiaodan Zhu , Zhen-Hua Ling , Zhan Shi , Quan Liu , Si Wei

Successful completion of reasoning task requires the agent to have relevant prior knowledge or some given context of the world dynamics. Usually, the information provided to the system for a reasoning task is just the query or some…

Artificial Intelligence · Computer Science 2019-11-18 Vatsal Mahajan

Ambiguities in natural language give rise to probability distributions over interpretations. The distributions are often over multiple ambiguous words at a time; a multiplicity which makes them a suitable topic for sheaf-theoretic models of…

Computation and Language · Computer Science 2023-09-01 Kin Ian Lo , Mehrnoosh Sadrzadeh , Shane Mansfield

The Winograd Schema Challenge (WSC) (Levesque, Davis, and Morgenstern 2011), a benchmark for commonsense reasoning, is a set of 273 expert-crafted pronoun resolution problems originally designed to be unsolvable for statistical models that…

Computation and Language · Computer Science 2019-11-25 Keisuke Sakaguchi , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

Commonsense reasoning is a long-standing challenge for deep learning. For example, it is difficult to use neural networks to tackle the Winograd Schema dataset (Levesque et al., 2011). In this paper, we present a simple method for…

Artificial Intelligence · Computer Science 2019-09-30 Trieu H. Trinh , Quoc V. Le

Challenge sets such as the Winograd Schema Challenge (WSC) are used to benchmark systems' ability to resolve ambiguities in natural language. If one assumes as in existing work that solving a given challenge set is at least as difficult as…

Computation and Language · Computer Science 2024-10-15 Ian Porada , Jackie Chi Kit Cheung

The Winograd Schema (WS) has been proposed as a test for measuring commonsense capabilities of models. Recently, pre-trained language model-based approaches have boosted performance on some WS benchmarks but the source of improvement is…

Computation and Language · Computer Science 2021-10-14 Yanai Elazar , Hongming Zhang , Yoav Goldberg , Dan Roth

The Winograd Schema Challenge (WSC) serves as a prominent benchmark for evaluating machine understanding. While Large Language Models (LLMs) excel at answering WSC questions, their ability to generate such questions remains less explored.…

Computation and Language · Computer Science 2024-02-01 Pardis Sadat Zahraei , Ali Emami

In the last decade, the Winograd Schema Challenge (WSC) has become a central aspect of the research community as a novel litmus test. Consequently, the WSC has spurred research interest because it can be seen as the means to understand…

Artificial Intelligence · Computer Science 2023-09-07 Nicos Isaak , Loizos Michael

The Winograd Schema Challenge - a set of twin sentences involving pronoun reference disambiguation that seem to require the use of commonsense knowledge - was proposed by Hector Levesque in 2011. By 2019, a number of AI systems, based on…

Computation and Language · Computer Science 2023-01-24 Vid Kocijan , Ernest Davis , Thomas Lukasiewicz , Gary Marcus , Leora Morgenstern

The Winograd Schema (WS) challenge, proposed as an al-ternative to the Turing Test, has become the new standard for evaluating progress in natural language understanding (NLU). In this paper we will not however be concerned with how this…

Artificial Intelligence · Computer Science 2019-02-13 Walid S. Saba

A Winograd schema is a pair of sentences that differ in a single word and that contain an ambiguous pronoun whose referent is different in the two sentences and requires the use of commonsense knowledge or world knowledge to disambiguate.…

Artificial Intelligence · Computer Science 2016-10-04 Ernest Davis

Performance on the Winograd Schema Challenge (WSC), a respected English commonsense reasoning benchmark, recently rocketed from chance accuracy to 89% on the SuperGLUE leaderboard, with relatively little corroborating evidence of a…

Computation and Language · Computer Science 2020-10-09 Haokun Liu , William Huang , Dhara A. Mungra , Samuel R. Bowman

The Winograd Schema Challenge (WSC) and variants inspired by it have become important benchmarks for common-sense reasoning (CSR). Model performance on the WSC has quickly progressed from chance-level to near-human using neural language…

Computation and Language · Computer Science 2020-11-16 Ali Emami , Adam Trischler , Kaheer Suleman , Jackie Chi Kit Cheung

Commonsense reasoning is fundamental to natural language understanding. While traditional methods rely heavily on human-crafted features and knowledge bases, we explore learning commonsense knowledge from a large amount of raw text via…

Computation and Language · Computer Science 2019-04-04 Shuohang Wang , Sheng Zhang , Yelong Shen , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Jing Jiang
‹ Prev 1 2 3 10 Next ›