English
Related papers

Related papers: A Review of Winograd Schema Challenge Datasets and…

200 papers

A Winograd schema is a pair of sentences that differ in a single word and that contain an ambiguous pronoun whose referent is different in the two sentences and requires the use of commonsense knowledge or world knowledge to disambiguate.…

Artificial Intelligence · Computer Science 2016-10-04 Ernest Davis

The Winograd Schema Challenge - a set of twin sentences involving pronoun reference disambiguation that seem to require the use of commonsense knowledge - was proposed by Hector Levesque in 2011. By 2019, a number of AI systems, based on…

Computation and Language · Computer Science 2023-01-24 Vid Kocijan , Ernest Davis , Thomas Lukasiewicz , Gary Marcus , Leora Morgenstern

The Winograd Schema Challenge (WSC) (Levesque, Davis, and Morgenstern 2011), a benchmark for commonsense reasoning, is a set of 273 expert-crafted pronoun resolution problems originally designed to be unsolvable for statistical models that…

Computation and Language · Computer Science 2019-11-25 Keisuke Sakaguchi , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

The Winograd Schema Challenge (WSC) is a test of machine intelligence, designed to be an improvement on the Turing test. A Winograd Schema consists of a sentence and a corresponding question. To successfully answer these questions, one…

Artificial Intelligence · Computer Science 2018-01-09 Vatsal Mahajan

Large-scale pretrained language models are the major driving force behind recent improvements in performance on the Winograd Schema Challenge, a widely employed test of common sense reasoning ability. We show, however, with a new diagnostic…

Computation and Language · Computer Science 2020-05-08 Mostafa Abdou , Vinit Ravishankar , Maria Barrett , Yonatan Belinkov , Desmond Elliott , Anders Søgaard

The Winograd Schema (WS) challenge, proposed as an al-ternative to the Turing Test, has become the new standard for evaluating progress in natural language understanding (NLU). In this paper we will not however be concerned with how this…

Artificial Intelligence · Computer Science 2019-02-13 Walid S. Saba

Commonsense reasoning is a long-standing challenge for deep learning. For example, it is difficult to use neural networks to tackle the Winograd Schema dataset (Levesque et al., 2011). In this paper, we present a simple method for…

Artificial Intelligence · Computer Science 2019-09-30 Trieu H. Trinh , Quoc V. Le

Ambiguities in natural language give rise to probability distributions over interpretations. The distributions are often over multiple ambiguous words at a time; a multiplicity which makes them a suitable topic for sheaf-theoretic models of…

Computation and Language · Computer Science 2023-09-01 Kin Ian Lo , Mehrnoosh Sadrzadeh , Shane Mansfield

Challenge sets such as the Winograd Schema Challenge (WSC) are used to benchmark systems' ability to resolve ambiguities in natural language. If one assumes as in existing work that solving a given challenge set is at least as difficult as…

Computation and Language · Computer Science 2024-10-15 Ian Porada , Jackie Chi Kit Cheung

The Winograd Schema (WS) has been proposed as a test for measuring commonsense capabilities of models. Recently, pre-trained language model-based approaches have boosted performance on some WS benchmarks but the source of improvement is…

Computation and Language · Computer Science 2021-10-14 Yanai Elazar , Hongming Zhang , Yoav Goldberg , Dan Roth

Winograd Schema Challenge (WSC) was proposed as an AI-hard problem in testing computers' intelligence on common sense representation and reasoning. This paper presents the new state-of-theart on WSC, achieving an accuracy of 71.1%. We…

Computation and Language · Computer Science 2019-04-23 Yu-Ping Ruan , Xiaodan Zhu , Zhen-Hua Ling , Zhan Shi , Quan Liu , Si Wei

The Winograd Schema Challenge (WSC) is a natural language understanding task proposed as an alternative to the Turing test in 2011. In this work we attempt to solve WSC problems by reasoning with additional knowledge. By using an approach…

Artificial Intelligence · Computer Science 2019-07-26 Arpit Sharma

In this paper, we present the first comprehensive categorization of essential commonsense knowledge for answering the Winograd Schema Challenge (WSC). For each of the questions, we invite annotators to first provide reasons for making…

Artificial Intelligence · Computer Science 2020-05-13 Hongming Zhang , Xinran Zhao , Yangqiu Song

We introduce an automatic system that achieves state-of-the-art results on the Winograd Schema Challenge (WSC), a common sense reasoning task that requires diverse, complex forms of inference and knowledge. Our method uses a knowledge…

Computation and Language · Computer Science 2018-10-03 Ali Emami , Noelia De La Cruz , Adam Trischler , Kaheer Suleman , Jackie Chi Kit Cheung

The Winograd Schema Challenge (WSC) is a common-sense reasoning task that requires background knowledge. In this paper, we contribute to tackling WSC in four ways. Firstly, we suggest a keyword method to define a restricted domain where…

Computation and Language · Computer Science 2020-11-25 Suk Joon Hong , Brandon Bennett

Commonsense reasoning is one of the important aspect of natural language understanding, with several benchmarks developed to evaluate it. However, only a few of these benchmarks are available in languages other than English. Developing…

Computation and Language · Computer Science 2024-12-17 Phakphum Artkaew

Can we get existing language models and refine them for zero-shot commonsense reasoning? This paper presents an initial study exploring the feasibility of zero-shot commonsense reasoning for the Winograd Schema Challenge by formulating the…

Computation and Language · Computer Science 2021-09-14 Tassilo Klein , Moin Nabi

We propose a self-supervised method to solve Pronoun Disambiguation and Winograd Schema Challenge problems. Our approach exploits the characteristic structure of training corpora related to so-called "trigger" words, which are responsible…

Computation and Language · Computer Science 2020-05-06 Tassilo Klein , Moin Nabi

Recent studies have significantly improved the state-of-the-art on common-sense reasoning (CSR) benchmarks like the Winograd Schema Challenge (WSC) and SWAG. The question we ask in this paper is whether improved performance on these…

Machine Learning · Computer Science 2021-09-27 Paul Trichelair , Ali Emami , Adam Trischler , Kaheer Suleman , Jackie Chi Kit Cheung

The recently introduced BERT model exhibits strong performance on several language understanding benchmarks. In this paper, we describe a simple re-implementation of BERT for commonsense reasoning. We show that the attentions produced by…

Computation and Language · Computer Science 2019-06-03 Tassilo Klein , Moin Nabi
‹ Prev 1 2 3 10 Next ›