中文
相关论文

相关论文: On the Winograd Schema: Situating Language Underst…

200 篇论文

The Winograd Schema Challenge is both a commonsense reasoning and natural language understanding challenge, introduced as an alternative to the Turing test. A Winograd schema is a pair of sentences differing in one or two words with a…

计算与语言 · 计算机科学 2020-04-30 Vid Kocijan , Thomas Lukasiewicz , Ernest Davis , Gary Marcus , Leora Morgenstern

The Winograd Schema (WS) has been proposed as a test for measuring commonsense capabilities of models. Recently, pre-trained language model-based approaches have boosted performance on some WS benchmarks but the source of improvement is…

计算与语言 · 计算机科学 2021-10-14 Yanai Elazar , Hongming Zhang , Yoav Goldberg , Dan Roth

The Winograd Schema Challenge (WSC) is a natural language understanding task proposed as an alternative to the Turing test in 2011. In this work we attempt to solve WSC problems by reasoning with additional knowledge. By using an approach…

人工智能 · 计算机科学 2019-07-26 Arpit Sharma

We introduce an automatic system that achieves state-of-the-art results on the Winograd Schema Challenge (WSC), a common sense reasoning task that requires diverse, complex forms of inference and knowledge. Our method uses a knowledge…

计算与语言 · 计算机科学 2018-10-03 Ali Emami , Noelia De La Cruz , Adam Trischler , Kaheer Suleman , Jackie Chi Kit Cheung

The Winograd Schema Challenge (WSC) is a test of machine intelligence, designed to be an improvement on the Turing test. A Winograd Schema consists of a sentence and a corresponding question. To successfully answer these questions, one…

人工智能 · 计算机科学 2018-01-09 Vatsal Mahajan

The Winograd Schema Challenge (WSC) is a common-sense reasoning task that requires background knowledge. In this paper, we contribute to tackling WSC in four ways. Firstly, we suggest a keyword method to define a restricted domain where…

计算与语言 · 计算机科学 2020-11-25 Suk Joon Hong , Brandon Bennett

Challenge sets such as the Winograd Schema Challenge (WSC) are used to benchmark systems' ability to resolve ambiguities in natural language. If one assumes as in existing work that solving a given challenge set is at least as difficult as…

计算与语言 · 计算机科学 2024-10-15 Ian Porada , Jackie Chi Kit Cheung

In the last decade, the Winograd Schema Challenge (WSC) has become a central aspect of the research community as a novel litmus test. Consequently, the WSC has spurred research interest because it can be seen as the means to understand…

人工智能 · 计算机科学 2023-09-07 Nicos Isaak , Loizos Michael

The Winograd Schema Challenge (WSC) serves as a prominent benchmark for evaluating machine understanding. While Large Language Models (LLMs) excel at answering WSC questions, their ability to generate such questions remains less explored.…

计算与语言 · 计算机科学 2024-02-01 Pardis Sadat Zahraei , Ali Emami

The Winograd Schema Challenge (WSC), a seemingly well-thought-out test for machine intelligence, has been proposed to shed light on developing systems that exhibit human behavior. Since its introduction, it aimed to pivot the focus of the…

人机交互 · 计算机科学 2024-02-14 Nicos Isaak

Large-scale pretrained language models are the major driving force behind recent improvements in performance on the Winograd Schema Challenge, a widely employed test of common sense reasoning ability. We show, however, with a new diagnostic…

计算与语言 · 计算机科学 2020-05-08 Mostafa Abdou , Vinit Ravishankar , Maria Barrett , Yonatan Belinkov , Desmond Elliott , Anders Søgaard

Ambiguities in natural language give rise to probability distributions over interpretations. The distributions are often over multiple ambiguous words at a time; a multiplicity which makes them a suitable topic for sheaf-theoretic models of…

计算与语言 · 计算机科学 2023-09-01 Kin Ian Lo , Mehrnoosh Sadrzadeh , Shane Mansfield

Large Language Models (LLMs) have demonstrated remarkable success in tasks like the Winograd Schema Challenge (WSC), showcasing advanced textual common-sense reasoning. However, applying this reasoning to multimodal domains, where…

计算与语言 · 计算机科学 2024-06-04 Brendan Park , Madeline Janecek , Naser Ezzati-Jivan , Yifeng Li , Ali Emami

A Winograd schema is a pair of sentences that differ in a single word and that contain an ambiguous pronoun whose referent is different in the two sentences and requires the use of commonsense knowledge or world knowledge to disambiguate.…

人工智能 · 计算机科学 2016-10-04 Ernest Davis

The Winograd Schema Challenge (WSC) (Levesque, Davis, and Morgenstern 2011), a benchmark for commonsense reasoning, is a set of 273 expert-crafted pronoun resolution problems originally designed to be unsolvable for statistical models that…

计算与语言 · 计算机科学 2019-11-25 Keisuke Sakaguchi , Ronan Le Bras , Chandra Bhagavatula , Yejin Choi

Winograd Schema Challenge (WSC) was proposed as an AI-hard problem in testing computers' intelligence on common sense representation and reasoning. This paper presents the new state-of-theart on WSC, achieving an accuracy of 71.1%. We…

计算与语言 · 计算机科学 2019-04-23 Yu-Ping Ruan , Xiaodan Zhu , Zhen-Hua Ling , Zhan Shi , Quan Liu , Si Wei

Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extracted from a neural…

计算与语言 · 计算机科学 2016-11-08 Dayu Yuan , Julian Richardson , Ryan Doherty , Colin Evans , Eric Altendorf

Performance on the Winograd Schema Challenge (WSC), a respected English commonsense reasoning benchmark, recently rocketed from chance accuracy to 89% on the SuperGLUE leaderboard, with relatively little corroborating evidence of a…

计算与语言 · 计算机科学 2020-10-09 Haokun Liu , William Huang , Dhara A. Mungra , Samuel R. Bowman

While Large Language Models (LLMs) excel at the Winograd Schema Challenge (WSC), a coreference resolution task testing common-sense reasoning through pronoun disambiguation, they struggle with instances that feature minor alterations or…

计算与语言 · 计算机科学 2024-02-23 Jing Han Sun , Ali Emami

In 'Winograd Schema' (WS) sentences like "The city councilmen refused the demonstrators a permit because they feared violence" and "The city councilmen refused the demonstrators a permit because they advocated revolution", it is easy for…

人工智能 · 计算机科学 2018-10-11 J Gerard Wolff
‹ 上一页 1 2 3 10 下一页 ›