English
Related papers

Related papers: A Broad-Coverage Challenge Corpus for Sentence Und…

200 papers

A recurring challenge of crowdsourcing NLP datasets at scale is that human writers often rely on repetitive patterns when crafting examples, leading to a lack of linguistic diversity. We introduce a novel approach for dataset creation based…

Computation and Language · Computer Science 2022-11-16 Alisa Liu , Swabha Swayamdipta , Noah A. Smith , Yejin Choi

Commonsense reasoning research has so far been limited to English. We aim to evaluate and improve popular multilingual language models (ML-LMs) to help advance commonsense reasoning (CSR) beyond English. We collect the Mickey Corpus,…

Computation and Language · Computer Science 2021-06-15 Bill Yuchen Lin , Seyeon Lee , Xiaoyang Qiao , Xiang Ren

Recent studies show that crowd-sourced Natural Language Inference (NLI) datasets may suffer from significant biases like annotation artifacts. Models utilizing these superficial clues gain mirage advantages on the in-domain testing set,…

Computation and Language · Computer Science 2020-10-16 Guanhua Zhang , Bing Bai , Jian Liang , Kun Bai , Conghui Zhu , Tiejun Zhao

While Natural Language Inference (NLI) models have achieved high performances on benchmark datasets, there are still concerns whether they truly capture the intended task, or largely exploit dataset artifacts. Through detailed analysis of…

Computation and Language · Computer Science 2024-12-24 Karthik Sivakoti

The recently proposed SNLI-VE corpus for recognising visual-textual entailment is a large, real-world dataset for fine-grained multimodal reasoning. However, the automatic way in which SNLI-VE has been assembled (via combining parts of two…

Computation and Language · Computer Science 2021-08-20 Virginie Do , Oana-Maria Camburu , Zeynep Akata , Thomas Lukasiewicz

As natural language processing (NLP) for gender bias becomes a significant interdisciplinary topic, the prevalent data-driven techniques such as large-scale language models suffer from data inadequacy and biased corpus, especially for…

Computation and Language · Computer Science 2023-01-03 Ge Zhang , Yizhi Li , Yaoyao Wu , Linyuan Zhang , Chenghua Lin , Jiayi Geng , Shi Wang , Jie Fu

Cross-lingual document classification aims at training a document classifier on resources in one language and transferring it to a different language without any additional resources. Several approaches have been proposed in the literature…

Computation and Language · Computer Science 2018-05-28 Holger Schwenk , Xian Li

Large-scale datasets for natural language inference are created by presenting crowd workers with a sentence (premise), and asking them to generate three new sentences (hypotheses) that it entails, contradicts, or is logically neutral with…

Computation and Language · Computer Science 2018-04-18 Suchin Gururangan , Swabha Swayamdipta , Omer Levy , Roy Schwartz , Samuel R. Bowman , Noah A. Smith

Natural Language Inference (NLI) is a central task in natural language understanding with applications in fact-checking, question answering, and information retrieval. Despite its importance, current NLI systems heavily rely on supervised…

Computation and Language · Computer Science 2025-05-07 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

Recent years have seen a growing number of publications that analyse Natural Language Inference (NLI) datasets for superficial cues, whether they undermine the complexity of the tasks underlying those datasets and how they impact those…

Computation and Language · Computer Science 2020-06-01 Viktor Schlegel , Goran Nenadic , Riza Batista-Navarro

Comparative constructions pose a challenge in Natural Language Inference (NLI), which is the task of determining whether a text entails a hypothesis. Comparatives are structurally complex in that they interact with other linguistic…

Computation and Language · Computer Science 2020-05-19 Izumi Haruta , Koji Mineshima , Daisuke Bekki

In the recent past, a popular way of evaluating natural language understanding (NLU), was to consider a model's ability to perform natural language inference (NLI) tasks. In this paper, we investigate if NLI tasks, that are rarely used for…

Computation and Language · Computer Science 2024-11-22 Lovish Madaan , David Esiobu , Pontus Stenetorp , Barbara Plank , Dieuwke Hupkes

Multilingual topic models enable crosslingual tasks by extracting consistent topics from multilingual corpora. Most models require parallel or comparable training corpora, which limits their ability to generalize. In this paper, we first…

Computation and Language · Computer Science 2018-06-13 Shudong Hao , Michael J. Paul

In this paper, we present a multi-lingual sentence encoder that can be used in search engines as a query and document encoder. This embedding enables a semantic similarity score between queries and documents that can be an important feature…

Computation and Language · Computer Science 2021-06-16 Mahdi Hajiaghayi , Monir Hajiaghayi , Mark Bolin

In this paper, we present a novel algorithm that combines multi-context term embeddings using a neural classifier and we test this approach on the use case of corpus-based term set expansion. In addition, we present a novel and unique…

Computation and Language · Computer Science 2019-04-11 Jonathan Mamou , Oren Pereg , Moshe Wasserblat , Ido Dagan

We present DepCC, the largest-to-date linguistically analyzed corpus in English including 365 million documents, composed of 252 billion tokens and 7.5 billion of named entity occurrences in 14.3 billion sentences from a web-scale crawl of…

Computation and Language · Computer Science 2018-03-01 Alexander Panchenko , Eugen Ruppert , Stefano Faralli , Simone Paolo Ponzetto , Chris Biemann

In this paper, we use the framework of neural machine translation to learn joint sentence representations across six very different languages. Our aim is that a representation which is independent of the language, is likely to capture the…

Computation and Language · Computer Science 2017-08-09 Holger Schwenk , Matthijs Douze

The Natural Language Inference (NLI) task is an important task in modern NLP, as it asks a broad question to which many other tasks may be reducible: Given a pair of sentences, does the first entail the second? Although the state-of-the-art…

Artificial Intelligence · Computer Science 2020-05-07 Zaid Marji , Animesh Nighojkar , John Licato

In machine translation field, in both academia and industry, there is a growing interest in increasingly powerful systems, using corpora of several hundred million to several billion examples. These systems represent the state-of-the-art.…

Computation and Language · Computer Science 2021-01-27 Raoul Blin

Much of human communication depends on implication, conveying meaning beyond literal words to express a wider range of thoughts, intentions, and feelings. For models to better understand and facilitate human communication, they must be…

Computation and Language · Computer Science 2025-01-20 Shreya Havaldar , Hamidreza Alvari , John Palowitch , Mohammad Javad Hosseini , Senaka Buthpitiya , Alex Fabrikant