English
Related papers

Related papers: Baselines and test data for cross-lingual inferenc…

200 papers

State-of-the-art natural language processing systems rely on supervision in the form of annotated data to learn competent models. These models are generally trained on data in a single language (usually English), and cannot be directly used…

Computation and Language · Computer Science 2018-09-14 Alexis Conneau , Guillaume Lample , Ruty Rinott , Adina Williams , Samuel R. Bowman , Holger Schwenk , Veselin Stoyanov

Large language models (LLMs) are increasingly applied in multilingual contexts, yet their capacity for consistent, logically grounded alignment across languages remains underexplored. We present a controlled evaluation framework for…

Computation and Language · Computer Science 2025-08-21 Samir Abdaljalil , Erchin Serpedin , Khalid Qaraqe , Hasan Kurban

Natural Language Inference (NLI) is a hot topic research in natural language processing, contradiction detection between sentences is a special case of NLI. This is considered a difficult NLP task which has a big influence when added as a…

Computation and Language · Computer Science 2023-04-05 Khloud Al Jallad , Nada Ghneim

Natural Language Inference (NLI) is the task of inferring whether the hypothesis can be justified by the given premise. Basically, we classify the hypothesis into three labels(entailment, neutrality and contradiction) given the premise. NLI…

Computation and Language · Computer Science 2024-12-11 Zijiang Yang

This paper extends the task of probing sentence representations for linguistic insight in a multilingual domain. In doing so, we make two contributions: first, we provide datasets for multilingual probing, derived from Wikipedia, in five…

Computation and Language · Computer Science 2019-06-13 Vinit Ravishankar , Lilja Øvrelid , Erik Velldal

Natural Language Processing systems are heavily dependent on the availability of annotated data to train practical models. Primarily, models are trained on English datasets. In recent times, significant advances have been made in…

Computation and Language · Computer Science 2023-01-18 Ankit Kumar Upadhyay , Harsit Kumar Upadhya

Natural language inference (NLI) is the task of determining if a natural language hypothesis can be inferred from a given premise in a justifiable manner. NLI was proposed as a benchmark task for natural language understanding. Existing…

Computation and Language · Computer Science 2018-06-15 Aakanksha Naik , Abhilasha Ravichander , Norman Sadeh , Carolyn Rose , Graham Neubig

We propose a hypothesis only baseline for diagnosing Natural Language Inference (NLI). Especially when an NLI dataset assumes inference is occurring based purely on the relationship between a context and a hypothesis, it follows that…

Computation and Language · Computer Science 2018-05-04 Adam Poliak , Jason Naradowsky , Aparajita Haldar , Rachel Rudinger , Benjamin Van Durme

The task of scientific Natural Language Inference (NLI) involves predicting the semantic relation between two sentences extracted from research articles. This task was recently proposed along with a new dataset called SciNLI derived from…

Computation and Language · Computer Science 2024-04-15 Mobashir Sadat , Cornelia Caragea

Natural language inference (NLI) is a fundamentally important task in natural language processing that has many applications. The recently released Stanford Natural Language Inference (SNLI) corpus has made it possible to develop and…

Computation and Language · Computer Science 2016-11-11 Shuohang Wang , Jing Jiang

The ability to understand logical relationships between sentences is an important task in language understanding. To aid in progress for this task, researchers have collected datasets for machine learning and evaluation of current systems.…

Computation and Language · Computer Science 2019-06-25 Shawn Tan , Yikang Shen , Chin-wei Huang , Aaron Courville

Abstractive summarization has enjoyed renewed interest in recent years, thanks to pre-trained language models and the availability of large-scale datasets. Despite promising results, current models still suffer from generating factually…

Computation and Language · Computer Science 2024-01-08 Roee Aharoni , Shashi Narayan , Joshua Maynez , Jonathan Herzig , Elizabeth Clark , Mirella Lapata

Cross-lingual word embeddings (CLEs) enable multilingual modeling of meaning and facilitate cross-lingual transfer of NLP models. Despite their ubiquitous usage in downstream tasks, recent increasingly popular projection-based CLE models…

Computation and Language · Computer Science 2019-06-07 Goran Glavas , Robert Litschko , Sebastian Ruder , Ivan Vulic

Many recent studies have shown that for models trained on datasets for natural language inference (NLI), it is possible to make correct predictions by merely looking at the hypothesis while completely ignoring the premise. In this work, we…

Computation and Language · Computer Science 2021-03-16 Tianyu Liu , Xin Zheng , Baobao Chang , Zhifang Sui

Word alignments identify translational correspondences between words in a parallel sentence pair and is used, for instance, to learn bilingual dictionaries, to train statistical machine translation systems , or to perform quality…

Computation and Language · Computer Science 2020-09-29 Anh Khoa Ngo Ho , François Yvon

Native language identification (NLI) is the task of training (via supervised machine learning) a classifier that guesses the native language of the author of a text. This task has been extensively researched in the last decade, and the…

Computation and Language · Computer Science 2022-08-03 Barbara Berti , Andrea Esuli , Fabrizio Sebastiani

We introduce Uncertain Natural Language Inference (UNLI), a refinement of Natural Language Inference (NLI) that shifts away from categorical labels, targeting instead the direct prediction of subjective probability assessments. We…

Computation and Language · Computer Science 2020-05-06 Tongfei Chen , Zhengping Jiang , Adam Poliak , Keisuke Sakaguchi , Benjamin Van Durme

The aim of this article is to investigate the fine-tuning potential of natural language inference (NLI) data to improve information retrieval and ranking. We demonstrate this for both English and Polish languages, using data from one of the…

Computation and Language · Computer Science 2023-08-08 Roman Dušek , Aleksander Wawer , Christopher Galias , Lidia Wojciechowska

Recent studies show that crowd-sourced Natural Language Inference (NLI) datasets may suffer from significant biases like annotation artifacts. Models utilizing these superficial clues gain mirage advantages on the in-domain testing set,…

Computation and Language · Computer Science 2020-10-16 Guanhua Zhang , Bing Bai , Jian Liang , Kun Bai , Conghui Zhu , Tiejun Zhao

Natural language inference (NLI) is a fundamental NLP task, investigating the entailment relationship between two texts. Popular NLI datasets present the task at sentence-level. While adequate for testing semantic representations, they fall…

Computation and Language · Computer Science 2020-11-11 Hanmeng Liu , Leyang Cui , Jian Liu , Yue Zhang
‹ Prev 1 2 3 10 Next ›