中文
相关论文

相关论文: IndoNLI: A Natural Language Inference Dataset for …

200 篇论文

Large Language Models (LLMs) are widely used for writing economic analysis reports or providing financial advice, but their ability to understand economic knowledge and reason about potential results of specific economic events lacks…

计算与语言 · 计算机科学 2024-07-02 Yue Guo , Yi Yang

Natural Language Inference (NLI) is a central task in natural language understanding with applications in fact-checking, question answering, and information retrieval. Despite its importance, current NLI systems heavily rely on supervised…

计算与语言 · 计算机科学 2025-05-07 Pablo Miralles-González , Javier Huertas-Tato , Alejandro Martín , David Camacho

Linguistic annotation of transcribed speech is essential for research in language acquisition, language disorders, and sociolinguistics, yet remains labor-intensive and time-consuming. While Large Language Models (LLMs) have shown promise…

计算与语言 · 计算机科学 2026-05-19 Qingwen Zhao , Hongao Zhu , Yunqi He , Rui Wang , Aijun Huang , Hai Hu

There is an emerging effort to develop NLP for Indonesias 700+ local languages, but progress remains costly due to the need for direct engagement with native speakers. However, it is unclear what these language communities truly need from…

计算与语言 · 计算机科学 2025-09-30 Muhammad Dehan Al Kautsar , Lucky Susanto , Derry Wijaya , Fajri Koto

Natural Language Inference (NLI) is foundational for evaluating language understanding in AI. However, progress has plateaued, with models failing on ambiguous examples and exhibiting poor generalization. We argue that this stems from…

计算与语言 · 计算机科学 2024-05-21 Claudiu Creanga , Liviu P. Dinu

Human label variation, or annotation disagreement, exists in many natural language processing (NLP) tasks, including natural language inference (NLI). To gain direct evidence of how NLI label variation arises, we build LiveNLI, an English…

计算与语言 · 计算机科学 2023-10-24 Nan-Jiang Jiang , Chenhao Tan , Marie-Catherine de Marneffe

Natural Language Inference (NLI) remains an important benchmark task for LLMs. NLI datasets are a springboard for transfer learning to other semantic tasks, and NLI models are standard tools for identifying the faithfulness of…

计算与语言 · 计算机科学 2024-07-01 Mohammad Javad Hosseini , Andrey Petrov , Alex Fabrikant , Annie Louis

XNLI is a popular Natural Language Inference (NLI) benchmark widely used to evaluate cross-lingual Natural Language Understanding (NLU) capabilities across languages. In this paper, we expand XNLI to include Basque, a low-resource language…

计算与语言 · 计算机科学 2024-04-11 Maite Heredia , Julen Etxaniz , Muitze Zulaika , Xabier Saralegi , Jeremy Barnes , Aitor Soroa

Recently there have been intensifying efforts to improve the understanding of Indonesian cultures by large language models (LLMs). An attractive source of cultural knowledge that has been largely overlooked is local journals of social…

计算与语言 · 计算机科学 2026-01-21 Adimulya Kartiyasa , Bao Gia Cao , Boyang Li

While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference-related knowledge (including commonsense) provided in the annotated data is still rather limited. There…

计算与语言 · 计算机科学 2021-09-10 Xiaoyu Yang , Xiaodan Zhu , Zhan Shi , Tianda Li

Reviewing contracts is a time-consuming procedure that incurs large expenses to companies and social inequality to those who cannot afford it. In this work, we propose "document-level natural language inference (NLI) for contracts", a…

计算与语言 · 计算机科学 2021-10-06 Yuta Koreeda , Christopher D. Manning

Native language identification (NLI) is the task of training (via supervised machine learning) a classifier that guesses the native language of the author of a text. This task has been extensively researched in the last decade, and the…

计算与语言 · 计算机科学 2022-08-03 Barbara Berti , Andrea Esuli , Fabrizio Sebastiani

Natural Language Inference (NLI) is the task of determining whether a sentence pair represents entailment, contradiction, or a neutral relationship. While NLI models perform well on many inference tasks, their ability to handle fine-grained…

计算与语言 · 计算机科学 2025-06-09 Tara Azin , Daniel Dumitrescu , Diana Inkpen , Raj Singh

How can we interpret and retrieve medical evidence to support clinical decisions? Clinical trial reports (CTR) amassed over the years contain indispensable information for the development of personalized medicine. However, it is practically…

计算与语言 · 计算机科学 2023-10-31 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

Pre-trained Transformer-based neural architectures have consistently achieved state-of-the-art performance in the Natural Language Inference (NLI) task. Since NLI examples encompass a variety of linguistic, logical, and reasoning phenomena,…

人工智能 · 计算机科学 2020-10-12 Pratik Joshi , Somak Aditya , Aalok Sathe , Monojit Choudhury

Despite rapid progress in vision-language and large language models (VLMs and LLMs), their effectiveness for AI-driven educational assessment in real-world, underrepresented classrooms remains largely unexplored. We evaluate…

计算与语言 · 计算机科学 2026-04-02 Nurul Aisyah , Muhammad Dehan Al Kautsar , Arif Hidayat , Raqib Chowdhury , Fajri Koto

Many natural language processing (NLP) tasks rely on labeled data to train machine learning models with high performance. However, data annotation is time-consuming and expensive, especially when the task involves a large amount of data or…

计算与语言 · 计算机科学 2024-04-08 Xingwei He , Zhenghao Lin , Yeyun Gong , A-Long Jin , Hang Zhang , Chen Lin , Jian Jiao , Siu Ming Yiu , Nan Duan , Weizhu Chen

We introduce a novel approach to incorporate syntax into natural language inference (NLI) models. Our method uses contextual token-level vector representations from a pretrained dependency parser. Like other contextual embedders, our method…

计算与语言 · 计算机科学 2019-09-19 Deric Pang , Lucy H. Lin , Noah A. Smith

Although region-specific large language models (LLMs) are increasingly developed, their safety remains underexplored, particularly in culturally diverse settings like Indonesia, where sensitivity to local norms is essential and highly…

计算与语言 · 计算机科学 2025-06-04 Muhammad Falensi Azmi , Muhammad Dehan Al Kautsar , Alfan Farizki Wicaksono , Fajri Koto

This work introduces a natural language inference (NLI) dataset that focuses on the validity of statements in legal wills. This dataset is unique because: (a) each entailment decision requires three inputs: the statement from the will, the…

计算与语言 · 计算机科学 2022-11-01 Alice Saebom Kwak , Jacob O. Israelsen , Clayton T. Morrison , Derek E. Bambauer , Mihai Surdeanu