中文
相关论文

相关论文: MSciNLI: A Diverse Benchmark for Scientific Natura…

200 篇论文

Natural Language Inference (NLI) is the task of inferring whether the hypothesis can be justified by the given premise. Basically, we classify the hypothesis into three labels(entailment, neutrality and contradiction) given the premise. NLI…

计算与语言 · 计算机科学 2024-12-11 Zijiang Yang

In recent years, the Natural Language Inference (NLI) task has garnered significant attention, with new datasets and models achieving near human-level performance on it. However, the full promise of NLI -- particularly that it learns…

计算与语言 · 计算机科学 2020-09-22 Anshuman Mishra , Dhruvesh Patel , Aparna Vijayakumar , Xiang Li , Pavan Kapanipathi , Kartik Talamadupula

This project investigates the efficacy of Large Language Models (LLMs) in understanding and extracting scientific knowledge across specific domains and to create a deep learning framework: Knowledge AI. As a part of this framework, we…

计算与语言 · 计算机科学 2024-08-12 Balaji Muralidharan , Hayden Beadles , Reza Marzban , Kalyan Sashank Mupparaju

Natural language inference (NLI) is a fundamental NLP task, investigating the entailment relationship between two texts. Popular NLI datasets present the task at sentence-level. While adequate for testing semantic representations, they fall…

计算与语言 · 计算机科学 2020-11-11 Hanmeng Liu , Leyang Cui , Jian Liu , Yue Zhang

Scientific Large Language Models (Sci-LLMs) are transforming how knowledge is represented, integrated, and applied in scientific research, yet their progress is shaped by the complex nature of scientific data. This survey presents a…

计算与语言 · 计算机科学 2025-10-21 Ming Hu , Chenglong Ma , Wei Li , Wanghan Xu , Jiamin Wu , Jucheng Hu , Tianbin Li , Guohang Zhuang , Jiaqi Liu , Yingzhou Lu , Ying Chen , Chaoyang Zhang , Cheng Tan , Jie Ying , Guocheng Wu , Shujian Gao , Pengcheng Chen , Jiashi Lin , Haitao Wu , Lulu Chen , Fengxiang Wang , Yuanyuan Zhang , Xiangyu Zhao , Feilong Tang , Encheng Su , Junzhi Ning , Xinyao Liu , Ye Du , Changkai Ji , Pengfei Jiang , Cheng Tang , Ziyan Huang , Jiyao Liu , Jiaqi Wei , Yuejin Yang , Xiang Zhang , Guangshuai Wang , Yue Yang , Huihui Xu , Ziyang Chen , Yizhou Wang , Chen Tang , Jianyu Wu , Yuchen Ren , Siyuan Yan , Zhonghua Wang , Zhongxing Xu , Shiyan Su , Shangquan Sun , Runkai Zhao , Zhisheng Zhang , Dingkang Yang , Jinjie Wei , Jiaqi Wang , Jiahao Xu , Jiangtao Yan , Wenhao Tang , Hongze Zhu , Yu Liu , Fudi Wang , Yiqing Shen , Yuanfeng Ji , Yanzhou Su , Tong Xie , Hongming Shan , Chun-Mei Feng , Zhi Hou , Diping Song , Lihao Liu , Yanyan Huang , Lequan Yu , Bin Fu , Shujun Wang , Xiaomeng Li , Xiaowei Hu , Yun Gu , Ben Fei , Benyou Wang , Yuewen Cao , Minjie Shen , Jie Xu , Haodong Duan , Fang Yan , Hongxia Hao , Jielan Li , Jiajun Du , Yanbo Wang , Imran Razzak , Zhongying Deng , Chi Zhang , Lijun Wu , Conghui He , Zhaohui Lu , Jinhai Huang , Wenqi Shao , Yihao Liu , Siqi Luo , Yi Xin , Xiaohong Liu , Fenghua Ling , Yuqiang Li , Aoran Wang , Siqi Sun , Qihao Zheng , Nanqing Dong , Tianfan Fu , Dongzhan Zhou , Yan Lu , Wenlong Zhang , Jin Ye , Jianfei Cai , Yirong Chen , Wanli Ouyang , Yu Qiao , Zongyuan Ge , Shixiang Tang , Junjun He , Chunfeng Song , Lei Bai , Bowen Zhou

While Indic NLP has made rapid advances recently in terms of the availability of corpora and pre-trained models, benchmark datasets on standard NLU tasks are limited. To this end, we introduce IndicXNLI, an NLI dataset for 11 Indic…

计算与语言 · 计算机科学 2022-04-20 Divyanshu Aggarwal , Vivek Gupta , Anoop Kunchukuttan

How can we interpret and retrieve medical evidence to support clinical decisions? Clinical trial reports (CTR) amassed over the years contain indispensable information for the development of personalized medicine. However, it is practically…

计算与语言 · 计算机科学 2023-10-31 Maël Jullien , Marco Valentino , Hannah Frost , Paul O'Regan , Donal Landers , André Freitas

Natural Language Inference (NLI) has been extensively studied by the NLP community as a framework for estimating the semantic relation between sentence pairs. While early work identified certain biases in NLI models, recent advancements in…

计算与语言 · 计算机科学 2022-11-02 Tal Schuster , Sihao Chen , Senaka Buthpitiya , Alex Fabrikant , Donald Metzler

In the domain of Natural Language Inference (NLI), especially in tasks involving the classification of multiple input texts, the Cross-Entropy Loss metric is widely employed as a standard for error measurement. However, this metric falls…

计算与语言 · 计算机科学 2024-10-03 Manish Sanwal

Scientific literature understanding is crucial for extracting targeted information and garnering insights, thereby significantly advancing scientific discovery. Despite the remarkable success of Large Language Models (LLMs), they face…

机器学习 · 计算机科学 2025-04-21 Sihang Li , Jin Huang , Jiaxi Zhuang , Yaorui Shi , Xiaochen Cai , Mingjun Xu , Xiang Wang , Linfeng Zhang , Guolin Ke , Hengxing Cai

Natural Language Inference (NLI) is a fundamental task in natural language processing. While NLI has developed many sub-directions such as sentence-level NLI, document-level NLI and cross-lingual NLI, Cross-Document Cross-Lingual NLI…

计算与语言 · 计算机科学 2025-10-08 Mengying Yuan , Wenhao Wang , Zixuan Wang , Yujie Huang , Kangli Wei , Fei Li , Chong Teng , Donghong Ji

The recent years have seen a revival of interest in textual entailment, sparked by i) the emergence of powerful deep neural network learners for natural language processing and ii) the timely development of large-scale evaluation datasets…

计算与语言 · 计算机科学 2018-03-05 Željko Agić , Natalie Schluter

We introduce Uncertain Natural Language Inference (UNLI), a refinement of Natural Language Inference (NLI) that shifts away from categorical labels, targeting instead the direct prediction of subjective probability assessments. We…

计算与语言 · 计算机科学 2020-05-06 Tongfei Chen , Zhengping Jiang , Adam Poliak , Keisuke Sakaguchi , Benjamin Van Durme

Large Language Models (LLMs) have emerged as a transformative power in enhancing natural language comprehension, representing a significant stride toward artificial general intelligence. The application of LLMs extends beyond conventional…

Recent large language models (LLMs) have advanced table understanding capabilities but rely on converting tables into text sequences. While multimodal large language models (MLLMs) enable direct visual processing, they face limitations in…

计算与语言 · 计算机科学 2025-02-26 Bohao Yang , Yingji Zhang , Dong Liu , André Freitas , Chenghua Lin

Natural Language Inference (NLI) is considered a representative task to test natural language understanding (NLU). In this work, we propose an extensible framework to collectively yet categorically test diverse Logical reasoning…

人工智能 · 计算机科学 2023-09-06 Ishan Tarunesh , Somak Aditya , Monojit Choudhury

The number of Language Models (LMs) dedicated to processing scientific text is on the rise. Keeping pace with the rapid growth of scientific LMs (SciLMs) has become a daunting task for researchers. To date, no comprehensive surveys on…

Natural Language Processing systems are heavily dependent on the availability of annotated data to train practical models. Primarily, models are trained on English datasets. In recent times, significant advances have been made in…

计算与语言 · 计算机科学 2023-01-18 Ankit Kumar Upadhyay , Harsit Kumar Upadhya

Emerging tools bring forth fresh approaches to work, and the field of natural science is no different. In natural science, traditional manual, serial, and labour-intensive work is being augmented by automated, parallel, and iterative…

Language models can achieve high accuracy on natural language tasks such as NLI, but performance suffers on manually created adversarial examples. We investigate the performance of a language model trained on the Stanford Natural Language…

计算与语言 · 计算机科学 2024-10-31 Chris Achard