English
Related papers

Related papers: Self-Consistent Narrative Prompts on Abductive Nat…

200 papers

Most of the contemporary approaches for multi-hop Natural Language Inference (NLI) construct explanations considering each test case in isolation. However, this paradigm is known to suffer from semantic drift, a phenomenon that causes the…

Artificial Intelligence · Computer Science 2022-09-13 Marco Valentino , Mokanarangan Thayaparan , André Freitas

Large language models (LLMs) have showcased remarkable potential across various tasks by conditioning on prompts. However, the quality of different human-written prompts leads to substantial discrepancies in LLMs' performance, and improving…

Computation and Language · Computer Science 2024-05-17 Yihong Dong , Kangcheng Luo , Xue Jiang , Zhi Jin , Ge Li

Language models can achieve high accuracy on natural language tasks such as NLI, but performance suffers on manually created adversarial examples. We investigate the performance of a language model trained on the Stanford Natural Language…

Computation and Language · Computer Science 2024-10-31 Chris Achard

Recent advances on instruction fine-tuning have led to the development of various prompting techniques for large language models, such as explicit reasoning steps. However, the success of techniques depends on various parameters, such as…

This paper surveys and organizes research works in a new paradigm in natural language processing, which we dub "prompt-based learning". Unlike traditional supervised learning, which trains a model to take in an input x and predict an output…

Computation and Language · Computer Science 2021-07-30 Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , Graham Neubig

Discrete prompts have been used for fine-tuning Pre-trained Language Models for diverse NLP tasks. In particular, automatic methods that generate discrete prompts from a small set of training instances have reported superior performance.…

Computation and Language · Computer Science 2023-02-14 Yoichi Ishibashi , Danushka Bollegala , Katsuhito Sudoh , Satoshi Nakamura

Language technologies that accurately model the dynamics of events must perform commonsense reasoning. Existing work evaluating commonsense reasoning focuses on making inferences about common, everyday situations. To instead investigate the…

Computation and Language · Computer Science 2024-05-02 Wenting Zhao , Justin T Chiu , Jena D. Hwang , Faeze Brahman , Jack Hessel , Sanjiban Choudhury , Yejin Choi , Xiang Lorraine Li , Alane Suhr

Continual learning empowers models to adapt autonomously to the ever-changing environment or data streams without forgetting old knowledge. Prompt-based approaches are built on frozen pre-trained models to learn the task-specific prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Zhanxin Gao , Jun Cen , Xiaobin Chang

Natural language inference (NLI) is an increasingly important task for natural language understanding, which requires one to infer whether a sentence entails another. However, the ability of NLI models to make pragmatic inferences remains…

Computation and Language · Computer Science 2020-07-15 Paloma Jeretic , Alex Warstadt , Suvrat Bhooshan , Adina Williams

Nature language inference (NLI) task is a predictive task of determining the inference relationship of a pair of natural language sentences. With the increasing popularity of NLI, many state-of-the-art predictive models have been proposed…

Computation and Language · Computer Science 2018-11-13 Haohan Wang , Da Sun , Eric P. Xing

While large language models (LLMs) such as ChatGPT and PaLM have demonstrated remarkable performance in various language understanding and generation tasks, their capabilities in complex reasoning and intricate knowledge utilization still…

Computation and Language · Computer Science 2023-10-11 Haodi Zhang , Min Cai , Xinhe Zhang , Chen Jason Zhang , Rui Mao , Kaishun Wu

Abductive reasoning starts from some observations and aims at finding the most plausible explanation for these observations. To perform abduction, humans often make use of temporal and causal inferences, and knowledge about how some…

Computation and Language · Computer Science 2021-06-09 Debjit Paul , Anette Frank

Abductive reasoning aims to find plausible explanations for an event. This style of reasoning is critical for commonsense tasks where there are often multiple plausible explanations. Existing approaches for abductive reasoning in natural…

Computation and Language · Computer Science 2023-05-25 Wenting Zhao , Justin T. Chiu , Claire Cardie , Alexander M. Rush

The Natural Language Inference (NLI) task is an important task in modern NLP, as it asks a broad question to which many other tasks may be reducible: Given a pair of sentences, does the first entail the second? Although the state-of-the-art…

Artificial Intelligence · Computer Science 2020-05-07 Zaid Marji , Animesh Nighojkar , John Licato

Prompting a pretrained language model with natural language patterns has been proved effective for natural language understanding (NLU). However, our preliminary study reveals that manual discrete prompts often lead to unstable performance…

Computation and Language · Computer Science 2023-10-26 Xiao Liu , Yanan Zheng , Zhengxiao Du , Ming Ding , Yujie Qian , Zhilin Yang , Jie Tang

Recent studies demonstrated that large language models (LLMs) can excel in many tasks via in-context learning (ICL). However, recent works show that ICL-prompted models tend to produce inaccurate results when presented with adversarial…

Computation and Language · Computer Science 2024-05-21 Xuanli He , Yuxiang Wu , Oana-Maria Camburu , Pasquale Minervini , Pontus Stenetorp

The RepEval 2017 Shared Task aims to evaluate natural language understanding models for sentence representation, in which a sentence is represented as a fixed-length vector with neural networks and the quality of the representation is…

Computation and Language · Computer Science 2017-08-07 Qian Chen , Xiaodan Zhu , Zhen-Hua Ling , Si Wei , Hui Jiang , Diana Inkpen

Building an intelligent dialogue system with the ability to select a proper response according to a multi-turn context is a great challenging task. Existing studies focus on building a context-response matching model with various neural…

Computation and Language · Computer Science 2020-09-15 Ruijian Xu , Chongyang Tao , Daxin Jiang , Xueliang Zhao , Dongyan Zhao , Rui Yan

Large language models (LLMs) often exhibit deficient reasoning or generate hallucinations. To address these, studies prefixed with "Self-" such as Self-Consistency, Self-Improve, and Self-Refine have been initiated. They share a…

Computation and Language · Computer Science 2024-09-19 Xun Liang , Shichao Song , Zifan Zheng , Hanyu Wang , Qingchen Yu , Xunkai Li , Rong-Hua Li , Yi Wang , Zhonghao Wang , Feiyu Xiong , Zhiyu Li

The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since…

Computation and Language · Computer Science 2025-08-04 Alexandros Koulakos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou