English
Related papers

Related papers: Unsupervised Natural Language Inference Using PHL …

200 papers

Natural Language Inference Generation task is to generate a text hypothesis given a text premise and a logical relation between the two. This task can be used in data augmentation and controllable text generation in practice. In this paper,…

Computation and Language · Computer Science 2022-05-24 Kaijian Li , Shansan Gong , Kenny Q. Zhu

Paraphrase generation has benefited extensively from recent progress in the designing of training objectives and model architectures. However, previous explorations have largely focused on supervised methods, which require a large amount of…

Computation and Language · Computer Science 2021-09-14 Tong Niu , Semih Yavuz , Yingbo Zhou , Nitish Shirish Keskar , Huan Wang , Caiming Xiong

While valuable datasets such as PersonaChat provide a foundation for training persona-grounded dialogue agents, they lack diversity in conversational and narrative settings, primarily existing in the "real" world. To develop dialogue agents…

Computation and Language · Computer Science 2024-01-15 Alexandra DeLucia , Mengjie Zhao , Yoshinori Maeda , Makoto Yoda , Keiichi Yamada , Hiromi Wakaki

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

Computation and Language · Computer Science 2019-12-10 Tiffany Chien , Jugal Kalita

Pretrained neural models such as BERT, when fine-tuned to perform natural language inference (NLI), often show high accuracy on standard datasets, but display a surprising lack of sensitivity to word order on controlled challenge sets. We…

Computation and Language · Computer Science 2020-04-28 Junghyun Min , R. Thomas McCoy , Dipanjan Das , Emily Pitler , Tal Linzen

Many recent studies have shown that for models trained on datasets for natural language inference (NLI), it is possible to make correct predictions by merely looking at the hypothesis while completely ignoring the premise. In this work, we…

Computation and Language · Computer Science 2021-03-16 Tianyu Liu , Xin Zheng , Baobao Chang , Zhifang Sui

Natural Language Inference (NLI) datasets often contain hypothesis-only biases---artifacts that allow models to achieve non-trivial performance without learning whether a premise entails a hypothesis. We propose two probabilistic methods to…

Computation and Language · Computer Science 2019-07-11 Yonatan Belinkov , Adam Poliak , Stuart M. Shieber , Benjamin Van Durme , Alexander M. Rush

Natural Language Processing systems are heavily dependent on the availability of annotated data to train practical models. Primarily, models are trained on English datasets. In recent times, significant advances have been made in…

Computation and Language · Computer Science 2023-01-18 Ankit Kumar Upadhyay , Harsit Kumar Upadhya

Recent investigations into the inner-workings of state-of-the-art large-scale pre-trained Transformer-based Natural Language Understanding (NLU) models indicate that they appear to know humanlike syntax, at least to some extent. We provide…

Computation and Language · Computer Science 2021-06-14 Koustuv Sinha , Prasanna Parthasarathi , Joelle Pineau , Adina Williams

In order for machine learning to garner widespread public adoption, models must be able to provide interpretable and robust explanations for their decisions, as well as learn from human-provided explanations at train time. In this work, we…

Computation and Language · Computer Science 2018-12-07 Oana-Maria Camburu , Tim Rocktäschel , Thomas Lukasiewicz , Phil Blunsom

Current Natural Language Inference (NLI) models achieve impressive results, sometimes outperforming humans when evaluating on in-distribution test sets. However, as these models are known to learn from annotation artefacts and dataset…

Computation and Language · Computer Science 2022-10-24 Joe Stacey , Pasquale Minervini , Haim Dubossarsky , Marek Rei

While discriminative neural network classifiers are generally preferred, recent work has shown advantages of generative classifiers in term of data efficiency and robustness. In this paper, we focus on natural language inference (NLI). We…

Computation and Language · Computer Science 2020-10-09 Xiaoan Ding , Tianyu Liu , Baobao Chang , Zhifang Sui , Kevin Gimpel

Dense retrievers have made significant strides in text retrieval and open-domain question answering. However, most of these achievements have relied heavily on extensive human-annotated supervision. In this study, we aim to develop…

Computation and Language · Computer Science 2024-10-31 Rui Meng , Ye Liu , Semih Yavuz , Divyansh Agarwal , Lifu Tu , Ning Yu , Jianguo Zhang , Meghana Bhat , Yingbo Zhou

Language model (LM) post-training relies on two stages of human supervision: task demonstrations for supervised finetuning (SFT), followed by preference comparisons for reinforcement learning from human feedback (RLHF). As LMs become more…

Machine Learning · Computer Science 2025-01-15 Yaowen Ye , Cassidy Laidlaw , Jacob Steinhardt

Existing approaches to constructing training data for Natural Language Inference (NLI) tasks, such as for semi-structured table reasoning, are either via crowdsourcing or fully automatic methods. However, the former is expensive and…

Computation and Language · Computer Science 2022-10-25 Dibyakanti Kumar , Vivek Gupta , Soumya Sharma , Shuo Zhang

Neural natural language generation (NLG) and understanding (NLU) models are data-hungry and require massive amounts of annotated data to be competitive. Recent frameworks address this bottleneck with generative models that synthesize weak…

Computation and Language · Computer Science 2021-02-09 Ernie Chang , Vera Demberg , Alex Marin

Modeling natural language inference is a very challenging task. With the availability of large annotated data, it has recently become feasible to train complex models such as neural-network-based inference models, which have shown to…

Computation and Language · Computer Science 2020-03-04 Qian Chen , Xiaodan Zhu , Zhen-Hua Ling , Diana Inkpen , Si Wei

In Natural Language Generation (NLG), End-to-End (E2E) systems trained through deep learning have recently gained a strong interest. Such deep models need a large amount of carefully annotated data to reach satisfactory performance.…

Computation and Language · Computer Science 2019-10-09 Raheel Qader , François Portet , Cyril Labbé

Neural-based end-to-end approaches to natural language generation (NLG) from structured data or knowledge are data-hungry, making their adoption for real-world applications difficult with limited data. In this work, we propose the new task…

Computation and Language · Computer Science 2020-04-21 Zhiyu Chen , Harini Eavani , Wenhu Chen , Yinyin Liu , William Yang Wang

The current trend in automatic speech recognition is to leverage large amounts of labeled data to train supervised neural network models. Unfortunately, obtaining data for a wide range of domains to train robust models can be costly.…

Computation and Language · Computer Science 2018-06-14 Wei-Ning Hsu , Hao Tang , James Glass