English
Related papers

Related papers: It Takes Two Flints to Make a Fire: Multitask Lear…

200 papers

We introduce a family of multitask variational methods for semi-supervised sequence labeling. Our model family consists of a latent-variable generative model and a discriminative labeler. The generative models use latent variables to define…

Computation and Language · Computer Science 2019-06-25 Mingda Chen , Qingming Tang , Karen Livescu , Kevin Gimpel

When faced with learning challenging new tasks, humans often follow sequences of steps that allow them to incrementally build up the necessary skills for performing these new tasks. However, in machine learning, models are most often…

Artificial Intelligence · Computer Science 2021-06-09 Otilia Stretcu , Emmanouil Antonios Platanios , Tom M. Mitchell , Barnabás Póczos

Explaining the predictions of AI models is paramount in safety-critical applications, such as in legal or medical domains. One form of explanation for a prediction is an extractive rationale, i.e., a subset of features of an instance that…

Computation and Language · Computer Science 2020-12-21 Lei Sha , Oana-Maria Camburu , Thomas Lukasiewicz

We combine multi-task learning and semi-supervised learning by inducing a joint embedding space between disparate label spaces and learning transfer functions between label embeddings, enabling us to jointly leverage unlabelled data and…

Computation and Language · Computer Science 2018-04-10 Isabelle Augenstein , Sebastian Ruder , Anders Søgaard

Active learning is commonly used to train label-efficient models by adaptively selecting the most informative queries. However, most active learning strategies are designed to either learn a representation of the data (e.g., embedding or…

Machine Learning · Computer Science 2022-02-07 Namrata Nadagouda , Austin Xu , Mark A. Davenport

Various natural language processing tasks are structured prediction problems where outputs are constructed with multiple interdependent decisions. Past work has shown that domain knowledge, framed as constraints over the output space, can…

Computation and Language · Computer Science 2020-06-03 Xingyuan Pan , Maitrey Mehta , Vivek Srikumar

Deliberation networks are a family of sequence-to-sequence models, which have achieved state-of-the-art performance in a wide range of tasks such as machine translation and speech synthesis. A deliberation network consists of multiple…

Computation and Language · Computer Science 2022-11-08 Qingyun Dou , Mark Gales

Document-level relation extraction (RE) aims at extracting relations among entities expressed across multiple sentences, which can be viewed as a multi-label classification problem. In a typical document, most entity pairs do not express…

Computation and Language · Computer Science 2022-05-04 Yang Zhou , Wee Sun Lee

In many settings it is important for one to be able to understand why a model made a particular prediction. In NLP this often entails extracting snippets of an input text `responsible for' corresponding model output; when such a snippet…

Computation and Language · Computer Science 2020-05-04 Sarthak Jain , Sarah Wiegreffe , Yuval Pinter , Byron C. Wallace

This paper introduces a new information extraction model for business documents. Different from prior studies which only base on span extraction or sequence labeling, the model takes into account advantage of both span extraction and…

Computation and Language · Computer Science 2022-05-27 Nguyen Hong Son , Hieu M. Vu , Tuan-Anh D. Nguyen , Minh-Tien Nguyen

While utilization of digital agents to support crucial decision making is increasing, trust in suggestions made by these agents is hard to achieve. However, it is essential to profit from their application, resulting in a need for…

Machine Learning · Computer Science 2022-04-21 Michael Heider , Helena Stegherr , Jonathan Wurth , Roman Sraj , Jörg Hähner

We pose causal inference as the problem of learning to classify probability distributions. In particular, we assume access to a collection $\{(S_i,l_i)\}_{i=1}^n$, where each $S_i$ is a sample drawn from the probability distribution of $X_i…

Machine Learning · Statistics 2015-05-20 David Lopez-Paz , Krikamol Muandet , Bernhard Schölkopf , Ilya Tolstikhin

Existing self-supervised learning methods learn representation by means of pretext tasks which are either (1) discriminating that explicitly specify which features should be separated or (2) aligning that precisely indicate which features…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Anjan Dutta , Massimiliano Mancini , Zeynep Akata

Relation extraction (RE) has achieved remarkable progress with the help of pre-trained language models. However, existing RE models are usually incapable of handling two situations: implicit expressions and long-tail relation classes,…

Computation and Language · Computer Science 2023-10-30 Pawan Kumar Rajpoot , Ankur Parikh

System behavior is often based on causal relations between certain events (e.g. If event1, then event2). Consequently, those causal relations are also textually embedded in requirements. We want to extract this causal knowledge and utilize…

Software Engineering · Computer Science 2020-06-30 Jannik Fischbach , Benedikt Hauptmann , Lukas Konwitschny , Dominik Spies , Andreas Vogelsang

Relation extraction (RE) is an indispensable information extraction task in several disciplines. RE models typically assume that named entity recognition (NER) is already performed in a previous step by another independent model. Several…

Computation and Language · Computer Science 2019-08-29 Tung Tran , Ramakanth Kavuluru

Neural language models are a powerful tool to embed words into semantic vector spaces. However, learning such models generally relies on the availability of abundant and diverse training examples. In highly specialised domains this…

Computation and Language · Computer Science 2015-12-04 Stephanie L. Hyland , Theofanis Karaletsos , Gunnar Rätsch

The paradigm of multi-task learning is that one can achieve better generalization by learning tasks jointly and thus exploiting the similarity between the tasks rather than learning them independently of each other. While previously the…

Machine Learning · Statistics 2015-11-19 Pratik Jawanpuria , Maksim Lapin , Matthias Hein , Bernt Schiele

Human explanations of natural language, rationales, form a tool to assess whether models learn a label for the right reasons or rely on dataset-specific shortcuts. Sufficiency is a common metric for estimating the informativeness of…

Computation and Language · Computer Science 2025-11-21 Jonathan Kamp , Lisa Beinborn , Antske Fokkens

Explainability and effectiveness are two key aspects for building recommender systems. Prior efforts mostly focus on incorporating side information to achieve better recommendation performance. However, these methods have some weaknesses:…

Information Retrieval · Computer Science 2019-03-12 Weizhi Ma , Min Zhang , Yue Cao , Woojeong , Jin , Chenyang Wang , Yiqun Liu , Shaoping Ma , Xiang Ren