English
Related papers

Related papers: Domain adaptation for sequence labeling using hidd…

200 papers

Content on the Internet is heterogeneous and arises from various domains like News, Entertainment, Finance and Technology. Understanding such content requires identifying named entities (persons, places and organizations) as one of the key…

Computation and Language · Computer Science 2016-12-02 Vivek Kulkarni , Yashar Mehdad , Troy Chevalier

Recently, semantic parsing has attracted much attention in the community. Although many neural modeling efforts have greatly improved the performance, it still suffers from the data scarcity issue. In this paper, we propose a novel semantic…

Computation and Language · Computer Science 2020-06-24 Zechang Li , Yuxuan Lai , Yansong Feng , Dongyan Zhao

Word representations induced from models with discrete latent variables (e.g.\ HMMs) have been shown to be beneficial in many NLP applications. In this work, we exploit labeled syntactic dependency trees and formalize the induction problem…

Computation and Language · Computer Science 2016-02-08 Simon Šuster , Gertjan van Noord , Ivan Titov

The remarkable success of large language models has been driven by dense models trained on massive unlabeled, unstructured corpora. These corpora typically contain text from diverse, heterogeneous sources, but information about the source…

Computation and Language · Computer Science 2022-05-04 Alexandra Chronopoulou , Matthew E. Peters , Jesse Dodge

We introduce a new representation learning algorithm suited to the context of domain adaptation, in which data at training and test time come from similar but different distributions. Our algorithm is directly inspired by theory on domain…

Machine Learning · Statistics 2015-02-10 Hana Ajakan , Pascal Germain , Hugo Larochelle , François Laviolette , Mario Marchand

Domain-specific contextualized language models have demonstrated substantial effectiveness gains for domain-specific downstream tasks, like similarity matching, entity recognition or information retrieval. However successfully applying such…

Computation and Language · Computer Science 2021-06-11 Sophia Althammer , Mark Buckley , Sebastian Hofstätter , Allan Hanbury

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-11-21 Viktoriya Krakovna , Finale Doshi-Velez

In this paper we introduce domain detection as a new natural language processing task. We argue that the ability to detect textual segments which are domain-heavy, i.e., sentences or phrases which are representative of and provide evidence…

Computation and Language · Computer Science 2019-07-29 Yumo Xu , Mirella Lapata

Many works proposed methods to improve the performance of Neural Machine Translation (NMT) models in a domain/multi-domain adaptation scenario. However, an understanding of how NMT baselines represent text domain information internally is…

Computation and Language · Computer Science 2021-09-17 Maksym Del , Elizaveta Korotkova , Mark Fishel

Domain mismatch between training and testing can lead to significant degradation in performance in many machine learning scenarios. Unfortunately, this is not a rare situation for automatic speech recognition deployments in real-world…

Computation and Language · Computer Science 2017-09-25 Wei-Ning Hsu , Yu Zhang , James Glass

We introduce a novel approach to unsupervised and semi-supervised domain adaptation for semantic segmentation. Unlike many earlier methods that rely on adversarial learning for feature alignment, we leverage contrastive learning to bridge…

Computer Vision and Pattern Recognition · Computer Science 2021-04-23 Weizhe Liu , David Ferstl , Samuel Schulter , Lukas Zebedin , Pascal Fua , Christian Leistner

Data sparsity is an inherent challenge in the recommender systems, where most of the data is collected from the implicit feedbacks of users. This causes two difficulties in designing effective algorithms: first, the majority of users only…

Information Retrieval · Computer Science 2020-07-15 Wenhui Yu , Xiao Lin , Junfeng Ge , Wenwu Ou , Zheng Qin

Deep neural networks excel at learning from labeled data and achieve state-of-the-art resultson a wide array of Natural Language Processing tasks. In contrast, learning from unlabeled data, especially under domain shift, remains a…

Computation and Language · Computer Science 2020-10-29 Alan Ramponi , Barbara Plank

Transfer learning methods, and in particular domain adaptation, help exploit labeled data in one domain to improve the performance of a certain task in another domain. However, it is still not clear what factors affect the success of domain…

Computation and Language · Computer Science 2021-06-25 Nicolai Pogrebnyakov , Shohreh Shaghaghian

Predicting structured outputs such as semantic segmentation relies on expensive per-pixel annotations to learn supervised models like convolutional neural networks. However, models trained on one data domain may not generalize well to other…

Computer Vision and Pattern Recognition · Computer Science 2019-09-30 Yi-Hsuan Tsai , Kihyuk Sohn , Samuel Schulter , Manmohan Chandraker

The notion of "in-domain data" in NLP is often over-simplistic and vague, as textual data varies in many nuanced linguistic aspects such as topic, style or level of formality. In addition, domain labels are many times unavailable, making it…

Computation and Language · Computer Science 2020-05-04 Roee Aharoni , Yoav Goldberg

Unsupervised methods for learning distributed representations of words are ubiquitous in today's NLP research, but far less is known about the best ways to learn distributed phrase or sentence representations from unlabelled data. This…

Computation and Language · Computer Science 2016-02-11 Felix Hill , Kyunghyun Cho , Anna Korhonen

Unsupervised Domain Adaptation (UDA) addresses the problem of performance degradation due to domain shift between training and testing sets, which is common in computer vision applications. Most existing UDA approaches are based on…

Computer Vision and Pattern Recognition · Computer Science 2019-05-14 Songsong Wu , Yan Yan , Hao Tang , Jianjun Qian , Jian Zhang , Xiao-Yuan Jing

Statistical machine translation (SMT) systems perform poorly when it is applied to new target domains. Our goal is to explore domain adaptation approaches and techniques for improving the translation quality of domain-specific SMT systems.…

Computation and Language · Computer Science 2018-04-06 Longyue Wang

It is well known that speaker identification performs extremely well in the neutral talking environments; however, the identification performance is declined sharply in the shouted talking environments. This work aims at proposing,…

Artificial Intelligence · Computer Science 2017-06-30 Ismail Shahin