English
Related papers

Related papers: On Correlating Factors for Domain Adaptation Perfo…

200 papers

Deep networks have been used to learn transferable representations for domain adaptation. Existing deep domain adaptation methods systematically employ popular hand-crafted networks designed specifically for image-classification tasks,…

Computer Vision and Pattern Recognition · Computer Science 2020-08-14 Yichen Li , Xingchao Peng

Domain adaptation addresses the common problem when the target distribution generating our test data drifts from the source (training) distribution. While absent assumptions, domain adaptation is impossible, strict conditions, e.g.…

Machine Learning · Computer Science 2019-03-13 Yifan Wu , Ezra Winston , Divyansh Kaushik , Zachary Lipton

Domain adaptation performance of a learning algorithm on a target domain is a function of its source domain error and a divergence measure between the data distribution of these two domains. We present a study of various distance-based…

Computation and Language · Computer Science 2020-03-05 Han Guo , Ramakanth Pasunuru , Mohit Bansal

In recent years, deep neural networks have emerged as a dominant machine learning tool for a wide variety of application domains. However, training a deep neural network requires a large amount of labeled data, which is an expensive process…

Computer Vision and Pattern Recognition · Computer Science 2017-06-26 Hemanth Venkateswara , Jose Eusebio , Shayok Chakraborty , Sethuraman Panchanathan

Recent works on domain adaptation reveal the effectiveness of adversarial learning on filling the discrepancy between source and target domains. However, two common limitations exist in current adversarial-learning-based methods. First,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-05 Minghao Xu , Jian Zhang , Bingbing Ni , Teng Li , Chengjie Wang , Qi Tian , Wenjun Zhang

While large language models (LLMs) have been increasingly adopted for machine translation (MT), their performance for specialist domains such as medicine and law remains an open challenge. Prior work has shown that LLMs can be…

Computation and Language · Computer Science 2025-03-10 Bryan Li , Jiaming Luo , Eleftheria Briakou , Colin Cherry

Unsupervised domain adaptation methods aim to alleviate performance degradation caused by domain-shift by learning domain-invariant representations. Existing deep domain adaptation methods focus on holistic feature alignment by matching…

Machine Learning · Computer Science 2018-11-20 Jun Wen , Risheng Liu , Nenggan Zheng , Qian Zheng , Zhefeng Gong , Junsong Yuan

In classification tasks, the classification accuracy diminishes when the data is gathered in different domains. To address this problem, in this paper, we investigate several adversarial models for domain adaptation (DA) and their effect on…

Sound · Computer Science 2023-09-08 Stanisław Kacprzak , Konrad Kowalczyk

We study the problem of domain adaptation under distribution shift, where the shift is due to a change in the distribution of an unobserved, latent variable that confounds both the covariates and the labels. In this setting, neither the…

Many domain adaptation approaches rely on learning cross domain shared representations to transfer the knowledge learned in one domain to other domains. Traditional domain adaptation only considers adapting for one task. In this paper, we…

Computation and Language · Computer Science 2017-05-31 Nanyun Peng , Mark Dredze

Generalizability of deep learning models may be severely affected by the difference in the distributions of the train (source domain) and the test (target domain) sets, e.g., when the sets are produced by different hardware. As a…

Image and Video Processing · Electrical Eng. & Systems 2022-08-02 Ivan Zakazov , Vladimir Shaposhnikov , Iaroslav Bespalov , Dmitry V. Dylov

Despite much progress being made in the field of object recognition with the advances of deep learning, there are still several factors negatively affecting the performance of deep learning models. Domain shift is one of these factors and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Kaiyu Guo , Brian Lovell

In domain adaptation for neural machine translation, translation performance can benefit from separating features into domain-specific features and common features. In this paper, we propose a method to explicitly model the two kinds of…

Computation and Language · Computer Science 2019-09-24 Shuhao Gu , Yang Feng , Qun Liu

The goal of this paper is to use multi-task learning to efficiently scale slot filling models for natural language understanding to handle multiple target tasks or domains. The key to scalability is reducing the amount of training data…

Computation and Language · Computer Science 2016-08-11 Aaron Jaech , Larry Heck , Mari Ostendorf

Machine learning is vulnerable to adversarial examples-inputs designed to cause models to perform poorly. However, it is unclear if adversarial examples represent realistic inputs in the modeled domains. Diverse domains such as networks and…

Cryptography and Security · Computer Science 2021-11-09 Ryan Sheatsley , Blaine Hoak , Eric Pauley , Yohan Beugin , Michael J. Weisman , Patrick McDaniel

Dense retrieval, which encodes queries and documents into a single dense vector, has become the dominant neural retrieval approach due to its simplicity and compatibility with fast approximate nearest neighbor algorithms. As the tasks dense…

Information Retrieval · Computer Science 2026-02-06 Julian Killingback , Mahta Rafiee , Madine Manas , Hamed Zamani

Scaling up neural models has yielded significant advancements in a wide array of tasks, particularly in language generation. Previous studies have found that the performance of neural models frequently adheres to predictable scaling laws,…

Information Retrieval · Computer Science 2024-07-16 Yan Fang , Jingtao Zhan , Qingyao Ai , Jiaxin Mao , Weihang Su , Jia Chen , Yiqun Liu

Deep domain adaptation models learn a neural network in an unlabeled target domain by leveraging the knowledge from a labeled source domain. This can be achieved by learning a domain-invariant feature space. Though the learned…

Machine Learning · Computer Science 2020-03-13 Yinghua Zhang , Yu Zhang , Ying Wei , Kun Bai , Yangqiu Song , Qiang Yang

Duplicate question detection is an ongoing challenge in community question answering because semantically equivalent questions can have significantly different words and structures. In addition, the identification of duplicate questions can…

Computation and Language · Computer Science 2018-11-19 Mohomed Shazan Mohomed Jabbar , Luke Kumar , Hamman Samuel , Mi-Young Kim , Sankalp Prabhakar , Randy Goebel , Osmar Zaïane

Domain adaptation from one data space (or domain) to another is one of the most challenging tasks of modern data analytics. If the adaptation is done correctly, models built on a specific data space become more robust when confronted to…

Machine Learning · Computer Science 2016-06-23 Nicolas Courty , Rémi Flamary , Devis Tuia , Alain Rakotomamonjy