English
Related papers

Related papers: Label-Free Multi-Domain Machine Translation with S…

200 papers

Unsupervised domain adaptation (DA) has gained substantial interest in semantic segmentation. However, almost all prior arts assume concurrent access to both labeled source and unlabeled target, making them unsuitable for scenarios…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jogendra Nath Kundu , Akshay Kulkarni , Amit Singh , Varun Jampani , R. Venkatesh Babu

Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocabularies. This paper shows effective techniques to transfer a…

Computation and Language · Computer Science 2019-06-06 Yunsu Kim , Yingbo Gao , Hermann Ney

Adapter layers are lightweight, learnable units inserted between transformer layers. Recent work explores using such layers for neural machine translation (NMT), to adapt pre-trained models to new domains or language pairs, training only a…

Computation and Language · Computer Science 2021-10-20 Asa Cooper Stickland , Alexandre Bérard , Vassilina Nikoulina

While deep neural networks demonstrate state-of-the-art performance on a variety of learning tasks, their performance relies on the assumption that train and test distributions are the same, which may not hold in real-world applications.…

Machine Learning · Computer Science 2021-02-18 Wenyu Zhang , Mohamed Ragab , Ramon Sagarna

Building generalizable AI models is one of the primary challenges in the healthcare domain. While radiologists rely on generalizable descriptive rules of abnormality, Neural Network (NN) models suffer even with a slight shift in input…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Shantanu Ghosh , Ke Yu , Kayhan Batmanghelich

Multi-label image recognition is a fundamental yet practical task because real-world images inherently possess multiple semantic labels. However, it is difficult to collect large-scale multi-label annotations due to the complexity of both…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Tianshui Chen , Tao Pu , Hefeng Wu , Yuan Xie , Liang Lin

Multi-label text classification (MLTC) is the task of assigning multiple labels to a given text, and has a wide range of application domains. Most existing approaches require an enormous amount of annotated data to learn a classifier and/or…

Computation and Language · Computer Science 2023-09-26 Muberra Ozmen , Joseph Cotnareanu , Mark Coates

Efficiently utilizing rich knowledge in pretrained models has become a critical topic in the era of large models. This work focuses on adaptively utilizing knowledge from multiple source-pretrained models to an unlabeled target domain…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Xinyao Li , Jingjing Li , Fengling Li , Lei Zhu , Ke Lu

Zero-resource cross-lingual transfer approaches aim to apply supervised models from a source language to unlabelled target languages. In this paper we perform an in-depth study of the two main techniques employed so far for cross-lingual…

Computation and Language · Computer Science 2023-04-28 Iker García-Ferrero , Rodrigo Agerri , German Rigau

In many practical applications, it is often difficult and expensive to obtain large-scale labeled data to train state-of-the-art deep neural networks. Therefore, transferring the learned knowledge from a separate, labeled source domain to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Sicheng Zhao , Hui Chen , Hu Huang , Pengfei Xu , Guiguang Ding

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

Domain shift is a well known problem where a model trained on a particular domain (source) does not perform well when exposed to samples from a different domain (target). Unsupervised methods that can adapt to domain shift are highly…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Botos Csaba , Xiaojuan Qi , Arslan Chaudhry , Puneet Dokania , Philip Torr

Generalization of machine learning models trained on a set of source domains on unseen target domains with different statistics, is a challenging problem. While many approaches have been proposed to solve this problem, they only utilize…

Machine Learning · Computer Science 2021-07-20 Prashant Pandey , Mrigank Raman , Sumanth Varambally , Prathosh AP

Manually labeling documents is tedious and expensive, but it is essential for training a traditional text classifier. In recent years, a few dataless text classification techniques have been proposed to address this problem. However,…

Information Retrieval · Computer Science 2017-11-07 Daochen Zha , Chenliang Li

The usefulness of deep learning models in robotics is largely dependent on the availability of training data. Manual annotation of training data is often infeasible. Synthetic data is a viable alternative, but suffers from domain gap. We…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Benedikt T. Imbusch , Max Schwarz , Sven Behnke

The recent success of deep neural networks relies on massive amounts of labeled data. For a target task where labeled data is unavailable, domain adaptation can transfer a learner from a different source domain. In this paper, we propose a…

Machine Learning · Computer Science 2017-02-17 Mingsheng Long , Han Zhu , Jianmin Wang , Michael I. Jordan

Training a good deep learning model requires substantial data and computing resources, which makes the resulting neural model a valuable intellectual property. To prevent the neural network from being undesirably exploited, non-transferable…

Computation and Language · Computer Science 2023-02-21 Guangtao Zeng , Wei Lu

In this paper, we propose two novel methods for domain adaptation for the attention-only neural machine translation (NMT) model, i.e., the Transformer. Our methods focus on training a single translation model for multiple domains by either…

Computation and Language · Computer Science 2019-06-21 Chenhui Chu , Raj Dabre

In the absence of labeled target data, unsupervised domain adaptation approaches seek to align the marginal distributions of the source and target domains in order to train a classifier for the target. Unsupervised domain alignment…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

Machine translation (MT) systems, especially when designed for an industrial setting, are trained with general parallel data derived from the Web. Thus, their style is typically driven by word/structure distribution coming from the average…

Computation and Language · Computer Science 2021-02-23 Thuy Vu , Alessandro Moschitti