English
Related papers

Related papers: FGraDA: A Dataset and Benchmark for Fine-Grained D…

200 papers

Progress in machine learning is typically measured by training and testing a model on the same distribution of data, i.e., the same domain. This over-estimates future accuracy on out-of-distribution data. The Visual Domain Adaptation…

Machine Learning · Computer Science 2021-07-26 Dina Bashkirova , Dan Hendrycks , Donghyun Kim , Samarth Mishra , Kate Saenko , Kuniaki Saito , Piotr Teterwak , Ben Usman

Document-level context for neural machine translation (NMT) is crucial to improve the translation consistency and cohesion, the translation of ambiguous inputs, as well as several other linguistic phenomena. Many works have been published…

Computation and Language · Computer Science 2023-06-09 Christian Herold , Hermann Ney

While quality estimation (QE) can play an important role in the translation process, its effectiveness relies on the availability and quality of training data. For QE in particular, high-quality labeled data is often lacking due to the high…

Most state-of-the-art deep domain adaptation techniques align source and target samples in a global fashion. That is, after alignment, each source sample is expected to become similar to any target sample. However, global alignment may not…

Machine Learning · Computer Science 2023-08-22 Liyue Chen , Linian Wang , Jinyu Xu , Shuai Chen , Weiqiang Wang , Wenbiao Zhao , Qiyu Li , Leye Wang

Although the advancements of pre-trained Large Language Models have significantly accelerated recent progress in NLP, their ever-increasing size poses significant challenges for conventional fine-tuning, especially in memory-intensive…

Computation and Language · Computer Science 2024-04-02 Chenxi Whitehouse , Fantine Huot , Jasmijn Bastings , Mostafa Dehghani , Chu-Cheng Lin , Mirella Lapata

We investigate adaptive ensemble weighting for Neural Machine Translation, addressing the case of improving performance on a new and potentially unknown domain without sacrificing performance on the original domain. We adapt sequentially…

Computation and Language · Computer Science 2019-06-04 Danielle Saunders , Felix Stahlberg , Adria de Gispert , Bill Byrne

Generalisation of deep neural networks becomes vulnerable when distribution shifts are encountered between train (source) and test (target) domain data. Few-shot domain adaptation mitigates this issue by adapting deep neural networks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Youssef Dawoud , Gustavo Carneiro , Vasileios Belagiannis

Multi-source unsupervised domain adaptation~(MSDA) aims at adapting models trained on multiple labeled source domains to an unlabeled target domain. In this paper, we propose a novel multi-source domain adaptation framework based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Jianzhong He , Xu Jia , Shuaijun Chen , Jianzhuang Liu

Effort in releasing large-scale datasets may be compromised by privacy and intellectual property considerations. A feasible alternative is to release pre-trained models instead. While these models are strong on their original task (source…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Yunzhong Hou , Liang Zheng

Multi-source unsupervised domain adaptation aims to leverage labeled data from multiple source domains for training a machine learning model to generalize well on a target domain without labels. Source domain selection plays a crucial role…

Machine Learning · Computer Science 2024-11-12 Yao Ma , Samuel Louvan , Zhunxuan Wang

Domain adaptation (DA) tries to tackle the scenarios when the test data does not fully follow the same distribution of the training data, and multi-source domain adaptation (MSDA) is very attractive for real world applications. By learning…

Machine Learning · Computer Science 2024-01-17 Jin Yuan , Feng Hou , Yangzhou Du , Zhongchao Shi , Xin Geng , Jianping Fan , Yong Rui

Domain Adaptation is widely used in practical applications of neural machine translation, which aims to achieve good performance on both the general-domain and in-domain. However, the existing methods for domain adaptation usually suffer…

Computation and Language · Computer Science 2021-04-15 Shuhao Gu , Yang Feng , Wanying Xie

This paper introduces ClimateGPT, a model family of domain-specific large language models that synthesize interdisciplinary research on climate change. We trained two 7B models from scratch on a science-oriented dataset of 300B tokens. For…

In many practical applications, it is often difficult and expensive to obtain enough large-scale labeled data to train deep neural networks to their full capability. Therefore, transferring the learned knowledge from a separate, labeled…

Machine Learning · Computer Science 2020-02-28 Sicheng Zhao , Bo Li , Colorado Reed , Pengfei Xu , Kurt Keutzer

Fine-Grained Visual Categorization (FGVC) is a challenging topic in computer vision. It is a problem characterized by large intra-class differences and subtle inter-class differences. In this paper, we tackle this problem in a weakly…

Computer Vision and Pattern Recognition · Computer Science 2020-10-08 Ashiq Imran , Vassilis Athitsos

To ensure the out-of-distribution (OOD) generalization performance, traditional domain generalization (DG) methods resort to training on data from multiple sources with different underlying distributions. And the success of those DG methods…

Machine Learning · Computer Science 2023-05-26 Zheyan Shen , Han Yu , Peng Cui , Jiashuo Liu , Xingxuan Zhang , Linjun Zhou , Furui Liu

Recent advances in unsupervised domain adaptation have significantly improved the recognition accuracy of CNNs by alleviating the domain shift between (labeled) source and (unlabeled) target data distributions. While the problem of…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Le Thanh Nguyen-Meidine , Madhu Kiran , Marco Pedersoli , Jose Dolz , Louis-Antoine Blais-Morin , Eric Granger

Gradual domain adaptation (GDA) aims to mitigate domain shift by progressively adapting models from the source domain to the target domain via intermediate domains. However, real intermediate domains are often unavailable or ineffective,…

Machine Learning · Computer Science 2026-02-03 Zhichao Chen , Zhan Zhuang , Yunfei Teng , Hao Wang , Fangyikang Wang , Zhengnan Li , Tianqiao Liu , Haoxuan Li , Zhouchen Lin

Achieving consistent high-quality machine translation (MT) across diverse domains remains a significant challenge, primarily due to the limited and imbalanced parallel training data available in various domains. While large language models…

Computation and Language · Computer Science 2024-10-04 Tianxiang Hu , Pei Zhang , Baosong Yang , Jun Xie , Derek F. Wong , Rui Wang

Large language models (LLMs) have showcased their capability with few-shot inference known as in-context learning. However, in-domain demonstrations are not always readily available in real scenarios, leading to cross-domain in-context…

Computation and Language · Computer Science 2023-11-21 Quanyu Long , Wenya Wang , Sinno Jialin Pan