中文
相关论文

相关论文: Domain Specific Sub-network for Multi-Domain Neura…

200 篇论文

Recent advances in natural language processing (NLP) can be largely attributed to the advent of pre-trained language models such as BERT and RoBERTa. While these models demonstrate remarkable performance on general datasets, they can…

Large-scale pre-trained language models have achieved impressive results on a wide range of downstream tasks recently. However, fine-tuning an extremely large-scale pre-trained language model on limited target datasets is often plagued by…

计算与语言 · 计算机科学 2022-11-04 Haojie Zhang , Ge Li , Jia Li , Zhongjin Zhang , Yuqi Zhu , Zhi Jin

Recently, multi-task spoken language understanding (SLU) models have emerged, designed to address various speech processing tasks. However, these models often rely on a large number of parameters. Also, they often encounter difficulties in…

计算与语言 · 计算机科学 2024-06-19 Hayato Futami , Siddhant Arora , Yosuke Kashiwagi , Emiru Tsunoo , Shinji Watanabe

Fine-tuning pre-trained Neural Machine Translation (NMT) models is the dominant approach for adapting to new languages and domains. However, fine-tuning requires adapting and maintaining a separate model for each target task. We propose a…

计算与语言 · 计算机科学 2019-09-19 Ankur Bapna , Naveen Arivazhagan , Orhan Firat

To reduce annotation labor associated with object detection, an increasing number of studies focus on transferring the learned knowledge from a labeled source domain to another unlabeled target domain. However, existing methods assume that…

计算机视觉与模式识别 · 计算机科学 2021-07-01 Xingxu Yao , Sicheng Zhao , Pengfei Xu , Jufeng Yang

Existing studies on semantic parsing mainly focus on the in-domain setting. We formulate cross-domain semantic parsing as a domain adaptation problem: train a semantic parser on some source domains and then adapt it to the target domain.…

计算与语言 · 计算机科学 2017-07-26 Yu Su , Xifeng Yan

Convolutional neural networks require numerous data for training. Considering the difficulties in data collection and labeling in some specific tasks, existing approaches generally use models pre-trained on a large source domain (e.g.…

计算机视觉与模式识别 · 计算机科学 2019-09-06 Zhichen Zhao , Bowen Zhang , Yuning Jiang , Li Xu , Lei Li , Wei-Ying Ma

In this paper, we empirically investigate applying word-level weights to adapt neural machine translation to e-commerce domains, where small e-commerce datasets and large out-of-domain datasets are available. In order to mine in-domain like…

计算与语言 · 计算机科学 2019-06-10 Shen Yan , Leonard Dahlmann , Pavel Petrushkov , Sanjika Hewavitharana , Shahram Khadivi

This paper introduces a concept of neural network specialization via task-specific domain constraining, aimed at enhancing network performance on data subspace in which the network operates. The study presents experiments on training…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Roman Malashin , Daniil Ilyukhin

We investigate techniques for supervised domain adaptation for neural machine translation where an existing model trained on a large out-of-domain dataset is adapted to a small in-domain dataset. In this scenario, overfitting is a major…

计算与语言 · 计算机科学 2017-08-01 Antonio Valerio Miceli Barone , Barry Haddow , Ulrich Germann , Rico Sennrich

Existing data augmentation approaches for neural machine translation (NMT) have predominantly relied on back-translating in-domain (IND) monolingual corpora. These methods suffer from issues associated with a domain information gap, which…

计算与语言 · 计算机科学 2020-04-07 Wei Peng , Chongxuan Huang , Tianhao Li , Yun Chen , Qun Liu

Accurate terminology translation is crucial for ensuring the practicality and reliability of neural machine translation (NMT) systems. To address this, lexically constrained NMT explores various methods to ensure pre-specified words and…

计算与语言 · 计算机科学 2021-08-13 Gyubok Lee , Seongjun Yang , Edward Choi

Cross-domain Chinese Word Segmentation (CWS) remains a challenge despite recent progress in neural-based CWS. The limited amount of annotated data in the target domain has been the key obstacle to a satisfactory performance. In this paper,…

计算与语言 · 计算机科学 2019-08-07 Yuxiao Ye , Yue Zhang , Weikang Li , Likun Qiu , Jian Sun

Previous studies on the domain adaptation for neural machine translation (NMT) mainly focus on the one-pass transferring out-of-domain translation knowledge to in-domain NMT model. In this paper, we argue that such a strategy fails to fully…

计算与语言 · 计算机科学 2019-12-17 Jiali Zeng , Yang Liu , Jinsong Su , Yubin Ge , Yaojie Lu , Yongjing Yin , Jiebo Luo

The ability to deploy robots that can operate safely in diverse environments is crucial for developing embodied intelligent agents. As a community, we have made tremendous progress in within-domain LiDAR semantic segmentation. However, do…

计算机视觉与模式识别 · 计算机科学 2023-08-30 Cristiano Saltori , Aljoša Ošep , Elisa Ricci , Laura Leal-Taixé

Cross-Domain Few-shot Semantic Segmentation (CD-FSS) aims to train generalized models that can segment classes from different domains with a few labeled images. Previous works have proven the effectiveness of feature transformation in…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Jiayi Chen , Rong Quan , Jie Qin

In domain adaptation for neural machine translation, translation performance can benefit from separating features into domain-specific features and common features. In this paper, we propose a method to explicitly model the two kinds of…

计算与语言 · 计算机科学 2019-09-24 Shuhao Gu , Yang Feng , Qun Liu

Domain adaptive pretraining, i.e. the continued unsupervised pretraining of a language model on domain-specific text, improves the modelling of text for downstream tasks within the domain. Numerous real-world applications are based on…

计算与语言 · 计算机科学 2021-09-15 Rasmus Kær Jørgensen , Mareike Hartmann , Xiang Dai , Desmond Elliott

The cross-domain recommendation technique is an effective way of alleviating the data sparse issue in recommender systems by leveraging the knowledge from relevant domains. Transfer learning is a class of algorithms underlying these…

信息检索 · 计算机科学 2018-12-05 Guangneng Hu , Yu Zhang , Qiang Yang

Deep neural networks (DNNs) have been widely used for medical image analysis. However, the lack of access a to large-scale annotated dataset poses a great challenge, especially in the case of rare diseases, or new domains for the research…

图像与视频处理 · 电气工程与系统科学 2021-07-02 Sungho Suh , Sojeong Cheon , Wonseo Choi , Yeon Woong Chung , Won-Kyung Cho , Ji-Sun Paik , Sung Eun Kim , Dong-Jin Chang , Yong Oh Lee