English
Related papers

Related papers: Domain Specific Sub-network for Multi-Domain Neura…

200 papers

Deep Neural Networks (DNNs) have recently been achieving state-of-the-art performance on a variety of computer vision related tasks. However, their computational cost limits their ability to be implemented in embedded systems with…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Laurent Dillard , Yosuke Shinya , Taiji Suzuki

Deep learning has achieved state-of-the-art performance on several computer vision tasks and domains. Nevertheless, it still has a high computational cost and demands a significant amount of parameters. Such requirements hinder the use in…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Samuel Felipe dos Santos , Rodrigo Berriel , Thiago Oliveira-Santos , Nicu Sebe , Jurandy Almeida

In this work we challenge the common approach of using a one-to-one mapping ('translation') between the source and target domains in unsupervised domain adaptation (UDA). Instead, we rely on stochastic translation to capture inherent…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Eleni Chiou , Eleftheria Panagiotaki , Iasonas Kokkinos

Neural Machine Translation (NMT) systems built on multilingual sequence-to-sequence Language Models (msLMs) fail to deliver expected results when the amount of parallel data for a language, as well as the language's representation in the…

Deep Neural Networks trained on large datasets can be easily transferred to new domains with far fewer labeled examples by a process called fine-tuning. This has the advantage that representations learned in the large source domain can be…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Marc Masana , Joost van de Weijer , Luis Herranz , Andrew D. Bagdanov , Jose M Alvarez

Deep convolutional neural networks (DCNNs) based remote sensing (RS) image semantic segmentation technology has achieved great success used in many real-world applications such as geographic element analysis. However, strong dependency on…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Qi Zhao , Shuchang Lyu , Binghao Liu , Lijiang Chen , Hongbo Zhao

This paper focuses on the domain generalization task where domain knowledge is unavailable, and even worse, only samples from a single domain can be utilized during training. Our motivation originates from the recent progresses in deep…

Machine Learning · Computer Science 2022-03-08 Chris Xing Tian , Haoliang Li , Xiaofei Xie , Yang Liu , Shiqi Wang

Multi-head attention has each of the attention heads collect salient information from different parts of an input sequence, making it a powerful mechanism for sequence modeling. Multilingual and multi-domain learning are common scenarios…

Computation and Language · Computer Science 2021-06-22 Hongyu Gong , Yun Tang , Juan Pino , Xian Li

The generalization of deep neural networks to unknown domains is a major challenge despite their tremendous progress in recent years. For this reason, the dynamic area of domain generalization (DG) has emerged. In contrast to unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Manuel Schwonberg , Hanno Gottschalk

This paper presents a novel multi-task learning-based method for unsupervised domain adaptation. Specifically, the source and target domain classifiers are jointly learned by considering the geometry of target domain and the divergence…

Computer Vision and Pattern Recognition · Computer Science 2018-03-28 Jing Zhang , Wanqing Li , Philip Ogunbona

Recent advances in unsupervised domain adaptation have shown the effectiveness of adversarial training to adapt features across domains, endowing neural networks with the capability of being tested on a target domain without requiring any…

Computer Vision and Pattern Recognition · Computer Science 2020-01-24 Mikel Menta , Adriana Romero , Joost van de Weijer

Recently multi-domain recommender systems have received much attention from researchers because they can solve cold-start problem as well as support for cross-selling. However, when applying into multi-domain items, although algorithms…

Information Retrieval · Computer Science 2018-12-18 Linh Nguyen , Tsukasa Ishigaki

Deep learning-based methods deliver state-of-the-art performance for solving inverse problems that arise in computational imaging. These methods can be broadly divided into two groups: (1) learn a network to map measurements to the signal…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Nebiyou Yismaw , Ulugbek S. Kamilov , M. Salman Asif

Limited availability of annotated medical imaging data poses a challenge for deep learning algorithms. Although transfer learning minimizes this hurdle in general, knowledge transfer across disparate domains is shown to be less effective.…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Jitender Singh Virk , Deepti R. Bathula

In the segmentation of remotely sensed images, deep learning models are typically pre-trained using large image databases like ImageNet before fine-tuned on domain-specific datasets. However, the performance of these fine-tuned models is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yuan Fang , Yuanzhi Cai , Jagannath Aryal , Qinfeng Zhu , Hong Huang , Cheng Zhang , Lei Fan

Absence of large-scale labeled data in the practitioner's target domain can be a bottleneck to applying machine learning algorithms in practice. Transfer learning is a popular strategy for leveraging additional data to improve the…

Machine Learning · Computer Science 2022-06-22 Tianshi Cao , Sasha Doubov , David Acuna , Sanja Fidler

Recently, $k$NN-MT has shown the promising capability of directly incorporating the pre-trained neural machine translation (NMT) model with domain-specific token-level $k$-nearest-neighbor ($k$NN) retrieval to achieve domain adaptation…

Computation and Language · Computer Science 2022-05-26 Xin Zheng , Zhirui Zhang , Shujian Huang , Boxing Chen , Jun Xie , Weihua Luo , Jiajun Chen

We develop a novel transfer learning framework to tackle the challenge of limited training data in image reconstruction problems. The proposed framework consists of two training steps, both of which are formed as bi-level optimizations. In…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yunmei Chen , Chi Ding , Xiaojing Ye

Although deep convolutional networks have reached state-of-the-art performance in many medical image segmentation tasks, they have typically demonstrated poor generalisation capability. To be able to generalise from one domain (e.g. one…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 Reuben Dorent , Samuel Joutard , Jonathan Shapey , Sotirios Bisdas , Neil Kitchen , Robert Bradford , Shakeel Saeed , Marc Modat , Sebastien Ourselin , Tom Vercauteren

We propose a novel unsupervised domain adaptation framework based on domain-specific batch normalization in deep neural networks. We aim to adapt to both domains by specializing batch normalization layers in convolutional neural networks…

Machine Learning · Computer Science 2019-06-11 Woong-Gi Chang , Tackgeun You , Seonguk Seo , Suha Kwak , Bohyung Han