English
Related papers

Related papers: Budget-Aware Adapters for Multi-Domain Learning

200 papers

Many multi-domain neural machine translation (NMT) models achieve knowledge transfer by enforcing one encoder to learn shared embedding across domains. However, this design lacks adaptation to individual domains. To overcome this…

Computation and Language · Computer Science 2021-02-15 Haoming Jiang , Chen Liang , Chong Wang , Tuo Zhao

Many networking tasks now employ deep learning (DL) to solve complex prediction and optimization problems. However, current design philosophy of DL-based algorithms entails intensive engineering overhead due to the manual design of deep…

Networking and Internet Architecture · Computer Science 2024-08-07 Duo Wu , Xianda Wang , Yaqi Qiao , Zhi Wang , Junchen Jiang , Shuguang Cui , Fangxin Wang

Domain adaptation problems arise in a variety of applications, where a training dataset from the \textit{source} domain and a test dataset from the \textit{target} domain typically follow different distributions. The primary difficulty in…

Machine Learning · Computer Science 2017-08-11 Wenhao Jiang , Cheng Deng , Wei Liu , Feiping Nie , Fu-lai Chung , Heng Huang

We focus on bridging domain discrepancy in lane detection among different scenarios to greatly reduce extra annotation and re-training costs for autonomous driving. Critical factors hinder the performance improvement of cross-domain lane…

Computer Vision and Pattern Recognition · Computer Science 2022-11-10 Chenguang Li , Boheng Zhang , Jia Shi , Guangliang Cheng

Deep learning models tend to underperform in the presence of domain shifts. Domain transfer has recently emerged as a promising approach wherein images exhibiting a domain shift are transformed into other domains for augmentation or…

Image and Video Processing · Electrical Eng. & Systems 2022-10-27 Weinan Song , Gaurav Fotedar , Nima Tajbakhsh , Ziheng Zhou , Lei He , Xiaowei Ding

Machine learning models often struggle to generalize across domains with varying data distributions, such as differing noise levels, leading to degraded performance. Traditional strategies like personalized training, which trains separate…

Machine Learning · Computer Science 2026-04-07 Snehaa Reddy , Jayaprakash Katual , Satish Mulleti

We introduce a model-based image reconstruction framework with a convolution neural network (CNN) based regularization prior. The proposed formulation provides a systematic approach for deriving deep architectures for inverse problems with…

Computer Vision and Pattern Recognition · Computer Science 2019-06-06 Hemant Kumar Aggarwal , Merry P. Mani , Mathews Jacob

Broad learning system (BLS) has been proposed for a few years. It demonstrates an effective learning capability for many classification and regression problems. However, BLS and its improved versions are mainly used to deal with…

Machine Learning · Computer Science 2021-06-29 Chao Yuan , Chang-E Ren

We propose a simple neural network model to deal with the domain adaptation problem in object recognition. Our model incorporates the Maximum Mean Discrepancy (MMD) measure as a regularization in the supervised learning to reduce the…

Computer Vision and Pattern Recognition · Computer Science 2016-07-28 Muhammad Ghifary , W. Bastiaan Kleijn , Mengjie Zhang

Deep neural networks have demonstrated impressive performance in various machine learning tasks. However, they are notoriously sensitive to changes in data distribution. Often, even a slight change in the distribution can lead to drastic…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Alon Hazan , Yoel Shoshan , Daniel Khapun , Roy Aladjem , Vadim Ratner

Large language models (LLMs) excel in open domains but struggle in specialized settings with limited data and evolving knowledge. Existing domain adaptation practices rely heavily on manual trial-and-error processes, incur significant…

Machine Learning · Computer Science 2026-03-10 Sidharth Sinha , Anson Bastos , Xuchao Zhang , Akshay Nambi , Chetan Bansal , Saravan Rajmohan

Deep learning (DL) allows computer models to learn, visualize, optimize, refine, and predict data. To understand its present state, examining the most recent advancements and applications of deep learning across various domains is…

3D object detectors are fundamental components of perception systems in autonomous vehicles. While these detectors achieve remarkable performance on standard autonomous driving benchmarks, they often struggle to generalize across different…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Bartłomiej Olber , Jakub Winter , Paweł Wawrzyński , Andrii Gamalii , Daniel Górniak , Marcin Łojek , Robert Nowak , Krystian Radlak

In recent years, object detection has shown impressive results using supervised deep learning, but it remains challenging in a cross-domain environment. The variations of illumination, style, scale, and appearance in different domains can…

Computer Vision and Pattern Recognition · Computer Science 2019-08-12 Rongchang Xie , Fei Yu , Jiachao Wang , Yizhou Wang , Li Zhang

Transformers have become the dominant architecture across a wide range of domains, largely due to the effectiveness of multi-head attention in capturing diverse representation subspaces. However, standard multi-head attention activates all…

Machine Learning · Computer Science 2026-04-27 Bilal Faye , Abdoulaye Mbaye , Hanane Azzag , Mustapha Lebbah

Most existing multi-source domain adaptation (MSDA) methods minimize the distance between multiple source-target domain pairs via feature distribution alignment, an approach borrowed from the single source setting. However, with diverse…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Zhongying Deng , Kaiyang Zhou , Yongxin Yang , Tao Xiang

Multi-domain learning (MDL) aims at obtaining a model with minimal average risk across multiple domains. Our empirical motivation is automated microscopy data, where cultured cells are imaged after being exposed to known and unknown…

Real-world perception systems in many cases build on hardware with limited resources to adhere to cost and power limitations of their carrying system. Deploying deep neural networks on resource-constrained hardware became possible with…

Computer Vision and Pattern Recognition · Computer Science 2022-05-06 Julia Hornauer , Lazaros Nalpantidis , Vasileios Belagiannis

We present a novel framework that can combine multi-domain learning (MDL), data imputation (DI) and multi-task learning (MTL) to improve performance for classification and regression tasks in different domains. The core of our method is an…

Machine Learning · Computer Science 2020-03-18 Andre Mendes , Julian Togelius , Leandro dos Santos Coelho

Domain generalization (DG) is a fundamental yet very challenging research topic in machine learning. The existing arts mainly focus on learning domain-invariant features with limited source domains in a static model. Unfortunately, there is…

Machine Learning · Computer Science 2022-05-30 Zhishu Sun , Zhifeng Shen , Luojun Lin , Yuanlong Yu , Zhifeng Yang , Shicai Yang , Weijie Chen