English
Related papers

Related papers: Budget-Aware Adapters for Multi-Domain Learning

200 papers

Neural networks (NNs) achieve outstanding performance in many domains; however, their decision processes are often opaque and their inference can be computationally expensive in resource-constrained environments. We recently proposed…

Machine Learning · Computer Science 2025-05-30 Chang Yue , Niraj K. Jha

Beam selection for millimeter-wave links in a vehicular scenario is a challenging problem, as an exhaustive search among all candidate beam pairs cannot be assuredly completed within short contact times. We solve this problem via a novel…

Deep learning (DL) models have achieved great success in many application domains. As such, many industrial companies such as Google and Facebook have acknowledged the importance of multi-tenant DL services. Although the multi-tenant…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-19 Zihan Liu , Jingwen Leng , Zhihui Zhang , Quan Chen , Chao Li , Minyi Guo

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

The insertion of deep learning in medical image analysis had lead to the development of state-of-the art strategies in several applications such a disease classification, as well as abnormality detection and segmentation. However, even the…

Image and Video Processing · Electrical Eng. & Systems 2022-02-24 Mauricio Orbes-Arteaga , Thomas Varsavsky , Lauge Sorensen , Mads Nielsen , Akshay Pai , Sebastien Ourselin , Marc Modat , M Jorge Cardoso

In this paper, we introduce a discrete variant of the meta-learning framework. Meta-learning aims at exploiting prior experience and data to improve performance on future tasks. By now, there exist numerous formulations for meta-learning in…

Machine Learning · Computer Science 2021-01-12 Arman Adibi , Aryan Mokhtari , Hamed Hassani

In this work, we present a new, algorithm for multi-domain learning. Given a pretrained architecture and a set of visual domains received sequentially, the goal of multi-domain learning is to produce a single model performing a task in all…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Massimiliano Mancini , Elisa Ricci , Barbara Caputo , Samuel Rota Buló

Data sparsity and cold-start problems are persistent challenges in recommendation systems. Cross-domain recommendation (CDR) is a promising solution that utilizes knowledge from the source domain to improve the recommendation performance in…

Information Retrieval · Computer Science 2023-11-07 Yanyu Chen , Yao Yao , Wai Kin Victor Chan , Li Xiao , Kai Zhang , Liang Zhang , Yun Ye

We propose Impatient Deep Neural Networks (DNNs) which deal with dynamic time budgets during application. They allow for individual budgets given a priori for each test example and for anytime prediction, i.e., a possible interruption at…

Computer Vision and Pattern Recognition · Computer Science 2016-10-11 Manuel Amthor , Erik Rodner , Joachim Denzler

Unsupervised domain adaptation (UDA) with pre-trained language models (PrLM) has achieved promising results since these pre-trained models embed generic knowledge learned from various domains. However, fine-tuning all the parameters of the…

Computation and Language · Computer Science 2021-11-02 Rongsheng Zhang , Yinhe Zheng , Xiaoxi Mao , Minlie Huang

We propose to focus on the problem of discovering neural network architectures efficient in terms of both prediction quality and cost. For instance, our approach is able to solve the following tasks: learn a neural network able to predict…

Machine Learning · Computer Science 2018-05-24 Tom Veniat , Ludovic Denoyer

Machine Learning (ML) models are very effective in many learning tasks, due to the capability to extract meaningful information from large data sets. Nevertheless, there are learning problems that cannot be easily solved relying on pure…

Machine Learning · Computer Science 2021-01-29 Andrea Borghesi , Federico Baldo , Michele Lombardi , Michela Milano

Universal domain adaptation (UniDA) is a practical but challenging problem, in which information about the relation between the source and the target domains is not given for knowledge transfer. Existing UniDA methods may suffer from the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-29 Yanzuo Lu , Meng Shen , Andy J Ma , Xiaohua Xie , Jian-Huang Lai

Recent advancements in deep neural networks have markedly enhanced the performance of computer vision tasks, yet the specialized nature of these networks often necessitates extensive data and high computational power. Addressing these…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Jiayou Chao , Wei Zhu

Recently unsupervised domain adaptation for the semantic segmentation task has become more and more popular due to high-cost of pixel-level annotation on real-world images. However, most domain adaptation methods are only restricted to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Takashi Isobe , Xu Jia , Shuaijun Chen , Jianzhong He , Yongjie Shi , Jianzhuang Liu , Huchuan Lu , Shengjin Wang

Classification and identification of the materials lying over or beneath the Earth's surface have long been a fundamental but challenging research topic in geoscience and remote sensing (RS) and have garnered a growing concern owing to the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Danfeng Hong , Lianru Gao , Naoto Yokoya , Jing Yao , Jocelyn Chanussot , Qian Du , Bing Zhang

Model-agnostic meta-learners aim to acquire meta-learned parameters from similar tasks to adapt to novel tasks from the same distribution with few gradient updates. With the flexibility in the choice of models, those frameworks demonstrate…

Machine Learning · Computer Science 2019-10-31 Risto Vuorio , Shao-Hua Sun , Hexiang Hu , Joseph J. Lim

Most domain adaptation methods focus on single-source-single-target adaptation settings. Multi-target domain adaptation is a powerful extension in which a single classifier is learned for multiple unlabeled target domains. To build a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-02 Sudipan Saha , Shan Zhao , Nasrullah Sheikh , Xiao Xiang Zhu

Many software systems today face uncertain operating conditions, such as sudden changes in the availability of resources or unexpected user behavior. Without proper mitigation these uncertainties can jeopardize the system goals.…

Software Engineering · Computer Science 2023-12-14 Danny Weyns , Omid Gheibi , Federico Quin , Jeroen Van Der Donckt

Large language models (LLMs) often suffer from catastrophic forgetting in continual learning (CL) scenarios, where performance on previously learned tasks degrades severely while training on sequentially arriving tasks. Although pioneering…

Machine Learning · Computer Science 2025-10-17 Zhiyi Wan , Wanrou Du , Liang Li , Miao Pan , Xiaoqi Qin