English
Related papers

Related papers: Low-Cost On-device Partial Domain Adaptation (LoCO…

200 papers

We propose a direct domain adaptation (DDA) approach to enrich the training of supervised neural networks on synthetic data by features from real-world data. The process involves a series of linear operations on the input features to the NN…

Machine Learning · Computer Science 2021-08-18 Tariq Alkhalifah , Oleg Ovcharenko

Partial domain adaptation (PDA) attracts appealing attention as it deals with a realistic and challenging problem when the source domain label space substitutes the target domain. Most conventional domain adaptation (DA) efforts concentrate…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Taotao Jing , Haifeng Xia , Zhengming Ding

In the biomedical domain, there is an abundance of dense, complex data where objects of interest may be challenging to detect or constrained by limits of human knowledge. Labelled domain specific datasets for supervised tasks are often…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Joy Hsu , Wah Chiu , Serena Yeung

Domain adaptation is the supervised learning setting in which the training and test data are sampled from different distributions: training data is sampled from a source domain, whilst test data is sampled from a target domain. This paper…

Machine Learning · Statistics 2016-10-21 Wouter M. Kouw , Jesse H. Krijthe , Marco Loog , Laurens J. P. van der Maaten

Quantized networks use less computational and memory resources and are suitable for deployment on edge devices. While quantization-aware training QAT is the well-studied approach to quantize the networks at low precision, most research…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Kartik Gupta , Akshay Asthana

We propose a provably convergent method, called Efficient Learned Descent Algorithm (ELDA), for low-dose CT (LDCT) reconstruction. ELDA is a highly interpretable neural network architecture with learned parameters and meanwhile retains…

Image and Video Processing · Electrical Eng. & Systems 2021-04-28 Qingchao Zhang , Mehrdad Alvandipour , Wenjun Xia , Yi Zhang , Xiaojing Ye , Yunmei Chen

In the absence of sufficient data variation (e.g., scanner and protocol variability) in annotated data, deep neural networks (DNNs) tend to overfit during training. As a result, their performance is significantly lower on data from unseen…

While deep neural networks are being utilized heavily for autonomous driving, they need to be adapted to new unseen environmental conditions for which they were not trained. We focus on a safety critical application of lane detection, and…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Kshitij Bhardwaj , Zishen Wan , Arijit Raychowdhury , Ryan Goldhahn

Recent developments and emerging use cases, such as smart Internet of Things (IoT) and Edge AI, have sparked considerable interest in the training of neural networks over fully decentralized (serverless) networks. One of the major…

Machine Learning · Computer Science 2025-01-30 Eunjeong Jeong , Marios Kountouris

On-device training is essential for user personalisation and privacy. With the pervasiveness of IoT devices and microcontroller units (MCUs), this task becomes more challenging due to the constrained memory and compute resources, and the…

Machine Learning · Computer Science 2024-06-12 Young D. Kwon , Rui Li , Stylianos I. Venieris , Jagmohan Chauhan , Nicholas D. Lane , Cecilia Mascolo

Distributed deep neural networks (DNNs) have become central to modern computer vision, yet their deployment on resource-constrained edge devices remains hindered by substantial parameter counts, computational demands, and the probability of…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-17 Mahadev Sunil Kumar , Arnab Raha , Debayan Das , Gopakumar G , Rounak Chatterjee , Amitava Mukherjee

Recent works have demonstrated convolutional neural networks are vulnerable to adversarial examples, i.e., inputs to machine learning models that an attacker has intentionally designed to cause the models to make a mistake. To improve the…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xianxu Hou , Jingxin Liu , Bolei Xu , Xiaolong Wang , Bozhi Liu , Guoping Qiu

Transfer learning has achieved promising results by leveraging knowledge from the source domain to annotate the target domain which has few or none labels. Existing methods often seek to minimize the distribution divergence between domains,…

Machine Learning · Computer Science 2018-07-03 Jindong Wang , Yiqiang Chen , Shuji Hao , Wenjie Feng , Zhiqi Shen

Low-rank adaptation (LoRA) has become a prevalent method for adapting pre-trained large language models to downstream tasks. However, the simple low-rank decomposition form may constrain the hypothesis space. To address this limitation, we…

Machine Learning · Computer Science 2025-04-30 Zhekai Du , Yinjie Min , Jingjing Li , Ke Lu , Changliang Zou , Liuhua Peng , Tingjin Chu , Mingming Gong

To leverage data and computation capabilities of mobile devices, machine learning algorithms are deployed at the network edge for training artificial intelligence (AI) models, resulting in the new paradigm of edge learning. In this paper,…

Information Theory · Computer Science 2020-07-01 Dingzhu Wen , Mehdi Bennis , Kaibin Huang

Anomaly detection (AD) plays a vital role across a wide range of domains, but its performance might deteriorate when applied to target domains with limited data. Domain Adaptation (DA) offers a solution by transferring knowledge from a…

Machine Learning · Statistics 2025-08-12 Tran Tuan Kiet , Nguyen Thang Loi , Vo Nguyen Le Duy

Unsupervised Domain Adaptive Object Detection (UDA-OD) uses unlabelled data to improve the reliability of robotic vision systems in open-world environments. Previous approaches to UDA-OD based on self-training have been effective in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Nicolas Harvey Chapman , Feras Dayoub , Will Browne , Christopher Lehnert

Deep neural networks have useful applications in many different tasks, however their performance can be severely affected by changes in the data distribution. For example, in the biomedical field, their performance can be affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Pedro Vianna , Muawiz Chaudhary , Paria Mehrbod , An Tang , Guy Cloutier , Guy Wolf , Michael Eickenberg , Eugene Belilovsky

We introduce a memory- and compute-efficient method for low-communication distributed training. Existing methods reduce communication by performing multiple local updates between infrequent global synchronizations. We demonstrate that their…

Machine Learning · Computer Science 2025-09-29 Anastasiia Filippova , Angelos Katharopoulos , David Grangier , Ronan Collobert

Domain Adaptation is a technique to address the lack of massive amounts of labeled data in unseen environments. Unsupervised domain adaptation is proposed to adapt a model to new modalities using solely labeled source data and unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-11-19 Thong Vo , Naimul Khan