English
Related papers

Related papers: Low-Cost On-device Partial Domain Adaptation (LoCO…

200 papers

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

Machine Learning · Computer Science 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

This work aims to enable on-device training of convolutional neural networks (CNNs) by reducing the computation cost at training time. CNN models are usually trained on high-performance computers and only the trained models are deployed to…

Machine Learning · Computer Science 2020-07-08 Yawen Wu , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Imitating skills from low-quality datasets, such as sub-optimal demonstrations and observations with distractors, is common in real-world applications. In this work, we focus on the problem of Learning from Noisy Demonstrations (LND), where…

Machine Learning · Computer Science 2024-04-05 Kaichen Huang , Hai-Hang Sun , Shenghua Wan , Minghao Shao , Shuai Feng , Le Gan , De-Chuan Zhan

Transfer learning aims to learn robust classifiers for the target domain by leveraging knowledge from a source domain. Since the source and the target domains are usually from different distributions, existing methods mainly focus on…

Machine Learning · Computer Science 2019-09-19 Jindong Wang , Yiqiang Chen , Wenjie Feng , Han Yu , Meiyu Huang , Qiang Yang

Test Time Adaptation (TTA) has emerged as a practical solution to mitigate the performance degradation of Deep Neural Networks (DNNs) in the presence of corruption/ noise affecting inputs. Existing approaches in TTA continuously adapt the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Shahriar Rifat , Jonathan Ashdown , Francesco Restuccia

Efficient fine-tuning of pre-trained convolutional neural network (CNN) models using local data is essential for providing high-quality services to users using ubiquitous and resource-limited Internet of Things (IoT) devices. Low-Rank…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-26 Chuntao Ding , Xu Cao , Jianhang Xie , Linlin Fan , Shangguang Wang , Zhichao Lu

The diversity of retinal imaging devices poses a significant challenge: domain shift, which leads to performance degradation when applying the deep learning models trained on one domain to new testing domains. In this paper, we propose a…

Image and Video Processing · Electrical Eng. & Systems 2021-10-07 Peng Liu , Charlie T. Tran , Bin Kong , Ruogu Fang

Keyword spotting accuracy degrades when neural networks are exposed to noisy environments. On-site adaptation to previously unseen noise is crucial to recovering accuracy loss, and on-device learning is required to ensure that the…

Sound · Computer Science 2024-03-19 Cristian Cioflan , Lukas Cavigelli , Manuele Rusci , Miguel de Prado , Luca Benini

In today's world, a vast amount of data is being generated by edge devices that can be used as valuable training data to improve the performance of machine learning algorithms in terms of the achieved accuracy or to reduce the compute…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Aditya Rajagopal , Christos-Savvas Bouganis

Unsupervised domain adaptation~(UDA) aims at reducing the distribution discrepancy when transferring knowledge from a labeled source domain to an unlabeled target domain. Previous UDA methods assume that the source and target domains share…

Computer Vision and Pattern Recognition · Computer Science 2020-08-26 Chuan-Xian Ren , Pengfei Ge , Peiyi Yang , Shuicheng Yan

Recent convolutional neural network (CNN) development continues to advance the state-of-the-art model accuracy for various applications. However, the enhanced accuracy comes at the cost of substantial memory bandwidth and storage…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Hsu-Hsun Chin , Ren-Song Tsay , Hsin-I Wu

Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (UDA), several…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yoonhyung Kim , Changick Kim

The accuracy of tinyML applications is often affected by various environmental factors, such as noises, location/calibration of sensors, and time-related changes. This article introduces a neural network based on-device learning (ODL)…

Machine Learning · Computer Science 2023-12-27 Kazuki Sunaga , Masaaki Kondo , Hiroki Matsutani

We study a new highly-practical problem setting that enables resource-constrained edge devices to adapt a pre-trained model to their local data distributions. Recognizing that device's data are likely to come from multiple latent domains…

Machine Learning · Computer Science 2024-02-02 Ondrej Bohdal , Da Li , Shell Xu Hu , Timothy Hospedales

Few-shot segmentation aims to train a segmentation model that can fast adapt to a novel task for which only a few annotated images are provided. Most recent models have adopted a prototype-based paradigm for few-shot inference. These…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Li Guo , Haoming Liu , Yuxuan Xia , Chengyu Zhang , Xiaochen Lu

Large pre-trained models are usually fine-tuned on downstream task data, and tested on unseen data. When the train and test data come from different domains, the model is likely to struggle, as it is not adapted to the test domain. We…

Computation and Language · Computer Science 2022-06-02 Omer Antverg , Eyal Ben-David , Yonatan Belinkov

Off-dynamics offline reinforcement learning (RL) aims to learn a policy for a target domain using limited target data and abundant source data collected under different transition dynamics. Existing methods typically address dynamics…

Machine Learning · Computer Science 2026-02-25 Zhangjie Xia , Yu Yang , Pan Xu

Computing at the edge offers intriguing possibilities for the development of autonomy and artificial intelligence. The advancements in autonomous technologies and the resurgence of computer vision have led to a rise in demand for fast and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-23 Martina Lofqvist , José Cano

Despite their success in many computer vision tasks, convolutional networks tend to require large amounts of labeled data to achieve generalization. Furthermore, the performance is not guaranteed on a sample from an unseen domain at test…

Computer Vision and Pattern Recognition · Computer Science 2019-09-09 Ozan Ciga , Jianan Chen , Anne Martel

Beyond the complexity of CNNs that require training on large annotated datasets, the domain shift between design and operational data has limited the adoption of CNNs in many real-world applications. For instance, in person…

Computer Vision and Pattern Recognition · Computer Science 2021-01-20 Le Thanh Nguyen-Meidine , Atif Belal , Madhu Kiran , Jose Dolz , Louis-Antoine Blais-Morin , Eric Granger