中文
相关论文

相关论文: Resource-efficient domain adaptive pre-training fo…

200 篇论文

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

计算机视觉与模式识别 · 计算机科学 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

Domain shift, the mismatch between training and testing data characteristics, causes significant degradation in the predictive performance in multi-source imaging scenarios. In medical imaging, the heterogeneity of population, scanners and…

机器学习 · 计算机科学 2021-12-21 Rongguang Wang , Pratik Chaudhari , Christos Davatzikos

Self-training emerges as an important research line on domain adaptation. By taking the model's prediction as the pseudo labels of the unlabeled data, self-training bootstraps the model with pseudo instances in the target domain. However,…

机器学习 · 计算机科学 2023-08-08 Menglong Lu , Zhen Huang , Yunxiang Zhao , Zhiliang Tian , Yang Liu , Dongsheng Li

Unsupervised domain adaptation (UDA) aims to learn a model trained on source domain and performs well on unlabeled target domain. In medical image segmentation field, most existing UDA methods depend on adversarial learning to address the…

计算机视觉与模式识别 · 计算机科学 2022-11-29 Shaolei Liu , Siqi Yin , Linhao Qu , Manning Wang

When applying LLMs to real-world enterprise operations, LLMs need to handle proprietary knowledge in small domains of specific operations ($\textbf{micro domains}$). A previous study shows micro domain-adaptive pre-training…

计算与语言 · 计算机科学 2026-02-05 Masaya Tsunokake , Yuta Koreeda , Terufumi Morishita , Koichi Nagatsuka , Hikaru Tomonari , Yasuhiro Sogawa

Recent works on domain adaptation reveal the effectiveness of adversarial learning on filling the discrepancy between source and target domains. However, two common limitations exist in current adversarial-learning-based methods. First,…

计算机视觉与模式识别 · 计算机科学 2019-12-05 Minghao Xu , Jian Zhang , Bingbing Ni , Teng Li , Chengjie Wang , Qi Tian , Wenjun Zhang

Domain adaptation investigates the problem of leveraging knowledge from a well-labeled source domain to an unlabeled target domain, where the two domains are drawn from different data distributions. Because of the distribution shifts,…

计算机视觉与模式识别 · 计算机科学 2019-07-12 Jingjing Li , Mengmeng Jing , Yue Xie , Ke Lu , Zi Huang

Domain adaptation targets at knowledge acquisition and dissemination from a labeled source domain to an unlabeled target domain under distribution shift. Still, the common requirement of identical class space shared across domains hinders…

机器学习 · 计算机科学 2022-03-16 Zhangjie Cao , Kaichao You , Ziyang Zhang , Jianmin Wang , Mingsheng Long

Annotating 3D LiDAR point clouds for perception tasks is fundamental for many applications e.g., autonomous driving, yet it still remains notoriously labor-intensive. Pretraining-finetuning approach can alleviate the labeling burden by…

计算机视觉与模式识别 · 计算机科学 2025-07-17 Xiangchao Yan , Runjian Chen , Bo Zhang , Hancheng Ye , Renqiu Xia , Jiakang Yuan , Hongbin Zhou , Xinyu Cai , Botian Shi , Wenqi Shao , Ping Luo , Yu Qiao , Tao Chen , Junchi Yan

Although recent years have witnessed significant advancements in medical image segmentation, the pervasive issue of domain shift among medical images from diverse centres hinders the effective deployment of pre-trained models. Many…

计算机视觉与模式识别 · 计算机科学 2024-12-30 Ziyang Chen , Yiwen Ye , Yongsheng Pan , Yong Xia

As a study on the efficient usage of data, Multi-source Unsupervised Domain Adaptation transfers knowledge from multiple source domains with labeled data to an unlabeled target domain. However, the distribution discrepancy between different…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Tong Xu , Lin Wang , Wu Ning , Chunyan Lyu , Kejun Wang , Chenhui Wang

Domain adaptation (DA) is a quickly expanding area in machine learning that involves adjusting a model trained in one domain to perform well in another domain. While there have been notable progressions, the fundamental concept of numerous…

计算机视觉与模式识别 · 计算机科学 2026-02-11 Yihang Wu , Ahmad Chaddad

To realize the full potential of deep learning for medical imaging, large annotated datasets are required for training. Such datasets are difficult to acquire because labeled medical images are not usually available due to privacy issues,…

计算机视觉与模式识别 · 计算机科学 2018-06-29 Faisal Mahmood , Richard Chen , Nicholas J. Durr

While deep learning methods have shown great success in medical image analysis, they require a number of medical images to train. Due to data privacy concerns and unavailability of medical annotators, it is oftentimes very difficult to…

图像与视频处理 · 电气工程与系统科学 2020-10-08 Yue Yang , Pengtao Xie

Cross-domain generalization is an open problem in WiFi-based sensing due to variations in environments, devices, and subjects, causing domain shifts in channel state information. To address this, we propose Domain-Adversarial Test-Time…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Julian Strohmayer , Rafael Sterzinger , Matthias Wödlinger , Martin Kampel

Large-scale general domain pretraining followed by downstream-specific finetuning has become a predominant paradigm in machine learning. However, discrepancies between the pretraining and target domains can still lead to performance…

机器学习 · 计算机科学 2024-10-15 Ruiyi Zhang , Sai Ashish Somayajula , Pengtao Xie

This paper presents a novel approach for unsupervised domain adaptation (UDA) targeting H&E stained histology images. Existing adversarial domain adaptation methods may not effectively align different domains of multimodal distributions…

计算机视觉与模式识别 · 计算机科学 2023-10-02 Ravi Kant Gupta , Shounak Das , Amit Sethi

Learn in-situ is a growing trend for Edge AI. Training deep neural network (DNN) on edge devices is challenging because both energy and memory are constrained. Low precision training helps to reduce the energy cost of a single training…

机器学习 · 计算机科学 2020-12-24 Tian Huang , Tao Luo , Joey Tianyi Zhou

Traditional deep learning-based visual imitation learning techniques require a large amount of demonstration data for model training, and the pre-trained models are difficult to adapt to new scenarios. To address these limitations, we…

机器人学 · 计算机科学 2022-04-26 Dandan Zhang , Wen Fan , John Lloyd , Chenguang Yang , Nathan Lepora

Pre-training is prevalent in deep learning for vision and text data, leveraging knowledge from other datasets to enhance downstream tasks. However, for tabular data, the inherent heterogeneity in attribute and label spaces across datasets…

机器学习 · 计算机科学 2025-02-13 Han-Jia Ye , Qi-Le Zhou , Huai-Hong Yin , De-Chuan Zhan , Wei-Lun Chao