English
Related papers

Related papers: Federated Domain Generalization with Domain-specif…

200 papers

The use of pre-trained language models fine-tuned to address specific downstream tasks is a common approach in natural language processing (NLP). However, acquiring domain-specific knowledge via fine-tuning is challenging. Traditional…

Computation and Language · Computer Science 2024-09-24 Sangyeon Cho , Jangyeong Jeon , Dongjoon Lee , Changhee Lee , Junyeong Kim

Distributional shift between domains poses great challenges to modern machine learning algorithms. The domain generalization (DG) signifies a popular line targeting this issue, where these methods intend to uncover universal patterns across…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Hao Chen , Qi Zhang , Zenan Huang , Haobo Wang , Junbo Zhao

Recent advances in generative modeling with diffusion processes (DPs) enabled breakthroughs in image synthesis. Despite impressive image quality, these models have various prompt compliance problems, including low recall in generating…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Deepak Sridhar , Abhishek Peri , Rohith Rachala , Nuno Vasconcelos

Due to the highly sensitive nature of certain data in cross-border sharing, collaborative cross-border recommendations and data sharing are often subject to stringent privacy protection regulations, resulting in insufficient data for model…

Machine Learning · Computer Science 2025-05-27 Zhizhong Tan , Jiexin Zheng , Xingxing Yang , Chi Zhang , Weiping Deng , Wenyong Wang

Federated learning (FL) has enabled global model training on decentralized data in a privacy-preserving way by aggregating model updates. However, for many natural language processing (NLP) tasks that utilize pre-trained language models…

Machine Learning · Computer Science 2023-01-25 Haodong Zhao , Wei Du , Fangqi Li , Peixuan Li , Gongshen Liu

The annotation scarcity of medical image segmentation poses challenges in collecting sufficient training data for deep learning models. Specifically, models trained on limited data may not generalize well to other unseen data domains,…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Heng Li , Haojin Li , Wei Zhao , Huazhu Fu , Xiuyun Su , Yan Hu , Jiang Liu

Large pre-trained vision-language models like CLIP have transformed computer vision by aligning images and text in a shared feature space, enabling robust zero-shot transfer via prompting. Soft-prompting, such as Context Optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Arsham Gholamzadeh Khoee , Yinan Yu , Robert Feldt

Integrating pretrained vision-language foundation models like CLIP into federated learning has attracted significant attention for enhancing generalization across diverse tasks. Typically, federated learning of vision-language models…

Machine Learning · Computer Science 2024-10-01 Bikang Pan , Wei Huang , Ye Shi

Prompt learning has emerged as an efficient and effective approach for transferring foundational Vision-Language Models (e.g., CLIP) to downstream tasks. However, current methods tend to overfit to seen categories, thereby limiting their…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Chen Xu , Yuhan Zhu , Guozhen Zhang , Haocheng Shen , Yixuan Liao , Xiaoxin Chen , Gangshan Wu , Limin Wang

Domain generalization (DG) is the challenging and topical problem of learning models that generalize to novel testing domains with different statistics than a set of known training domains. The simple approach of aggregating data from all…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Da Li , Jianshu Zhang , Yongxin Yang , Cong Liu , Yi-Zhe Song , Timothy M. Hospedales

Leveraging datasets available to learn a model with high generalization ability to unseen domains is important for computer vision, especially when the unseen domain's annotated data are unavailable. We study a novel and practical problem…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Yang Shu , Zhangjie Cao , Chenyu Wang , Jianmin Wang , Mingsheng Long

Federated Learning faces significant challenges in statistical and system heterogeneity, along with high energy consumption, necessitating efficient client selection strategies. Traditional approaches, including heuristic and learning-based…

Machine Learning · Computer Science 2025-10-01 Zhiyuan Ning , Chunlin Tian , Meng Xiao , Wei Fan , Pengyang Wang , Li Li , Pengfei Wang , Yuanchun Zhou

Federated learning (FL) is emerging as a promising technique for collaborative learning without local data leaving their devices. However, clients' data originating from diverse domains may degrade model performance due to domain shifts,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Zheng Wang , Zihui Wang , Zheng Wang , Xiaoliang Fan , Cheng Wang

Cross-Domain Sequential Recommendation (CDSR) leverages user behaviors across domains to enhance recommendation quality. However, naive aggregation of sequential signals can introduce conflicting domain-specific preferences, leading to…

Information Retrieval · Computer Science 2025-09-12 Xiaoxin Ye , Chengkai Huang , Hongtao Huang , Lina Yao

Remote sensing data is often distributed across multiple institutions, and due to privacy concerns and data-sharing restrictions, leveraging large-scale datasets in a centralized training framework is challenging. Federated learning offers…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Hui Lin , Chao Zhang , Danfeng Hong , Kexin Dong , Congcong Wen

Domain Generalization (DG) seeks to develop a versatile model capable of performing effectively on unseen target domains. Notably, recent advances in pre-trained Visual Foundation Models (VFMs), such as CLIP, have demonstrated considerable…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 De Cheng , Zhipeng Xu , Xinyang Jiang , Dongsheng Li , Nannan Wang , Xinbo Gao

Federated learning enables a population of clients to collaboratively train machine learning models without exchanging their raw data, but standard algorithms such as FedAvg suffer from slow convergence and high communication and memory…

Machine Learning · Computer Science 2026-04-30 Yutong He , Zhengyang Huang , Jiahe Geng

We present Diffusion Model Patching (DMP), a simple method to boost the performance of pre-trained diffusion models that have already reached convergence, with a negligible increase in parameters. DMP inserts a small, learnable set of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Seokil Ham , Sangmin Woo , Jin-Young Kim , Hyojun Go , Byeongjun Park , Changick Kim

Compositional Zero-Shot Learning (CZSL) aims to recognize novel concepts formed by known states and objects during training. Existing methods either learn the combined state-object representation, challenging the generalization of unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Xiaocheng Lu , Ziming Liu , Song Guo , Jingcai Guo

Prompting method is regarded as one of the crucial progress for few-shot nature language processing. Recent research on prompting moves from discrete tokens based ``hard prompts'' to continuous ``soft prompts'', which employ learnable…

Computation and Language · Computer Science 2023-02-06 Yutai Hou , Hongyuan Dong , Xinghao Wang , Bohan Li , Wanxiang Che