English
Related papers

Related papers: Personalized Dictionary Learning for Heterogeneous…

200 papers

Federated learning's poor performance in the presence of heterogeneous data remains one of the most pressing issues in the field. Personalized federated learning departs from the conventional paradigm in which all clients employ the same…

Machine Learning · Computer Science 2024-02-27 Mengen Luo , Ercan Engin Kuruoglu

Federated learning (FL for simplification) is a distributed machine learning technique that utilizes global servers and collaborative clients to achieve privacy-preserving global model training without direct data sharing. However,…

Machine Learning · Computer Science 2022-11-28 Mingjia Shi , Yuhao Zhou , Qing Ye , Jiancheng Lv

In this paper, we propose supervised dictionary learning (SDL) by incorporating information on class labels into the learning of the dictionary. To this end, we propose to learn the dictionary in a space where the dependency between the…

Computer Vision and Pattern Recognition · Computer Science 2013-11-27 Mehrdad J. Gangeh , Ali Ghodsi , Mohamed S. Kamel

In this paper, we address the challenge of Perspective-Invariant Learning in machine learning and computer vision, which involves enabling a network to understand images from varying perspectives to achieve consistent semantic…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Deyi Ji , Feng Zhao , Lanyun Zhu , Wenwei Jin , Hongtao Lu , Jieping Ye

Personalized Federated Learning (PFL) aims to train customized models for clients with highly heterogeneous data distributions while preserving data privacy. Existing approaches often rely on heuristics like clustering or model…

Artificial Intelligence · Computer Science 2026-03-13 Ping Guo , Tiantian Zhang , Xi Lin , Xiang Li , Zhi-Ri Tang , Qingfu Zhang

Partial Label Learning (PLL) aims to learn from the data where each training instance is associated with a set of candidate labels, among which only one is correct. Most existing methods deal with such problem by either treating each…

Machine Learning · Computer Science 2019-06-04 Gengyu Lyu , Songhe Feng , Yi Jin , Guojun Dai , Congyan Lang , Yidong Li

Training a deep neural network requires a large amount of single-task data and involves a long time-consuming optimization phase. This is not scalable to complex, realistic environments with new unexpected changes. Humans can perform fast…

Neural and Evolutionary Computing · Computer Science 2020-09-04 Tsendsuren Munkhdalai

Decentralized and federated learning algorithms face data heterogeneity as one of the biggest challenges, especially when users want to learn a specific task. Even when personalized headers are used concatenated to a shared network…

Machine Learning · Computer Science 2022-12-22 Matin Mortaheb , Sennur Ulukus

Heterogeneous face matching is a challenge issue in face recognition due to large domain difference as well as insufficient pairwise images in different modalities during training. This paper proposes a coupled deep learning (CDL) approach…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Xiang Wu , Lingxiao Song , Ran He , Tieniu Tan

Federated learning enables the deployment of machine learning to problems for which centralized data collection is impractical. Adding differential privacy guarantees bounds on privacy while data are contributed to a global model. Adding…

Machine Learning · Computer Science 2022-02-22 Andrew Silva , Katherine Metcalf , Nicholas Apostoloff , Barry-John Theobald

Large pretrained language models (LLMs) have shown surprising In-Context Learning (ICL) ability. An important application in deploying large language models is to augment LLMs with a private database for some specific task. The main problem…

Cryptography and Security · Computer Science 2024-05-09 Chunyan Zheng , Keke Sun , Wenhao Zhao , Haibo Zhou , Lixin Jiang , Shaoyang Song , Chunlai Zhou

Federated learning is an emerging distributed machine learning framework aiming at protecting data privacy. Data heterogeneity is one of the core challenges in federated learning, which could severely degrade the convergence rate and…

Machine Learning · Statistics 2025-11-27 Feifei Wang , Huiyun Tang , Yang Li

Recently, federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. Nevertheless, directly applying federated learning to real-world tasks faces…

Machine Learning · Computer Science 2022-04-19 Bingzhe Wu , Zhipeng Liang , Yuxuan Han , Yatao Bian , Peilin Zhao , Junzhou Huang

Federated Learning is a powerful machine learning paradigm to cooperatively train a global model with highly distributed data. A major bottleneck on the performance of distributed Stochastic Gradient Descent (SGD) algorithm for large-scale…

Machine Learning · Computer Science 2020-01-24 Haozhao Wang , Zhihao Qu , Song Guo , Xin Gao , Ruixuan Li , Baoliu Ye

This paper presents a structured dictionary-based model for hyperspectral data that incorporates both spectral and contextual characteristics of a spectral sample, with the goal of hyperspectral image classification. The idea is to…

Computer Vision and Pattern Recognition · Computer Science 2013-08-07 Ali Soltani-Farani , Hamid R. Rabiee , Seyyed Abbas Hosseini

Remote sensing image segmentation faces persistent challenges in distinguishing morphologically similar categories and adapting to diverse scene variations. While existing methods rely on implicit representation learning paradigms, they…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Xuechao Zou , Yue Li , Shun Zhang , Kai Li , Shiying Wang , Pin Tao , Junliang Xing , Congyan Lang

As increasingly capable large language models (LLMs) emerge, researchers have begun exploring their potential for subjective tasks. While recent work demonstrates that LLMs can be aligned with diverse human perspectives, evaluating this…

Computation and Language · Computer Science 2025-10-14 Pietro Bernardelle , Leon Fröhling , Stefano Civelli , Gianluca Demartini

Heterogeneous federated learning (HFL) aims to ensure effective and privacy-preserving collaboration among different entities. As newly joined clients require significant adjustments and additional training to align with the existing…

Machine Learning · Computer Science 2026-01-29 Kaile Wang , Jiannong Cao , Yu Yang , Xiaoyin Li , Mingjin Zhang

We present a novel hierarchical triplet loss (HTL) capable of automatically collecting informative training samples (triplets) via a defined hierarchical tree that encodes global context information. This allows us to cope with the main…

Computer Vision and Pattern Recognition · Computer Science 2018-10-17 Weifeng Ge , Weilin Huang , Dengke Dong , Matthew R. Scott

Despite the remarkable success of pre-trained language models (PLMs), they still face two challenges: First, large-scale PLMs are inefficient in terms of memory footprint and computation. Second, on the downstream tasks, PLMs tend to rely…

Computation and Language · Computer Science 2022-10-12 Yuanxin Liu , Fandong Meng , Zheng Lin , Jiangnan Li , Peng Fu , Yanan Cao , Weiping Wang , Jie Zhou