English
Related papers

Related papers: VGS-ATD: Robust Distributed Learning for Multi-Lab…

200 papers

In the last decade, data-driven algorithms outperformed traditional optimization-based algorithms in many research areas, such as computer vision, natural language processing, etc. However, extensive data usages bring a new challenge or…

Machine Learning · Computer Science 2021-12-02 Shih-Chun Lin , Chia-Hung Lin

Fetal ultrasound (US) data is often limited due to privacy and regulatory restrictions, posing challenges for training deep learning (DL) models. While semi-supervised learning (SSL) is commonly used for fetal US image analysis, existing…

Image and Video Processing · Electrical Eng. & Systems 2026-01-27 Fangyijie Wang , Siteng Ma , Guénolé Silvestre , Kathleen M. Curran

Distributed learning is commonly used for accelerating model training by harnessing the computational capabilities of multiple-edge devices. However, in practical applications, the communication delay emerges as a bottleneck due to the…

Machine Learning · Computer Science 2024-03-26 Chanho Park , H. Vincent Poor , Namyoon Lee

Federated learning (FL) has attracted significant attention for enabling collaborative learning without exposing private data. Among the primary variants of FL, vertical federated learning (VFL) addresses feature-partitioned data held by…

Machine Learning · Computer Science 2026-03-31 Kihun Hong , Sejun Park , Ganguk Hwang

Modern Automatic Speech Recognition (ASR) systems rely on distributed deep learning to for quick training completion. To enable efficient distributed training, it is imperative that the training algorithms can converge with a large…

Audio and Speech Processing · Electrical Eng. & Systems 2019-07-15 Wei Zhang , Xiaodong Cui , Ulrich Finkler , George Saon , Abdullah Kayi , Alper Buyuktosunoglu , Brian Kingsbury , David Kung , Michael Picheny

Current network training paradigms primarily focus on either centralized or decentralized data regimes. However, in practice, data availability often exhibits a hybrid nature, where both regimes coexist. This hybrid setting presents new…

Machine Learning · Computer Science 2025-12-01 Junyi Zhu , Ruicong Yao , Taha Ceritli , Savas Ozkan , Matthew B. Blaschko , Eunchung Noh , Jeongwon Min , Cho Jung Min , Mete Ozay

Federated Learning (FL) is a distributed machine learning paradigm that enables collaboration among multiple clients to train a shared model without sharing raw data. However, a major challenge in FL is the label imbalance, where clients…

Machine Learning · Computer Science 2024-09-24 Ziyu Yao

We design and implement a distributed multinode synchronous SGD algorithm, without altering hyper parameters, or compressing data, or altering algorithmic behavior. We perform a detailed analysis of scaling, and identify optimal design…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-03-02 Dipankar Das , Sasikanth Avancha , Dheevatsa Mudigere , Karthikeyan Vaidynathan , Srinivas Sridharan , Dhiraj Kalamkar , Bharat Kaul , Pradeep Dubey

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from…

Machine Learning · Computer Science 2019-07-24 Prashnna Kumar Gyawali , Zhiyuan Li , Sandesh Ghimire , Linwei Wang

Large volumes of medical data remain underutilized because centralizing distributed data is often infeasible due to strict privacy regulations and institutional constraints. In addition, models trained in centralized settings frequently…

Image and Video Processing · Electrical Eng. & Systems 2026-05-12 Puja Saha , Eranga Ukwatta

Current 3D semi-supervised segmentation methods face significant challenges such as limited consideration of contextual information and the inability to generate reliable pseudo-labels for effective unsupervised data use. To address these…

Computer Vision and Pattern Recognition · Computer Science 2023-11-22 Sanaz Karimijafarbigloo , Reza Azad , Yury Velichko , Ulas Bagci , Dorit Merhof

Intelligent fault diagnosis (IFD) plays a crucial role in ensuring the safe operation of industrial machinery and improving production efficiency. However, traditional supervised deep learning methods require a large amount of training data…

Machine Learning · Computer Science 2025-07-22 Yajiao Dai , Jun Li , Zhen Mei , Yiyang Ni , Shi Jin , Zengxiang Li , Sheng Guo , Wei Xiang

Recent attacks have shown that user data can be recovered from FedSGD updates, thus breaking privacy. However, these attacks are of limited practical relevance as federated learning typically uses the FedAvg algorithm. Compared to FedSGD,…

Machine Learning · Computer Science 2022-11-02 Dimitar I. Dimitrov , Mislav Balunović , Nikola Konstantinov , Martin Vechev

The privacy-preserving federated learning for vertically partitioned data has shown promising results as the solution of the emerging multi-party joint modeling application, in which the data holders (such as government branches, private…

Machine Learning · Computer Science 2020-08-17 Bin Gu , An Xu , Zhouyuan Huo , Cheng Deng , Heng Huang

Federated Learning enables visual models to be trained on-device, bringing advantages for user privacy (data need never leave the device), but challenges in terms of data diversity and quality. Whilst typical models in the datacenter are…

Machine Learning · Computer Science 2020-07-20 Tzu-Ming Harry Hsu , Hang Qi , Matthew Brown

Federated learning is gaining popularity as a distributed machine learning method that can be used to deploy AI-dependent IoT applications while protecting client data privacy and security. Due to the differences of clients, a single global…

Machine Learning · Computer Science 2022-02-21 Xingjian Cao , Gang Sun , Hongfang Yu , Mohsen Guizani

In multi-label learning, each sample is associated with several labels. Existing works indicate that exploring correlations between labels improve the prediction performance. However, embedding the label correlations into the training…

Machine Learning · Computer Science 2011-03-04 Tianyi Zhou , Dacheng Tao

Semi-supervised multi-organ medical image segmentation aids physicians in improving disease diagnosis and treatment planning and reduces the time and effort required for organ annotation.Existing state-of-the-art methods train the labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Haochen Zhao , Hui Meng , Deqian Yang , Xiaozheng Xie , Xiaoze Wu , Qingfeng Li , Jianwei Niu

Image recognition is an important topic in computer vision and image processing, and has been mainly addressed by supervised deep learning methods, which need a large set of labeled images to achieve promising performance. However, in most…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Haoqian Wang , Zhiwei Xu , Jun Xu , Wangpeng An , Lei Zhang , Qionghai Dai

Unlike traditional central training, federated learning (FL) improves the performance of the global model by sharing and aggregating local models rather than local data to protect the users' privacy. Although this training approach appears…

Machine Learning · Computer Science 2022-01-27 Jiahui Geng , Yongli Mou , Feifei Li , Qing Li , Oya Beyan , Stefan Decker , Chunming Rong