English
Related papers

Related papers: Sample Selection Using Multi-Task Autoencoders in …

200 papers

The ubiquity of edge devices has led to a growing amount of unlabeled data produced at the edge. Deep learning models deployed on edge devices are required to learn from these unlabeled data to continuously improve accuracy. Self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-26 Jiahe Shi , Yawen Wu , Dewen Zeng , Jun Tao , Jingtong Hu , Yiyu Shi

Unsupervised learning methods for feature extraction are becoming more and more popular. We combine the popular contrastive learning method (prototypical contrastive learning) and the classic representation learning method (autoencoder) to…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Zeyu Cao , Xiaorun Li , Liaoying Zhao

Self-supervised learning (SSL) has emerged as a crucial technique in image processing, encoding, and understanding, especially for developing today's vision foundation models that utilize large-scale datasets without annotations to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chuang Niu , Wenjun Xia , Hongming Shan , Ge Wang

Self-taught learning is a technique that uses a large number of unlabeled data as source samples to improve the task performance on target samples. Compared with other transfer learning techniques, self-taught learning can be applied to a…

Machine Learning · Computer Science 2019-12-03 Siwei Feng , Han Yu , Marco F. Duarte

Federated Learning (FL) enables multiple resource-constrained edge devices with varying levels of heterogeneity to collaboratively train a global model. However, devices with limited capacity can create bottlenecks and slow down model…

Machine Learning · Computer Science 2025-04-08 Afsaneh Mahanipour , Hana Khamfroush

Various IoT applications demand resource-constrained machine learning mechanisms for different applications such as pervasive healthcare, activity monitoring, speech recognition, real-time computer vision, etc. This necessitates us to…

Machine Learning · Computer Science 2020-11-09 Gautham Krishna Gudur , Bala Shyamala Balaji , Satheesh K. Perepu

We propose using federated learning, a decentralized on-device learning paradigm, to train speech recognition models. By performing epochs of training on a per-user basis, federated learning must incur the cost of dealing with non-IID data…

Machine Learning · Computer Science 2021-05-18 Dhruv Guliani , Francoise Beaufays , Giovanni Motta

The development of noninvasive brain imaging such as resting-state functional magnetic resonance imaging (rs-fMRI) and its combination with AI algorithm provides a promising solution for the early diagnosis of Autism spectrum disorder…

Image and Video Processing · Electrical Eng. & Systems 2022-04-11 Fangyu Zhang , Yanjie Wei , Jin Liu , Yanlin Wang , Wenhui Xi , Yi Pan

Federated learning has allowed the training of statistical models over remote devices without the transfer of raw client data. In practice, training in heterogeneous and large networks introduce novel challenges in various aspects like…

Machine Learning · Computer Science 2020-11-17 Dipankar Sarkar , Sumit Rai , Ankur Narang

Federated learning (FL) is emerging as a new paradigm to train machine learning models in distributed systems. Rather than sharing, and disclosing, the training dataset with the server, the model parameters (e.g. neural networks weights and…

Signal Processing · Electrical Eng. & Systems 2020-05-27 Stefano Savazzi , Monica Nicoli , Vittorio Rampa

Band selection in hyperspectral imaging (HSI) is critical for optimising data processing and enhancing analytical accuracy. Traditional approaches have predominantly concentrated on analysing spectral and pixel characteristics within…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Judy X Yang , Jun Zhou , Jing Wang , Hui Tian , Alan Wee Chung Liew

Federated Learning (FL) enables distributed optimization without compromising data sovereignty. Yet, where local label distributions are mutually exclusive, standard weight aggregation fails due to conflicting optimization trajectories.…

Machine Learning · Computer Science 2026-03-18 Andrea Moleri , Christian Internò , Ali Raza , Markus Olhofer , David Klindt , Fabio Stella , Barbara Hammer

This work explores the application of Federated Learning (FL) to Unsupervised Semantic image Segmentation (USS). Recent USS methods extract pixel-level features using frozen visual foundation models and refine them through self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Evangelos Charalampakis , Vasileios Mygdalis , Ioannis Pitas

In the 21st-century information age, with the development of big data technology, effectively extracting valuable information from massive data has become a key issue. Traditional data mining methods are inadequate when faced with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Aoran Shen , Minghao Dai , Jiacheng Hu , Yingbin Liang , Shiru Wang , Junliang Du

This work addresses the problem of optimizing communications between server and clients in federated learning (FL). Current sampling approaches in FL are either biased, or non optimal in terms of server-clients communications and training…

Machine Learning · Computer Science 2021-05-24 Yann Fraboni , Richard Vidal , Laetitia Kameni , Marco Lorenzi

Unsupervised embedding learning aims to extract good representation from data without the need for any manual labels, which has been a critical challenge in many supervised learning tasks. This paper proposes a new unsupervised embedding…

Machine Learning · Computer Science 2020-02-28 Sungwon Han , Yizhan Xu , Sungwon Park , Meeyoung Cha , Cheng-Te Li

Federated learning (FL) has become a hot research area in enabling the collaborative training of machine learning models among multiple clients that hold sensitive local data. Nevertheless, unconstrained federated optimization has been…

Machine Learning · Computer Science 2022-08-31 Ying Cui , Yangchen Li , Chencheng Ye

Collecting large-scale medical datasets with fully annotated samples for training of deep networks is prohibitively expensive, especially for 3D volume data. Recent breakthroughs in self-supervised learning (SSL) offer the ability to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Duy M. H. Nguyen , Hoang Nguyen , Mai T. N. Truong , Tri Cao , Binh T. Nguyen , Nhat Ho , Paul Swoboda , Shadi Albarqouni , Pengtao Xie , Daniel Sonntag

The practical deployment of Federated Learning (FL) on resource-constrained devices is fundamentally limited by the high cost of training large models and the instability caused by heterogeneous (non-IID) client data. Conventional pruning…

Machine Learning · Computer Science 2026-05-13 Christian Internò , Elena Raponi , Markus Olhofer , Ali Raza , Thomas Bäck , Niki van Stein , Yaochu Jin , Barbara Hammer

Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex distributed problem, federated learning in practice still…

Machine Learning · Computer Science 2023-03-10 Xidong Wu , Feihu Huang , Zhengmian Hu , Heng Huang