English
Related papers

Related papers: Aggregated f-average Neural Network applied to Few…

200 papers

Federated learning (FL) is a new paradigm for distributed machine learning that allows a global model to be trained across multiple clients without compromising their privacy. Although FL has demonstrated remarkable success in various…

Machine Learning · Computer Science 2023-06-06 Haolin Wang , Xuefeng Liu , Jianwei Niu , Shaojie Tang , Jiaxing Shen

Few-shot learning is an important research field of machine learning in which a classifier must be trained in such a way that it can adapt to new classes which are not included in the training set. However, only small amounts of examples of…

Machine Learning · Computer Science 2020-06-11 Andrei Boiarov , Oleg Granichin , Olga Granichina

Recently, there has been a growing interest in developing machine learning (ML) models that can promote fairness, i.e., eliminating biased predictions towards certain populations (e.g., individuals from a specific demographic group). Most…

Machine Learning · Computer Science 2023-08-29 Song Wang , Jing Ma , Lu Cheng , Jundong Li

Given a {features, target} dataset, we introduce an incremental algorithm that constructs an aggregate regressor, using an ensemble of neural networks. It is well known that ensemble methods suffer from the multicollinearity issue, which is…

Machine Learning · Computer Science 2021-05-03 Pola Lydia Lagari , Lefteri H. Tsoukalas , Salar Safarkhani , Isaac E. Lagaris

Student performance prediction is a critical research problem to understand the students' needs, present proper learning opportunities/resources, and develop the teaching quality. However, traditional machine learning methods fail to…

Machine Learning · Computer Science 2021-12-23 Yinkai Wang , Aowei Ding , Kaiyi Guan , Shixi Wu , Yuanqi Du

Few-shot learning problem focuses on recognizing unseen classes given a few labeled images. In recent effort, more attention is paid to fine-grained feature embedding, ignoring the relationship among different distance metrics. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Jinxiang Lai , Siqian Yang , Guannan Jiang , Xi Wang , Yuxi Li , Zihui Jia , Xiaochen Chen , Jun Liu , Bin-Bin Gao , Wei Zhang , Yuan Xie , Chengjie Wang

To accelerate learning process with few samples, meta-learning resorts to prior knowledge from previous tasks. However, the inconsistent task distribution and heterogeneity is hard to be handled through a global sharing model…

Machine Learning · Computer Science 2022-06-22 Geng Li , Boyuan Ren , Hongzhi Wang

Ensembles, where multiple neural networks are trained individually and their predictions are averaged, have been shown to be widely successful for improving both the accuracy and predictive uncertainty of single neural networks. However, an…

Machine Learning · Computer Science 2020-02-21 Yeming Wen , Dustin Tran , Jimmy Ba

Federated learning allows us to run machine learning algorithms on decentralized data when data sharing is not permitted due to privacy concerns. Ensemble-based learning works by training multiple (weak) classifiers whose output is…

Machine Learning · Computer Science 2024-02-20 Florian van Daalen , Lianne Ippel , Andre Dekker , Inigo Bermejo

In modern statistics, interests shift from pursuing the uniformly minimum variance unbiased estimator to reducing mean squared error (MSE) or residual squared error. Shrinkage based estimation and regression methods offer better prediction…

Methodology · Statistics 2025-02-25 Tianyu Zhan , Haoda Fu , Jian Kang

We address the problem of federated learning (FL) where users are distributed and partitioned into clusters. This setup captures settings where different groups of users have their own objectives (learning tasks) but by aggregating their…

Machine Learning · Statistics 2021-06-10 Avishek Ghosh , Jichan Chung , Dong Yin , Kannan Ramchandran

Deep neural networks have been able to outperform humans in some cases like image recognition and image classification. However, with the emergence of various novel categories, the ability to continuously widen the learning capability of…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Nihar Bendre , Hugo Terashima Marín , Peyman Najafirad

Federated learning learns from scattered data by fusing collaborative models from local nodes. However, the conventional coordinate-based model averaging by FedAvg ignored the random information encoded per parameter and may suffer from…

Machine Learning · Computer Science 2021-11-30 Fuxun Yu , Weishan Zhang , Zhuwei Qin , Zirui Xu , Di Wang , Chenchen Liu , Zhi Tian , Xiang Chen

Federated learning (FL) enables decentralized model training without centralizing raw data. However, practical FL deployments often face a key realistic challenge: Clients participate intermittently in server aggregation and with unknown,…

Machine Learning · Computer Science 2025-07-15 Herlock , Rahimi , Dionysis Kalogerias

Federated Learning (FL) is a distributed learning paradigm that scales on-device learning collaboratively and privately. Standard FL algorithms such as FedAvg are primarily geared towards smooth unconstrained settings. In this paper, we…

Machine Learning · Computer Science 2021-06-08 Honglin Yuan , Manzil Zaheer , Sashank Reddi

Federated Learning (FL) is a decentralized machine learning framework that enables collaborative model training while respecting data privacy. In various applications, non-uniform availability or participation of users is unavoidable due to…

Machine Learning · Computer Science 2023-09-26 Periklis Theodoropoulos , Konstantinos E. Nikolakakis , Dionysis Kalogerias

Few-shot Intent Detection is challenging due to the scarcity of available annotated utterances. Although recent works demonstrate that multi-level matching plays an important role in transferring learned knowledge from seen training classes…

Computation and Language · Computer Science 2020-10-13 Hoang Nguyen , Chenwei Zhang , Congying Xia , Philip S. Yu

Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in…

Machine Learning · Computer Science 2023-11-16 Irene Tenison , Sai Aravind Sreeramadas , Vaikkunth Mugunthan , Edouard Oyallon , Irina Rish , Eugene Belilovsky

Training multiple deep neural networks (DNNs) and averaging their outputs is a simple way to improve the predictive performance. Nevertheless, the multiplied training cost prevents this ensemble method to be practical and efficient. Several…

Machine Learning · Computer Science 2021-10-27 Feng Wang , Guoyizhe Wei , Qiao Liu , Jinxiang Ou , Xian Wei , Hairong Lv

In collaborative filtering (CF) algorithms, the optimal models are usually learned by globally minimizing the empirical risks averaged over all the observed data. However, the global models are often obtained via a performance tradeoff…

Machine Learning · Computer Science 2021-04-16 Dongsheng Li , Haodong Liu , Chao Chen , Yingying Zhao , Stephen M. Chu , Bo Yang