English
Related papers

Related papers: HEAT: A Highly Efficient and Affordable Training S…

200 papers

Collaborative filtering (CF) is widely used to learn informative latent representations of users and items from observed interactions. Existing CF-based methods commonly adopt negative sampling to discriminate different items. Training with…

Information Retrieval · Computer Science 2023-05-02 Xin Zhou , Aixin Sun , Yong Liu , Jie Zhang , Chunyan Miao

Graph Neural Networks deliver strong classification results but often suffer from poor calibration performance, leading to overconfidence or underconfidence. This is particularly problematic in high stakes applications where accurate…

Machine Learning · Computer Science 2025-03-03 Dingyi Zhuang , Chonghe Jiang , Yunhan Zheng , Shenhao Wang , Jinhua Zhao

In the recent years, heterogeneous machine learning accelerators have become of significant interest in science, engineering and industry. The major processing speed bottlenecks in these platforms come from (a) an electronic data…

Optics · Physics 2022-08-25 Maria Solyanik-Gorgone , Behrouz Movahhed , Volker J Sorger

Diffusion models achieve state-of-the-art video generation quality, but their inference remains expensive due to the large number of sequential denoising steps. This has motivated a growing line of research on accelerating diffusion…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Yasaman Haghighi , Alexandre Alahi

Federated Learning (FL) has achieved significant achievements recently, enabling collaborative model training on distributed data over edge devices. Iterative gradient or model exchanges between devices and the centralized server in the…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-19 Ji Liu , Tianshi Che , Yang Zhou , Ruoming Jin , Huaiyu Dai , Dejing Dou , Patrick Valduriez

The ability to scale out training workloads has been one of the key performance enablers of deep learning. The main scaling approach is data-parallel GPU-based training, which has been boosted by hardware and software support for highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-02 Ilia Markov , Hamidreza Ramezanikebrya , Dan Alistarh

Collaborative filtering (CF) is a long-standing problem of recommender systems. Many novel methods have been proposed, ranging from classical matrix factorization to recent graph convolutional network-based approaches. After recent fierce…

Information Retrieval · Computer Science 2021-08-19 Jeongwhan Choi , Jinsung Jeon , Noseong Park

AI-powered edge devices currently lack the ability to adapt their embedded inference models to the ever-changing environment. To tackle this issue, Continual Learning (CL) strategies aim at incrementally improving the decision capabilities…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-28 Leonardo Ravaglia , Manuele Rusci , Alessandro Capotondi , Francesco Conti , Lorenzo Pellegrini , Vincenzo Lomonaco , Davide Maltoni , Luca Benini

In this work, we explore combining automatic hyperparameter tuning and optimization for federated learning (FL) in an online, one-shot procedure. We apply a principled approach on a method for adaptive client learning rate, number of local…

Machine Learning · Computer Science 2022-11-07 Andrew K Kan

Hierarchical federated learning (HFL) has demonstrated promising scalability advantages over the traditional "star-topology" architecture-based federated learning (FL). However, HFL still imposes significant computation, communication, and…

Machine Learning · Computer Science 2025-01-28 Wenzhi Fang , Dong-Jun Han , Christopher G. Brinton

In this work, we present a federated version of the state-of-the-art Neural Collaborative Filtering (NCF) approach for item recommendations. The system, named FedNCF, enables learning without requiring users to disclose or transmit their…

Information Retrieval · Computer Science 2022-02-17 Vasileios Perifanis , Pavlos S. Efraimidis

The proliferation of cloud data center applications and network function virtualization (NFV) boosts dynamic and QoS dependent traffic into the data centers network. Currently, lots of network routing protocols are requirement agnostic,…

This paper presents an energy-efficient transmission framework for federated learning (FL) in industrial Internet of Things (IIoT) environments with strict latency and energy constraints. Machinery subnetworks (SNs) collaboratively train a…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Hamid Reza Hashempour , Mostafa Nozari , Gilberto Berardinelli , Yanjiao Li , Jie Zhang , Hien Quoc Ngo , Shashi Raj Pandey

Traditional Collaborative Filtering (CF) based methods are applied to understand the personal preferences of users/customers for items or products from the rating matrix. Usually, the rating matrix is sparse in nature. So there are some…

Information Retrieval · Computer Science 2022-10-12 Supriyo Mandal , Abyayananda Maiti

Diffusion Transformers (DiTs) excel in generative tasks but face practical deployment challenges due to high inference costs. Feature caching, which stores and retrieves redundant computations, offers the potential for acceleration.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yushi Huang , Zining Wang , Ruihao Gong , Jing Liu , Xinjie Zhang , Jinyang Guo , Xianglong Liu , Jun Zhang

Statistical data heterogeneity is a significant barrier to convergence in federated learning (FL). While prior work has advanced heterogeneous FL through better optimization objectives, these methods fall short when there is extreme data…

Machine Learning · Computer Science 2025-04-17 Nurbek Tastan , Samuel Horvath , Martin Takac , Karthik Nandakumar

The rapid growth of AI-enabled Internet of Vehicles (IoV) calls for efficient Machine Learning (ML) solutions that can handle high vehicular mobility and decentralized data. This has motivated the emergence of Hierarchical Federated…

Machine Learning · Computer Science 2026-05-28 Xiaohong Yang , Minghui Liwang , Xianbin Wang , Zhipeng Cheng , Seyyedali Hosseinalipour , Huaiyu Dai , Zhenzhen Jiao

As deep learning models nowadays are widely adopted by both cloud services and edge devices, reducing the latency of deep learning model inferences becomes crucial to provide efficient model serving. However, it is challenging to develop…

Machine Learning · Computer Science 2023-02-16 Yaoyao Ding , Cody Hao Yu , Bojian Zheng , Yizhi Liu , Yida Wang , Gennady Pekhimenko

Recommendation systems get expanding significance because of their applications in both the scholarly community and industry. With the development of additional data sources and methods of extracting new information other than the rating…

Information Retrieval · Computer Science 2020-05-19 Mohammad Maghsoudi Mehrabani , Hamid Mohayeji , Ali Moeini

Federated Learning (FL) trains deep models across edge devices without centralizing raw data, preserving user privacy. However, client heterogeneity slows down convergence and limits global model accuracy. Clustered FL (CFL) mitigates this…

Machine Learning · Computer Science 2026-02-10 Minghao Li , Dmitrii Avdiukhin , Rana Shahout , Nikita Ivkin , Vladimir Braverman , Minlan Yu