English
Related papers

Related papers: Expand Heterogeneous Learning Systems with Selecti…

200 papers

Consider the problem of improving the estimation of conditional average treatment effects (CATE) for a target domain of interest by leveraging related information from a source domain with a different feature space. This heterogeneous…

Machine Learning · Computer Science 2022-10-13 Ioana Bica , Mihaela van der Schaar

Federated Learning (FL) is a decentralized machine-learning paradigm, in which a global server iteratively averages the model parameters of local users without accessing their data. User heterogeneity has imposed significant challenges to…

Machine Learning · Computer Science 2021-06-11 Zhuangdi Zhu , Junyuan Hong , Jiayu Zhou

Since the advent of knowledge distillation, much research has focused on how the soft labels generated by the teacher model can be utilized effectively. Existing studies points out that the implicit knowledge within soft labels originates…

Machine Learning · Computer Science 2025-09-29 Hua Yuan , Ning Xu , Xin Geng , Yong Rui

Data heterogeneity presents significant challenges for federated learning (FL). Recently, dataset distillation techniques have been introduced, and performed at the client level, to attempt to mitigate some of these challenges. In this…

Machine Learning · Computer Science 2023-12-05 Yuqi Jia , Saeed Vahidian , Jingwei Sun , Jianyi Zhang , Vyacheslav Kungurtsev , Neil Zhenqiang Gong , Yiran Chen

Online Knowledge Distillation (KD) is recently highlighted to train large models in Federated Learning (FL) environments. Many existing studies adopt the logit ensemble method to perform KD on the server side. However, they often assume…

Machine Learning · Computer Science 2026-01-09 Jihyun Lim , Junhyuk Jo , Tuo Zhang , Sunwoo Lee

Federated Learning (FL) plays a critical role in distributed systems. In these systems, data privacy and confidentiality hold paramount importance, particularly within edge-based data processing systems such as IoT devices deployed in smart…

Machine Learning · Computer Science 2024-03-08 Humaid Ahmed Desai , Amr Hilal , Hoda Eldardiry

Recent advances in personalized federated learning have focused on addressing client model heterogeneity. However, most existing methods still require external data, rely on model decoupling, or adopt partial learning strategies, which can…

Machine Learning · Computer Science 2025-07-31 Chen Zhang , Husheng Li , Xiang Liu , Linshan Jiang , Danxin Wang

Collective learning can be greatly enhanced when agents effectively exchange knowledge with their peers. In particular, recent work studying agents that learn to teach other teammates has demonstrated that action advising accelerates…

Meta-learning has been extensively applied in the domains of few-shot learning and fast adaptation, achieving remarkable performance. While Meta-learning methods like Model-Agnostic Meta-Learning (MAML) and its variants provide a good set…

Machine Learning · Computer Science 2024-08-09 Runxi Cheng , Yongxian Wei , Xianglong He , Wanyun Zhu , Songsong Huang , Fei Richard Yu , Fei Ma , Chun Yuan

As technology scaling is approaching the physical limit, lithography hotspot detection has become an essential task in design for manufacturability. While the deployment of pattern matching or machine learning in hotspot detection can help…

Machine Learning · Computer Science 2021-08-02 Xuezhong Lin , Jingyu Pan , Jinming Xu , Yiran Chen , Cheng Zhuo

BERT is a cutting-edge language representation model pre-trained by a large corpus, which achieves superior performances on various natural language understanding tasks. However, a major blocking issue of applying BERT to online services is…

Computation and Language · Computer Science 2020-10-22 Yihuan Mao , Yujing Wang , Chufan Wu , Chen Zhang , Yang Wang , Yaming Yang , Quanlu Zhang , Yunhai Tong , Jing Bai

Diffusion models have emerged as a dominant approach for text-to-image generation. Key components such as the human preference alignment and classifier-free guidance play a crucial role in ensuring generation quality. However, their…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Minghao Fu , Guo-Hua Wang , Liangfu Cao , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang

Federated learning (FL) is able to manage edge devices to cooperatively train a model while maintaining the training data local and private. One common assumption in FL is that all edge devices share the same machine learning model in…

Machine Learning · Computer Science 2022-07-07 Chan Yun Hin , Ngai Edith

Federated Learning (FL) enables collaborative model training across diverse entities while safeguarding data privacy. However, FL faces challenges such as data heterogeneity and model diversity. The Meta-Federated Learning (Meta-FL)…

Machine Learning · Computer Science 2024-06-25 Zahir Alsulaimawi

Various health-care applications such as assisted living, fall detection, etc., require modeling of user behavior through Human Activity Recognition (HAR). Such applications demand characterization of insights from multiple…

Machine Learning · Computer Science 2020-12-07 Gautham Krishna Gudur , Satheesh K. Perepu

Leveraging external knowledge is crucial for achieving high performance in knowledge-intensive tasks, such as question answering. The retrieve-and-read approach is widely adopted for integrating external knowledge into a language model.…

Computation and Language · Computer Science 2024-06-10 Dongkyu Lee , Chandana Satya Prakash , Jack FitzGerald , Jens Lehmann

Deep learning is a key approach for the environment perception function of Cooperative Intelligent Transportation Systems (C-ITS) with autonomous vehicles and smart traffic infrastructure. In today's C-ITS, smart traffic participants are…

Machine Learning · Computer Science 2022-07-29 Rui Song , Liguo Zhou , Venkatnarayanan Lakshminarasimhan , Andreas Festag , Alois Knoll

An increasing number of well-trained deep networks have been released online by researchers and developers, enabling the community to reuse them in a plug-and-play way without accessing the training annotations. However, due to the large…

Machine Learning · Computer Science 2019-06-26 Sihui Luo , Xinchao Wang , Gongfan Fang , Yao Hu , Dapeng Tao , Mingli Song

Efficient online learning requires seamless access to diverse resources such as videos, code repositories, documentation, and general web content. This poster paper introduces early-stage work on a Multi-Agent Retrieval-Augmented Generation…

Artificial Intelligence · Computer Science 2025-02-07 Devansh Srivastav , Hasan Md Tusfiqur Alam , Afsaneh Asaei , Mahmoud Fazeli , Tanisha Sharma , Daniel Sonntag

Whereas cognitive models of learning often assume direct experience with both the features of an event and with a true label or outcome, much of everyday learning arises from hearing the opinions of others, without direct access to either…

Artificial Intelligence · Computer Science 2025-12-05 Yun-Shiuan Chuang , Jerry Zhu , Timothy T. Rogers