English
Related papers

Related papers: HyFedRAG: A Federated Retrieval-Augmented Generati…

200 papers

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding responses in external knowledge during inference. However, conventiona RAG systems under-perform on structured tabular data, largely due to coarse…

Computation and Language · Computer Science 2026-05-05 Zebin Guo , Weidong Geng , Ruichen Mao

Federated Learning (FL) has emerged as an effective learning paradigm for distributed computation owing to its strong potential in capturing underlying data statistics while preserving data privacy. However, in cases of practical data…

Machine Learning · Computer Science 2023-05-22 Achintha Wijesinghe , Songyang Zhang , Zhi Ding

Graph-based Retrieval-Augmented Generation (Graph-RAG) enhances large language models (LLMs) by structuring retrieval over an external corpus. However, existing approaches typically assume a static corpus, requiring expensive full-graph…

Information Retrieval · Computer Science 2025-07-08 Fangyuan Zhang , Zhengjun Huang , Yingli Zhou , Qintian Guo , Zhixun Li , Wensheng Luo , Di Jiang , Yixiang Fang , Xiaofang Zhou

Extracting real-time insights from multi-modal data streams from various domains such as healthcare, intelligent transportation, and satellite remote sensing remains a challenge. High computational demands and limited knowledge scope…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Murugan Sankaradas , Ravi K. Rajendran , Srimat T. Chakradhar

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

Electroencephalography (EEG) classification techniques have been widely studied for human behavior and emotion recognition tasks. But it is still a challenging issue since the data may vary from subject to subject, may change over time for…

Signal Processing · Electrical Eng. & Systems 2020-09-14 Dashan Gao , Ce Ju , Xiguang Wei , Yang Liu , Tianjian Chen , Qiang Yang

Federated Learning (FL) is a machine learning paradigm that safeguards privacy by retaining client data on edge devices. However, optimizing FL in practice can be challenging due to the diverse and heterogeneous nature of the learning…

Machine Learning · Computer Science 2024-06-11 Yongxin Guo , Xiaoying Tang , Tao Lin

Retrieval-Augmented Generation (RAG) enhances the factual grounding of Large Language Models by conditioning their outputs on external documents. However, standard embedding-based retrievers treat naturally structured corpora, such as…

Information Retrieval · Computer Science 2026-05-11 Giorgia Bolognesi , Claudio Estatico , Ulderico Fugacci , Isabella Mastroianni , Claudio Muselli , Luca Oneto

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user queries. These systems, however, remain…

Computation and Language · Computer Science 2025-05-26 Huichi Zhou , Kin-Hei Lee , Zhonghao Zhan , Yue Chen , Zhenhao Li , Zhaoyang Wang , Hamed Haddadi , Emine Yilmaz

Retrieval-augmented generation (RAG) has proven effective in integrating knowledge into large language models (LLMs). However, conventional RAGs struggle to capture complex relationships between pieces of knowledge, limiting their…

Information Retrieval · Computer Science 2025-12-12 Linhao Luo , Zicheng Zhao , Gholamreza Haffari , Dinh Phung , Chen Gong , Shirui Pan

Retrieval-Augmented Generation enhances language models by retrieving external knowledge to support informed and grounded responses. However, traditional RAG methods rely on fragment-level retrieval, limiting their ability to address…

Information Retrieval · Computer Science 2026-05-05 Wenbiao Tao , Xinyuan Li , Yunshi Lan , Weining Qian

Federated Learning (FL) has emerged as a promising approach for preserving data privacy in recommendation systems by training models locally. Recently, Graph Neural Networks (GNN) have gained popularity in recommendation tasks due to their…

Cryptography and Security · Computer Science 2024-01-24 Dezhong Yao , Tongtong Liu , Qi Cao , Hai Jin

With the wealth of information produced by social networks, smartphones, medical or financial applications, speculations have been raised about the sensitivity of such data in terms of users' personal privacy and data security. To address…

Machine Learning · Computer Science 2019-08-21 Vito Walter Anelli , Yashar Deldjoo , Tommaso Di Noia , Antonio Ferrara

Retrieval-Augmented Generation (RAG) significantly mitigates the hallucinations and domain knowledge deficiency in large language models by incorporating external knowledge bases. However, the multi-module architecture of RAG introduces…

Cryptography and Security · Computer Science 2026-03-24 Yanming Mu , Hao Hu , Feiyang Li , Qiao Yuan , Jiang Wu , Zichuan Liu , Pengcheng Liu , Mei Wang , Hongwei Zhou , Yuling Liu

In today's world, the rapid expansion of IoT networks and the proliferation of smart devices in our daily lives, have resulted in the generation of substantial amounts of heterogeneous data. These data forms a stream which requires special…

Machine Learning · Computer Science 2023-12-27 Sofia Zahri , Hajar Bennouri , Ahmed M. Abdelmoniem

Fine-tuning large language models (LLMs) via federated learning, i.e., FedLLM, has been proposed to adapt LLMs for various downstream applications in a privacy-preserving way. To reduce the fine-tuning costs on resource-constrained devices,…

Machine Learning · Computer Science 2025-03-28 Jun Liu , Yunming Liao , Hongli Xu , Yang Xu

In the Industrial Internet of Things (IoT), a large amount of data will be generated every day. Due to privacy and security issues, it is difficult to collect all these data together to train deep learning models, thus the federated…

Machine Learning · Computer Science 2024-03-25 Jianjun Huang , Lixin Ye , Li Kang

Preserving privacy and reducing communication costs for edge users pose significant challenges in recommendation systems. Although federated learning has proven effective in protecting privacy by avoiding data exchange between clients and…

Machine Learning · Computer Science 2023-11-01 Lin Wang , Zhichao Wang , Xi Leng , Xiaoying Tang

Data heterogeneity among Federated Learning (FL) users poses a significant challenge, resulting in reduced global model performance. The community has designed various techniques to tackle this issue, among which Knowledge Distillation…

Machine Learning · Computer Science 2024-10-08 Momin Ahmad Khan , Yasra Chandio , Fatima Muhammad Anwar

Nowadays, the industrial Internet of Things (IIoT) has played an integral role in Industry 4.0 and produced massive amounts of data for industrial intelligence. These data locate on decentralized devices in modern factories. To protect the…

Machine Learning · Computer Science 2022-02-04 Zonghang Li , Yihong He , Hongfang Yu , Jiawen Kang , Xiaoping Li , Zenglin Xu , Dusit Niyato