English
Related papers

Related papers: DP-FlogTinyLLM: Differentially private federated l…

200 papers

Train machine learning models on sensitive user data has raised increasing privacy concerns in many areas. Federated learning is a popular approach for privacy protection that collects the local gradient information instead of real data.…

Cryptography and Security · Computer Science 2021-05-24 Lichao Sun , Jianwei Qian , Xun Chen

System logs are some of the most important information for the maintenance of software systems, which have become larger and more complex in recent years. The goal of log-based anomaly detection is to automatically detect system anomalies…

Machine Learning · Computer Science 2024-02-19 Yuuki Yamanaka , Tomokatsu Takahashi , Takuya Minami , Yoshiaki Nakajima

This paper presents LDP-Fed, a novel federated learning system with a formal privacy guarantee using local differential privacy (LDP). Existing LDP protocols are developed primarily to ensure data privacy in the collection of single…

Machine Learning · Computer Science 2020-06-09 Stacey Truex , Ling Liu , Ka-Ho Chow , Mehmet Emre Gursoy , Wenqi Wei

With the rapid development of large language models (LLMs), an increasing number of applications leverage cloud-based LLM APIs to reduce usage costs. However, since cloud-based models' parameters and gradients are agnostic, users have to…

Machine Learning · Computer Science 2026-02-23 Hui Ma , Shaoyu Dou , Ya Liu , Fei Xing , Li Feng , Feng Pi

Due to the veracity and heterogeneity in network traffic, detecting anomalous events is challenging. The computational load on global servers is a significant challenge in terms of efficiency, accuracy, and scalability. Our primary…

Machine Learning · Computer Science 2023-03-15 William Marfo , Deepak K. Tosh , Shirley V. Moore

Federated learning (FL) for large language models (LLMs) has attracted increasing attention as a privacy-preserving approach for adapting models over distributed data, where parameter-efficient methods such as Low-Rank Adaptation (LoRA) are…

Machine Learning · Computer Science 2026-01-30 Zhikang Shen , Jianrong Lu , Haiyuan Wan , Jianhai Chen

Federated learning (FL) enhances privacy by keeping user data on local devices. However, emerging attacks have demonstrated that the updates shared by users during training can reveal significant information about their data. This has…

Federated Learning (FL) offers a decentralized framework for training and fine-tuning Large Language Models (LLMs) by leveraging computational resources across organizations while keeping sensitive data on local devices. It addresses…

Cryptography and Security · Computer Science 2026-05-20 Md Jueal Mia , M. Hadi Amini

Cloud-device collaboration leverages on-cloud Large Language Models (LLMs) for handling public user queries and on-device Small Language Models (SLMs) for processing private user data, collectively forming a powerful and privacy-preserving…

Information Retrieval · Computer Science 2025-12-09 Yingyi Zhang , Pengyue Jia , Xianneng Li , Derong Xu , Maolin Wang , Yichao Wang , Zhaocheng Du , Huifeng Guo , Yong Liu , Ruiming Tang , Xiangyu Zhao

This paper proposes an anomaly detection method based on federated learning to address key challenges in multi-tenant cloud environments, including data privacy leakage, heterogeneous resource behavior, and the limitations of centralized…

Machine Learning · Computer Science 2025-08-15 Yuxi Wang , Heyao Liu , Nyutian Long , Guanzi Yao

LLMs have demonstrated great capabilities in various NLP tasks. Different entities can further improve the performance of those LLMs on their specific downstream tasks by fine-tuning LLMs. When several entities have similar interested…

Machine Learning · Computer Science 2023-09-04 Weirui Kuang , Bingchen Qian , Zitao Li , Daoyuan Chen , Dawei Gao , Xuchen Pan , Yuexiang Xie , Yaliang Li , Bolin Ding , Jingren Zhou

Federated learning (FL), a novel branch of distributed machine learning (ML), develops global models through a private procedure without direct access to local datasets. However, it is still possible to access the model updates (gradient…

Machine Learning · Computer Science 2024-06-27 Mahtab Talaei , Iman Izadi

Federated learning (FL), with the growing IoT and edge computing, is seen as a promising solution for applications that are latency- and privacy-aware. However, due to the widespread dispersion of data across many clients, it is challenging…

Machine Learning · Computer Science 2024-11-05 Dipanwita Thakur , Antonella Guzzo , Giancarlo Fortino

Sharing of telecommunication network data, for example, even at high aggregation levels, is nowadays highly restricted due to privacy legislation and regulations and other important ethical concerns. It leads to scattering data across…

Machine Learning · Computer Science 2022-05-18 Paula Raissa Silva , João Vinagre , João Gama

Large Language Models (LLMs) are increasingly integrated into real-world applications, raising concerns about privacy, security and the need to remove undesirable knowledge. Machine Unlearning has emerged as a promising solution, yet faces…

Machine Learning · Computer Science 2025-10-22 Yisheng Zhong , Zhengbang Yang , Zhuangdi Zhu

Local differential privacy (LDP) is a recently proposed privacy standard for collecting and analyzing data, which has been used, e.g., in the Chrome browser, iOS and macOS. In LDP, each user perturbs her information locally, and only sends…

Cryptography and Security · Computer Science 2019-07-02 Ning Wang , Xiaokui Xiao , Yin Yang , Jun Zhao , Siu Cheung Hui , Hyejin Shin , Junbum Shin , Ge Yu

As the IT industry advances, system log data becomes increasingly crucial. Many computer systems rely on log texts for management due to restricted access to source code. The need for log anomaly detection is growing, especially in…

Machine Learning · Computer Science 2023-11-10 Gunho No , Yukyung Lee , Hyeongwon Kang , Pilsung Kang

This paper addresses the increasingly prominent problem of anomaly detection in distributed systems. It proposes a detection method based on federated contrastive learning. The goal is to overcome the limitations of traditional centralized…

Machine Learning · Computer Science 2025-06-25 Renzi Meng , Heyi Wang , Yumeng Sun , Qiyuan Wu , Lian Lian , Renhan Zhang

Distributed databases are fundamental infrastructures of today's large-scale software systems such as cloud systems. Detecting anomalies in distributed databases is essential for maintaining software availability. Existing approaches,…

Software Engineering · Computer Science 2024-06-13 Lingzhe Zhang , Tong Jia , Mengxi Jia , Ying Li , Yong Yang , Zhonghai Wu

With the proliferation of training data, distributed machine learning (DML) is becoming more competent for large-scale learning tasks. However, privacy concerns have to be given priority in DML, since training data may contain sensitive…

Machine Learning · Computer Science 2020-08-26 Xin Wang , Hideaki Ishii , Linkang Du , Peng Cheng , Jiming Chen