English
Related papers

Related papers: DP-FlogTinyLLM: Differentially private federated l…

200 papers

Federated Learning (FL) offers a promising approach for training clinical AI models without centralizing sensitive patient data. However, its real-world adoption is hindered by challenges related to privacy, resource constraints, and…

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

With the rapid development of multi-cloud environments, it is increasingly important to ensure the security and reliability of intelligent monitoring systems. In this paper, we propose an anomaly detection and early warning mechanism for…

Machine Learning · Computer Science 2025-06-10 Yihong Jin , Ze Yang , Juntian Liu , Xinhe Xu

Differentially private (DP) decentralized Federated Learning (FL) allows local users to collaborate without sharing their data with a central server. However, accurately quantifying the privacy budget of private FL algorithms is challenging…

Machine Learning · Computer Science 2025-10-24 Xiang Li , Buxin Su , Chendi Wang , Qi Long , Weijie J. Su

Industrial Water Treatment Systems (IWTS) are safety critical cyber-physical infrastructures and due to increased connectivity, these systems are exposed to cyber threats that can manipulate process behaviour without creating obvious…

Machine Learning · Computer Science 2026-05-18 Mandar Joshi , Farzana Zahid , Judy Bowen , Matthew M. Y. Kuo , Valeriy Vyatkin , Emil Karlsson

Large language models (LLMs) do not preserve privacy at inference-time. The LLM's outputs can inadvertently reveal information about the model's context, which presents a privacy challenge when the LLM is augmented via tools or databases…

Computation and Language · Computer Science 2026-02-03 Rushil Thareja , Preslav Nakov , Praneeth Vepakomma , Nils Lukas

Differential privacy (DP) techniques can be applied to the federated learning model to statistically guarantee data privacy against inference attacks to communication among the learning agents. While ensuring strong data privacy, however,…

Machine Learning · Computer Science 2022-02-22 Minseok Ryu , Kibaek Kim

To defend the inference attacks and mitigate the sensitive information leakages in Federated Learning (FL), client-level Differentially Private FL (DPFL) is the de-facto standard for privacy protection by clipping local updates and adding…

Machine Learning · Computer Science 2023-05-03 Yifan Shi , Kang Wei , Li Shen , Yingqi Liu , Xueqian Wang , Bo Yuan , Dacheng Tao

Log-based anomaly detection is fundamentally constrained by training data sparsity. Our empirical study reveals that public benchmark datasets cover less than 10% of source code log templates. Consequently, models frequently misclassify…

Software Engineering · Computer Science 2026-04-14 Xinyu Li , Yintong Huo , Chenxi Mao , Shiwen Shan , Yuxin Su , Yanlin Wang , Zibin Zheng

Specializing large language models (LLMs) for local deployment in domain-specific use cases is necessary for strong performance while meeting latency and privacy constraints. However, conventional task-specific adaptation approaches do not…

Machine Learning · Computer Science 2024-12-20 Lanxiang Hu , Tajana Rosing , Hao Zhang

Decentralized learning (DL) is an emerging paradigm of collaborative machine learning that enables nodes in a network to train models collectively without sharing their raw data or relying on a central server. This paper introduces Zip-DL,…

Federated learning (FL) provides a privacy-preserving solution for fine-tuning pre-trained large language models (LLMs) using distributed private datasets, enabling task-specific adaptation while preserving data privacy. However,…

Machine Learning · Computer Science 2025-01-09 Na Yan , Yang Su , Yansha Deng , Robert Schober

Distributed denial-of-service (DDoS) attacks remain a critical threat to Internet services, causing costly disruptions. While machine learning (ML) has shown promise in DDoS detection, current solutions struggle with multi-domain…

Privacy-preserving adaptation of Large Language Models (LLMs) in sensitive domains (e.g., mental health) requires balancing strict confidentiality with model utility and safety. We propose FedMentor, a federated fine-tuning framework that…

Cryptography and Security · Computer Science 2026-01-27 Nobin Sarwar , Shubhashis Roy Dipta

Differential privacy (DP) techniques can be applied to the federated learning model to protect data privacy against inference attacks to communication among the learning agents. The DP techniques, however, hinder achieving a greater…

Machine Learning · Computer Science 2021-10-08 Minseok Ryu , Kibaek Kim

Most enterprise applications use logging as a mechanism to diagnose anomalies, which could help with reducing system downtime. Anomaly detection using software execution logs has been explored in several prior studies, using both classical…

Machine Learning · Computer Science 2023-11-01 Nadun Wijesinghe , Hadi Hemmati

Anomaly detection is crucial in financial auditing, and effective detection requires large volumes of data from multiple organizations. However, journal entry data is highly sensitive, making it infeasible to share them directly across…

Machine Learning · Computer Science 2025-08-05 Sota Mashiko , Yuji Kawamata , Tomoru Nakayama , Tetsuya Sakurai , Yukihiko Okada

With the increasing prevalence of scalable file systems in the context of High Performance Computing (HPC), the importance of accurate anomaly detection on runtime logs is increasing. But as it currently stands, many state-of-the-art…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-20 Chris Egersdoerfer , Dong Dai , Di Zhang

Log-based anomaly detection (LAD) is critical for ensuring the reliability of large-scale distributed systems. However, most existing LAD approaches assume centralized training, which is often impractical due to privacy constraints and the…

Software Engineering · Computer Science 2025-12-10 Yihan Liao , Jacky Keung , Zhenyu Mao , Jingyu Zhang , Jialong Li

Large language models (LLMs) are increasingly integrated into real-time machine learning applications, where safeguarding user privacy is paramount. Traditional differential privacy mechanisms often struggle to balance privacy and accuracy,…

Cryptography and Security · Computer Science 2024-10-04 Jessica Smith , David Williams , Emily Brown