English
Related papers

Related papers: Private Learning Implies Online Learning: An Effic…

200 papers

In this paper, we address two practical challenges of distributed learning in multi-agent network systems, namely personalization and resilience. Personalization is the need of heterogeneous agents to learn local models tailored to their…

Multiagent Systems · Computer Science 2026-01-01 Luca Ballotta , Nicola Bastianello , Riccardo M. G. Ferrari , Karl H. Johansson

Online learning algorithms have impressive convergence properties when it comes to risk minimization and convex games on very large problems. However, they are inherently sequential in their design which prevents them from taking advantage…

Optimization and Control · Mathematics 2009-11-04 John Langford , Alexander Smola , Martin Zinkevich

Many reinforcement learning applications involve the use of data that is sensitive, such as medical records of patients or financial information. However, most current reinforcement learning methods can leak information contained within the…

Machine Learning · Computer Science 2019-02-04 Tengyang Xie , Philip S. Thomas , Gerome Miklau

Deep learning with differential privacy (DP) has garnered significant attention over the past years, leading to the development of numerous methods aimed at enhancing model accuracy and training efficiency. This paper delves into the…

Machine Learning · Computer Science 2024-08-27 Youlong Ding , Xueyang Wu , Yining Meng , Yonggang Luo , Hao Wang , Weike Pan

Online learning holds the promise of enabling efficient long-term credit assignment in recurrent neural networks. However, current algorithms fall short of offline backpropagation by either not being scalable or failing to learn long-range…

Machine Learning · Computer Science 2023-11-08 Nicolas Zucchet , Robert Meier , Simon Schug , Asier Mujika , João Sacramento

We introduce a locally differentially private (LDP) algorithm for online federated learning that employs temporally correlated noise to improve utility while preserving privacy. To address challenges posed by the correlated noise and local…

Machine Learning · Computer Science 2025-03-13 Jiaojiao Zhang , Linglingzhi Zhu , Dominik Fay , Mikael Johansson

Federated learning becomes a prominent approach when different entities want to learn collaboratively a common model without sharing their training data. However, Federated learning has two main drawbacks. First, it is quite bandwidth…

Cryptography and Security · Computer Science 2021-03-02 Raouf Kerkouche , Gergely Ács , Claude Castelluccia , Pierre Genevès

The need for robust, secure and private machine learning is an important goal for realizing the full potential of the Internet of Things (IoT). Federated learning has proven to help protect against privacy violations and information…

Machine Learning · Computer Science 2021-01-12 Olakunle Ibitoye , M. Omair Shafiq , Ashraf Matrawy

The performance cost of differential privacy has, for some applications, been shown to be higher for minority groups; fairness, conversely, has been shown to disproportionally compromise the privacy of members of such groups. Most work in…

Cryptography and Security · Computer Science 2022-03-08 Victor Petrén Bach Hansen , Atula Tejaswi Neerkaje , Ramit Sawhney , Lucie Flek , Anders Søgaard

Offline reinforcement learning, which aims at optimizing sequential decision-making strategies with historical data, has been extensively applied in real-life applications. State-Of-The-Art algorithms usually leverage powerful function…

Machine Learning · Computer Science 2022-11-28 Ming Yin , Mengdi Wang , Yu-Xiang Wang

Differential privacy is one of the methods to solve the problem of privacy protection in federated learning. Setting the same privacy budget for each round will result in reduced accuracy in training. The existing methods of the adjustment…

Cryptography and Security · Computer Science 2024-08-20 Zhiqiang Wang , Xinyue Yu , Qianli Huang , Yongguang Gong

The increasing adoption of data-driven applications in education such as in learning analytics and AI in education has raised significant privacy and data protection concerns. While these challenges have been widely discussed in previous…

Machine Learning · Computer Science 2025-03-19 Mohammad Khalil , Ronas Shakya , Qinyi Liu

Human learning relies on specialization -- distinct cognitive mechanisms working together to enable rapid learning. In contrast, most modern neural networks rely on a single mechanism: gradient descent over an objective function. This…

Machine Learning · Computer Science 2025-05-16 Daniel Weitekamp , Christopher MacLellan , Erik Harpstead , Kenneth Koedinger

Differentially private training algorithms provide protection against one of the most popular attacks in machine learning: the membership inference attack. However, these privacy algorithms incur a loss of the model's classification…

Cryptography and Security · Computer Science 2021-10-13 Jiaxiang Liu , Simon Oya , Florian Kerschbaum

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

Machine teaching often involves the creation of an optimal (typically minimal) dataset to help a model (referred to as the `student') achieve specific goals given by a teacher. While abundant in the continuous domain, the studies on the…

Machine Learning · Computer Science 2024-02-01 Xiaodong Wu , Yufei Han , Hayssam Dahrouj , Jianbing Ni , Zhenwen Liang , Xiangliang Zhang

Machine Learning algorithms are technological key enablers for artificial intelligence (AI). Due to the inherent complexity, these learning algorithms represent black boxes and are difficult to comprehend, therefore influencing compliance…

Computers and Society · Computer Science 2020-02-21 NIklas Kuhl , Jodie Lobana , Christian Meske

This paper considers an online reinforcement learning algorithm that leverages pre-collected data (passive memory) from the environment for online interaction. We show that using passive memory improves performance and further provide…

Machine Learning · Computer Science 2024-10-21 Anay Pattanaik , Lav R. Varshney

We consider the extensive-form bandit problem, where on each trial the learner (a user coordinated by a server) plays an extensive-form game against an oblivious adversary, observing the information sets it finds itself in as well as the…

Cryptography and Security · Computer Science 2026-05-08 Stephen Pasteris , Rahul Savani , Theodore Turocy

The deployment of deep learning applications has to address the growing privacy concerns when using private and sensitive data for training. A conventional deep learning model is prone to privacy attacks that can recover the sensitive…

Cryptography and Security · Computer Science 2020-04-10 Di Gao , Cheng Zhuo