English
Related papers

Related papers: Online Learning via the Differential Privacy Lens

200 papers

We consider the problem of online classification under a privacy constraint. In this setting a learner observes sequentially a stream of labelled examples $(x_t, y_t)$, for $1 \leq t \leq T$, and returns at each iteration $t$ a hypothesis…

Machine Learning · Computer Science 2021-06-28 Noah Golowich , Roi Livni

In online learning, the data is provided in a sequential order, and the goal of the learner is to make online decisions to minimize overall regrets. This note is concerned with continuous-time models and algorithms for several online…

Machine Learning · Statistics 2024-05-20 Lexing Ying

We address nonconvex learning problems over undirected networks. In particular, we focus on the challenge of designing an algorithm that is both communication-efficient and that guarantees the privacy of the agents' data. The first goal is…

Machine Learning · Computer Science 2026-04-06 Xiaoxing Ren , Yuwen Ma , Nicola Bastianello , Karl H. Johansson , Thomas Parisini , Andreas A. Malikopoulos

We study regret minimization under privacy constraints in episodic inhomogeneous linear Markov Decision Processes (MDPs), motivated by the growing use of reinforcement learning (RL) in personalized decision-making systems that rely on…

Machine Learning · Computer Science 2025-04-29 Sharan Sahu

Decentralized Online Learning (online learning in decentralized networks) attracts more and more attention, since it is believed that Decentralized Online Learning can help the data providers cooperatively better solve their online problems…

Machine Learning · Computer Science 2019-05-30 Yawei Zhao , Chen Yu , Peilin Zhao , Hanlin Tang , Shuang Qiu , Ji Liu

In this book, I introduce the basic concepts of Online Learning through the modern view of Online Convex Optimization. Here, online learning refers to the framework of regret minimization under worst-case assumptions. I present first-order…

Machine Learning · Computer Science 2026-04-28 Francesco Orabona

We investigate the distributed online nonconvex optimization problem with differential privacy over time-varying networks. Each node minimizes the sum of several nonconvex functions while preserving the node's differential privacy. We…

Systems and Control · Electrical Eng. & Systems 2025-01-09 Yingjie Zhou , Tao Li

Differential privacy is the state-of-the-art definition for privacy, guaranteeing that any analysis performed on a sensitive dataset leaks no information about the individuals whose data are contained therein. In this thesis, we develop…

Machine Learning · Computer Science 2023-11-29 Vassilis Digalakis

Differential privacy is a strong notion for privacy that can be used to prove formal guarantees, in terms of a privacy budget, $\epsilon$, about how much information is leaked by a mechanism. However, implementations of privacy-preserving…

Machine Learning · Computer Science 2019-08-14 Bargav Jayaraman , David Evans

This paper addresses the challenge of balancing learner data privacy with the use of data in learning analytics (LA) by proposing a novel framework by applying Differential Privacy (DP). The need for more robust privacy protection keeps…

Cryptography and Security · Computer Science 2025-01-06 Qinyi Liu , Ronas Shakya , Mohammad Khalil , Jelena Jovanovic

We consider the problem of online learning where the sequence of actions played by the learner must adhere to an unknown safety constraint at every round. The goal is to minimize regret with respect to the best safe action in hindsight…

Machine Learning · Computer Science 2024-03-08 Karthik Sridharan , Seung Won Wilson Yoo

Differential Privacy (DP) is an important privacy-enhancing technology for private machine learning systems. It allows to measure and bound the risk associated with an individual participation in a computation. However, it was recently…

Machine Learning · Computer Science 2022-09-09 Cuong Tran , My H. Dinh , Ferdinando Fioretto

Motivated by the increasing deployment of reinforcement learning in the real world, involving a large consumption of personal data, we introduce a differentially private (DP) policy gradient algorithm. We show that, in this setting, the…

Machine Learning · Computer Science 2025-02-03 Alexandre Rio , Merwan Barlier , Igor Colin

In order to develop practical and efficient algorithms while circumventing overly pessimistic computational lower bounds, recent work has been interested in developing oracle-efficient algorithms in a variety of learning settings. Two such…

Machine Learning · Computer Science 2025-02-17 Adam Block , Abhishek Shetty

In this paper, we study the problem of regret minimization in reinforcement learning (RL) under differential privacy constraints. This work is motivated by the wide range of RL applications for providing personalized service, where privacy…

Machine Learning · Computer Science 2021-08-27 Sayak Ray Chowdhury , Xingyu Zhou , Ness Shroff

We present the first theoretical guarantees for differentially private online reinforcement learning (RL) with general function approximation, extending beyond prior work restricted to tabular and linear settings. Our approach combines a…

Machine Learning · Computer Science 2026-05-11 Yi He , Xingyu Zhou

This work addresses the problem of revenue maximization in a repeated, unlimited supply item-pricing auction while preserving buyer privacy. We present a novel algorithm that provides differential privacy with respect to the buyer's input…

Computer Science and Game Theory · Computer Science 2023-10-31 Joon Suk Huh

Training differentially private machine learning models requires constraining an individual's contribution to the optimization process. This is achieved by clipping the $2$-norm of their gradient at a predetermined threshold prior to…

Machine Learning · Computer Science 2024-01-09 Filippo Galli , Catuscia Palamidessi , Tommaso Cucinotta

Motivated by high-stakes decision-making domains like personalized medicine where user information is inherently sensitive, we design privacy preserving exploration policies for episodic reinforcement learning (RL). We first provide a…

Machine Learning · Computer Science 2020-09-22 Giuseppe Vietri , Borja Balle , Akshay Krishnamurthy , Zhiwei Steven Wu

Differential privacy allows bounding the influence that training data records have on a machine learning model. To use differential privacy in machine learning, data scientists must choose privacy parameters $(\epsilon,\delta)$. Choosing…

Cryptography and Security · Computer Science 2021-07-21 Daniel Bernau , Günther Eibl , Philip W. Grassal , Hannah Keller , Florian Kerschbaum