English
Related papers

Related papers: Decentralized Data Reduction with Quantization Con…

200 papers

Simply restricting the computation to non-sensitive part of the data may lead to inferences on sensitive data through data dependencies. Inference control from data dependencies has been studied in the prior work. However, existing…

Databases · Computer Science 2023-12-27 Primal Pappachan , Shufan Zhang , Xi He , Sharad Mehrotra

Decentralized learning offers privacy and communication efficiency when data are naturally distributed among agents communicating over an underlying graph. Motivated by overparameterized learning settings, in which models are trained to…

Machine Learning · Computer Science 2023-03-28 Hossein Taheri , Christos Thrampoulidis

This paper attempts to give an overview about sufficiency in the setting of quantum statistics. The basic concepts are treated paralelly to the the measure theoretic case. It turns out that several classical examples and results have a…

Quantum Physics · Physics 2007-05-23 Anna Jencova , Denes Petz

We propose a separation principle that enables a systematic way of designing decentralized algorithms used in consensus optimization. Specifically, we show that a decentralized optimization algorithm can be constructed by combining a…

Optimization and Control · Mathematics 2019-03-05 Shuo Han

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

Optimization and Control · Mathematics 2025-07-21 Roberto Morales , Umberto Biccari

When the transferable set is unknowable, transfering informative knowledge as much as possible\textemdash a principle we refer to as \emph{sufficiency}, becomes crucial for enhancing transfer learning effectiveness. However, existing…

Methodology · Statistics 2025-07-22 Xiyuan Zhang , Huihang Liu , Xinyu Zhang

The Wald development of statistical decision theory addresses decision making with sample data. Wald's concept of a statistical decision function (SDF) embraces all mappings of the form [data -> decision]. An SDF need not perform…

Econometrics · Economics 2019-09-17 Charles F. Manski

We study a system composed of multiple distinct service locations that aims to convince customers to join the system by providing information to customers. We cast the system's information design problem in the framework of Bayesian…

Computer Science and Game Theory · Computer Science 2025-04-22 Niloufar Mirzavand Boroujeni , Krishnamurthy Iyer , William L. Cooper

In this research project, we investigate an alternative to the standard cloud-centralized data architecture. Specifically, we aim to leave part of the application data under the control of the individual data owners in decentralized…

Databases · Computer Science 2023-12-21 Ilaria Battiston , Peter Boncz

We examine a stochastic formulation for data-driven optimization wherein the decision-maker is not privy to the true distribution, but has knowledge that it lies in some hypothesis set and possesses a historical data set, from which…

Optimization and Control · Mathematics 2023-09-21 Gar Goei Loke , Taozeng Zhu , Ruiting Zuo

Local explanation frameworks aim to rationalize particular decisions made by a black-box prediction model. Existing techniques are often restricted to a specific type of predictor or based on input saliency, which may be undesirably…

Machine Learning · Computer Science 2019-02-12 Brandon Carter , Jonas Mueller , Siddhartha Jain , David Gifford

Optimization is finding the best solution, which mathematically amounts to locating the global minimum of some cost function. Optimization is traditionally automated with digital or quantum computers, each having their limitations and none…

Statistical Mechanics · Physics 2021-11-16 Natalia B. Janson , Christopher J. Marsden

Consider the following distributed optimization scenario. A worker has access to training data that it uses to compute the gradients while a server decides when to stop iterative computation based on its target accuracy or delay…

Machine Learning · Computer Science 2022-04-28 Chung-Yi Lin , Victoria Kostina , Babak Hassibi

For nearly any challenging scientific problem evaluation of the likelihood is problematic if not impossible. Approximate Bayesian computation (ABC) allows us to employ the whole Bayesian formalism to problems where we can use simulations…

Computation · Statistics 2011-07-04 Chris Barnes , Sarah Filippi , Michael P. H. Stumpf , Thomas Thorne

We consider the problem of regularized regression in a network of communication-constrained devices. Each node has local data and objectives, and the goal is for the nodes to optimize a global objective. We develop a distributed…

Optimization and Control · Mathematics 2016-03-22 Neil McGlohon , Stacy Patterson

We address the inference problem concerning regression coefficients in a classical linear regression model using least squares estimates. The analysis is conducted under circumstances where network dependency exists across units in the…

Methodology · Statistics 2024-04-03 Jing Lei , Kehui Chen , Haeun Moon

We consider network-based decentralized optimization problems, where each node in the network possesses a local function and the objective is to collectively attain a consensus solution that minimizes the sum of all the local functions. A…

Optimization and Control · Mathematics 2023-09-07 Suhail M. Shah , Albert S. Berahas , Raghu Bollapragada

We consider the task of training machine learning models with data-dependent constraints. Such constraints often arise as empirical versions of expected value constraints that enforce fairness or stability goals. We reformulate…

Machine Learning · Statistics 2023-01-18 Songkai Xue , Yuekai Sun , Mikhail Yurochkin

Parameters of sub-populations can be more relevant than super-population ones. For example, a healthcare provider may be interested in the effect of a treatment plan for a specific subset of their patients; policymakers may be concerned…

Methodology · Statistics 2023-03-22 Ying Jin , Dominik Rothenhäusler

Decentralized optimization of distributed stochastic differential systems has been an active area of research for over half a century. Its formulation utilizing static team and person-by-person optimality criteria is well investigated.…

Optimization and Control · Mathematics 2013-02-15 Charalambos D. Charalambous , Nasir U. Ahmed