English
Related papers

Related papers: Deletion-Robust Submodular Maximization at Scale

200 papers

We study the problem of maximizing a monotone set function subject to a cardinality constraint $k$ in the setting where some number of elements $\tau$ is deleted from the returned set. The focus of this work is on the worst-case adversarial…

Machine Learning · Statistics 2020-05-05 Ilija Bogunovic , Junyao Zhao , Volkan Cevher

We address differential privacy for fully distributed optimization subject to a shared inequality constraint. By co-designing the distributed optimization mechanism and the differential-privacy noise injection mechanism, we propose the…

Optimization and Control · Mathematics 2024-04-04 Yongqiang Wang , Angelia Nedic

This paper considers the problem of privacy-preservation in decentralized optimization, in which $N$ agents cooperatively minimize a global objective function that is the sum of $N$ local objective functions. We assume that each local…

Optimization and Control · Mathematics 2018-09-19 Chunlei Zhang , Huan Gao , Yongqiang Wang

Decentralized optimization has become a standard paradigm for solving large-scale decision-making problems and training large machine learning models without centralizing data. However, this paradigm introduces new privacy and security…

Machine Learning · Computer Science 2024-08-19 Changxin Liu , Nicola Bastianello , Wei Huo , Yang Shi , Karl H. Johansson

Large models and enormous data are essential driving forces of the unprecedented successes achieved by modern algorithms, especially in scientific computing and machine learning. Nevertheless, the growing dimensionality and model…

Machine Learning · Computer Science 2023-10-04 Yijun Dong

Submodular functions and their optimization have found applications in diverse settings ranging from machine learning and data mining to game theory and economics. In this work, we consider the constrained maximization of a submodular…

Data Structures and Algorithms · Computer Science 2025-07-15 Moran Feldman , Alan Kuhnle

Which ads should we display in sponsored search in order to maximize our revenue? How should we dynamically rank information sources to maximize value of information? These applications exhibit strong diminishing returns: Selection of…

Machine Learning · Computer Science 2009-08-07 Daniel Golovin , Andreas Krause , Matthew Streeter

We propose the first adversarially robust algorithm for monotone submodular maximization under single and multiple knapsack constraints with scalable implementations in distributed and streaming settings. For a single knapsack constraint,…

Data Structures and Algorithms · Computer Science 2019-05-08 Dmitrii Avdiukhin , Slobodan Mitrović , Grigory Yaroslavtsev , Samson Zhou

Privacy-preserving distributed processing has recently attracted considerable attention. It aims to design solutions for conducting signal processing tasks over networks in a decentralized fashion without violating privacy. Many algorithms…

Cryptography and Security · Computer Science 2020-09-03 Qiongxiu Li , Jaron Skovsted Gundersen , Richard Heusdens , Mads Græsbøll Christensen

Running machine learning algorithms on large and rapidly growing volumes of data is often computationally expensive, one common trick to reduce the size of a data set, and thus reduce the computational cost of machine learning algorithms,…

Machine Learning · Computer Science 2022-01-25 Shaojie Tang , Jing Yuan

We study the problem of deleting user data from machine learning models trained using empirical risk minimization. Our focus is on learning algorithms which return the empirical risk minimizer and approximate unlearning algorithms that…

Machine Learning · Statistics 2022-09-27 Vinith M. Suriyakumar , Ashia C. Wilson

We study the problem of maximizing a monotone submodular function subject to a cardinality constraint $k$, with the added twist that a number of items $\tau$ from the returned set may be removed. We focus on the worst-case setting…

Machine Learning · Statistics 2017-06-16 Ilija Bogunovic , Slobodan Mitrović , Jonathan Scarlett , Volkan Cevher

Privacy protection and nonconvexity are two challenging problems in decentralized optimization and learning involving sensitive data. Despite some recent advances addressing each of the two problems separately, no results have been reported…

Optimization and Control · Mathematics 2022-12-16 Yongqiang Wang , Tamer Basar

We study the maximum capture problem in facility location under random utility models, i.e., the problem of seeking to locate new facilities in a competitive market such that the captured user demand is maximized, assuming that each…

Optimization and Control · Mathematics 2022-03-29 Tien Thanh Dam , Thuy Anh Ta , Tien Mai

This article provides a comprehensive exploration of submodular maximization problems, focusing on those subject to uniform and partition matroids. Crucial for a wide array of applications in fields ranging from computer science to systems…

Data Structures and Algorithms · Computer Science 2025-01-03 Solmaz S. Kia

Maximizing monotone submodular functions under a matroid constraint is a classic algorithmic problem with multiple applications in data mining and machine learning. We study this classic problem in the fully dynamic setting, where elements…

Data Structures and Algorithms · Computer Science 2025-05-26 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

We consider the problem of model selection in a high-dimensional sparse linear regression model under privacy constraints. We propose a differentially private (DP) best subset selection method with strong statistical utility properties by…

Machine Learning · Statistics 2024-10-30 Saptarshi Roy , Zehua Wang , Ambuj Tewari

Applications in machine learning, optimization, and control require the sequential selection of a few system elements, such as sensors, data, or actuators, to optimize the system performance across multiple time steps. However, in…

Machine Learning · Statistics 2020-12-17 Vasileios Tzoumas , Ali Jadbabaie , George J. Pappas

Distributed optimization is manifesting great potential in multiple fields, e.g., machine learning, control, and resource allocation. Existing decentralized optimization algorithms require sharing explicit state information among the…

Systems and Control · Electrical Eng. & Systems 2024-05-28 Huqiang Cheng , Xiaofeng Liao , Huaqing Li , You Zhao

Dense subgraph extraction is a fundamental problem in graph analysis and data mining, aimed at identifying cohesive and densely connected substructures within a given graph. It plays a crucial role in various domains, including social…

Data Structures and Algorithms · Computer Science 2024-03-01 Chia-Yang Hung , Chih-Ya Shen