English
Related papers

Related papers: Robust Coreset Construction for Distributed Machin…

200 papers

We study core-set construction algorithms for the task of Diversity Maximization under fairness/partition constraint. Given a set of points $P$ in a metric space partitioned into $m$ groups, and given $k_1,\ldots,k_m$, the goal of this…

Data Structures and Algorithms · Computer Science 2023-10-13 Sepideh Mahabadi , Stojan Trajanovski

To improve the efficiency and sustainability of learning deep models, we propose CREST, the first scalable framework with rigorous theoretical guarantees to identify the most valuable examples for training non-convex models, particularly…

Machine Learning · Computer Science 2023-06-05 Yu Yang , Hao Kang , Baharan Mirzasoleiman

Federated learning is the centralized training of statistical models from decentralized data on mobile devices while preserving the privacy of each device. We present a robust aggregation approach to make federated learning robust to…

Machine Learning · Statistics 2023-08-04 Krishna Pillutla , Sham M. Kakade , Zaid Harchaoui

We study the problem of constructing $(1+\varepsilon)$-coresets for Euclidean $(k,z)$-clustering in the distributed setting, where $n$ data points are partitioned across $s$ sites. We focus on two prominent communication models: the…

Data Structures and Algorithms · Computer Science 2026-03-10 Vincent Cohen-Addad , Liudeng Wang , David P. Woodruff , Samson Zhou

Inspired by biological swarms, robotic swarms are envisioned to solve real-world problems that are difficult for individual agents. Biological swarms can achieve collective intelligence based on local interactions and simple rules; however,…

Robotics · Computer Science 2017-09-21 Qiyang Li , Xintong Du , Yizhou Huang , Quinlan Sykora , Angela P. Schoellig

Federated Learning (FL) is used to learn machine learning models with data that is partitioned across multiple clients, including resource-constrained edge devices. It is therefore important to devise solutions that are efficient in terms…

Machine Learning · Computer Science 2024-01-17 Durga Sivasubramanian , Lokesh Nagalapatti , Rishabh Iyer , Ganesh Ramakrishnan

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

Image and Video Processing · Electrical Eng. & Systems 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel

In a recent work, [19] studied the following "fair" variants of classical clustering problems such as $k$-means and $k$-median: given a set of $n$ data points in $\mathbb{R}^d$ and a binary type associated to each data point, the goal is to…

Data Structures and Algorithms · Computer Science 2019-12-18 Lingxiao Huang , Shaofeng H. -C. Jiang , Nisheeth K. Vishnoi

Given a metric space, the $(k,z)$-clustering problem consists of finding $k$ centers such that the sum of the of distances raised to the power $z$ of every point to its closest center is minimized. This encapsulates the famous $k$-median…

Data Structures and Algorithms · Computer Science 2022-08-01 Vincent Cohen-Addad , David Saulpic , Chris Schwiegelshohn

In projective clustering we are given a set of n points in $R^d$ and wish to cluster them to a set $S$ of $k$ linear subspaces in $R^d$ according to some given distance function. An $\eps$-coreset for this problem is a weighted (scaled)…

Data Structures and Algorithms · Computer Science 2020-11-30 Adiel Statman , Liat Rozenberg , Dan Feldman

Federated Learning is a framework that jointly trains a model \textit{with} complete knowledge on a remotely placed centralized server, but \textit{without} the requirement of accessing the data stored in distributed machines. Some work…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Jia Qian , Lars Kai Hansen , Xenofon Fafoutis , Prayag Tiwari , Hari Mohan Pandey

The study of provable adversarial robustness has mostly been limited to classification tasks and models with one-dimensional real-valued outputs. We extend the scope of certifiable robustness to problems with more general and structured…

Machine Learning · Computer Science 2022-01-13 Aounon Kumar , Tom Goldstein

Center-based clustering techniques are fundamental in some areas of machine learning such as data summarization. Generic $k$-center algorithms can produce biased cluster representatives so there has been a recent interest in fair $k$-center…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-21 Jinxiang Gan , Mordecai Golin , Zonghan Yang , Yuhao Zhang

Modern Deep Learning (DL) models have grown to sizes requiring massive clusters of specialized, high-end nodes to train. Designing such clusters to maximize both performance and utilization--to amortize their steep cost--is a challenging…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-03-15 Divya Kiran Kadiyala , Saeed Rashidi , Taekyung Heo , Abhimanyu Rajeshkumar Bambhaniya , Tushar Krishna , Alexandros Daglis

Latency to end-users and regulatory requirements push large companies to build data centers all around the world. The resulting data is "born" geographically distributed. On the other hand, many machine learning applications require a…

Machine Learning · Computer Science 2016-03-31 Ignacio Cano , Markus Weimer , Dhruv Mahajan , Carlo Curino , Giovanni Matteo Fumarola

In this paper, we study the problem of {\em $k$-center clustering with outliers}. The problem has many important applications in real world, but the presence of outliers can significantly increase the computational complexity. Though a…

Machine Learning · Computer Science 2023-01-10 Hu Ding , Ruomin Huang , Kai Liu , Haikuo Yu , Zixiu Wang

We study algorithms for construction of composable coresets for the task of Determinant Maximization under partition constraint. Given a point set $V\subset \mathbb{R}^d$ that is partitioned into $s$ groups $V_1,\cdots, V_s$, and integers…

Data Structures and Algorithms · Computer Science 2025-10-08 Sepideh Mahabadi , Thuy-Duong Vuong

Supervised Learning is a way of developing Artificial Intelligence systems in which a computer algorithm is trained on labeled data inputs. Effectiveness of a Supervised Learning algorithm is determined by its performance on a given dataset…

Computers and Society · Computer Science 2024-10-29 Shubhi Bansal , Atharva Tendulkar , Nagendra Kumar

Motivated by practical generalizations of the classic $k$-median and $k$-means objectives, such as clustering with size constraints, fair clustering, and Wasserstein barycenter, we introduce a meta-theorem for designing coresets for…

Data Structures and Algorithms · Computer Science 2022-09-20 Vladimir Braverman , Vincent Cohen-Addad , Shaofeng H. -C. Jiang , Robert Krauthgamer , Chris Schwiegelshohn , Mads Bech Toftrup , Xuan Wu

In a distributed machine learning setting like Federated Learning where there are multiple clients involved which update their individual weights to a single central server, often training on the entire individual client's dataset for each…

Machine Learning · Computer Science 2025-11-04 Prateek Chanda , Shrey Modi , Ganesh Ramakrishnan