English
Related papers

Related papers: Federated Heavy Hitter Recovery under Linear Sketc…

200 papers

Decentralized federated learning (DFL) is a promising machine learning paradigm for bringing artificial intelligence (AI) capabilities to the network edge. Running DFL on top of edge networks, however, faces severe performance challenges…

Networking and Internet Architecture · Computer Science 2025-04-22 Tingyang Sun , Tuan Nguyen , Ting He

Identifying heavy hitters and estimating the frequencies of flows are fundamental tasks in various network domains. Existing approaches to this challenge can broadly be categorized into two groups, hashing-based and competing-counter-based.…

Data Structures and Algorithms · Computer Science 2024-06-25 Rana Shahout , Michael Mitzenmacher

The longstanding goals of federated learning (FL) require rigorous privacy guarantees and low communication overhead while holding a relatively high model accuracy. However, simultaneously achieving all the goals is extremely challenging.…

Machine Learning · Computer Science 2021-06-02 He Yang

Inspired by the recent work FedNL (Safaryan et al, FedNL: Making Newton-Type Methods Applicable to Federated Learning), we propose a new communication efficient second-order framework for Federated learning, namely FLECS. The proposed…

Optimization and Control · Mathematics 2022-06-07 Artem Agafonov , Dmitry Kamzolov , Rachael Tappenden , Alexander Gasnikov , Martin Takáč

We study the maximum $k$-set coverage problem in the following distributed setting. A collection of sets $S_1,\ldots,S_m$ over a universe $[n]$ is partitioned across $p$ machines and the goal is to find $k$ sets whose union covers the most…

Data Structures and Algorithms · Computer Science 2018-08-24 Sepehr Assadi , Sanjeev Khanna

We initiate a systematic study of linear sketching over $\mathbb F_2$. For a given Boolean function $f \colon \{0,1\}^n \to \{0,1\}$ a randomized $\mathbb F_2$-sketch is a distribution $\mathcal M$ over $d \times n$ matrices with elements…

Data Structures and Algorithms · Computer Science 2016-11-14 Sampath Kannan , Elchanan Mossel , Grigory Yaroslavtsev

Hybrid Language Models (HLMs) combine the low-latency efficiency of Small Language Models (SLMs) on edge devices with the high accuracy of Large Language Models (LLMs) on centralized servers. Unlike traditional end-to-end LLM inference,…

Machine Learning · Computer Science 2025-07-02 Faranaksadat Solat , Joohyung Lee , Mohamed Seif , Dusit Niyato , H. Vincent Poor

Offline reinforcement learning (RL), which seeks to learn an optimal policy using offline data, has garnered significant interest due to its potential in critical applications where online data collection is infeasible or expensive. This…

Machine Learning · Computer Science 2024-02-09 Jiin Woo , Laixi Shi , Gauri Joshi , Yuejie Chi

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

Federated Learning (FL) is one of the hot research topics, and it utilizes Machine Learning (ML) in a distributed manner without directly accessing private data on clients. However, FL faces many challenges, including the difficulty to…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-02 Shadha Tabatabai , Ihab Mohammed , Basheer Qolomany , Abdullatif Albasser , Kashif Ahmad , Mohamed Abdallah , Ala Al-Fuqaha

In the future high-luminosity LHC era, high-energy physics experiments face unprecedented computational challenges for event reconstruction. Employing the LHCb vertex locator as a case study we investigate a novel approach for charged…

This paper presents a study on asynchronous Federated Learning (FL) in a mobile network setting. The majority of FL algorithms assume that communication between clients and the server is always available, however, this is not the case in…

Machine Learning · Computer Science 2024-03-19 Jieming Bian , Jie Xu

Set cover and hitting set are fundamental problems in combinatorial optimization which are well-studied in the offline, online, and dynamic settings. We study the geometric versions of these problems and present new online and dynamic…

Computational Geometry · Computer Science 2023-03-17 Arindam Khan , Aditya Lonkar , Saladi Rahul , Aditya Subramanian , Andreas Wiese

We propose a novel approach to charged particle tracking at high intensity particle colliders based on Approximate Nearest Neighbors search. With hundreds of thousands of measurements per collision to be reconstructed e.g. at the High…

High Energy Physics - Experiment · Physics 2021-01-19 Sabrina Amrouche , Moritz Kiehn , Tobias Golling , Andreas Salzburger

We consider the closest lattice point problem in a distributed network setting and study the communication cost and the error probability for computing an approximate nearest lattice point, using the nearest-plane algorithm, due to Babai.…

Information Theory · Computer Science 2017-04-27 M. F. Bollauf , V. A. Vaishampayan , S. I. R. Costa

Federated Learning (FL) is a promising paradigm that offers significant advancements in privacy-preserving, decentralized machine learning by enabling collaborative training of models across distributed devices without centralizing data.…

Machine Learning · Computer Science 2024-06-03 Khiem Le , Nhan Luong-Ha , Manh Nguyen-Duc , Danh Le-Phuoc , Cuong Do , Kok-Seng Wong

We present new distributed quantum algorithms for fundamental distributed computing problems, namely, leader election, broadcast, Minimum Spanning Tree (MST), and Breadth-First Search (BFS) tree, in arbitrary networks. These algorithms are…

Quantum Physics · Physics 2026-03-03 Fabien Dufoulon , Frédéric Magniez , Gopal Pandurangan

Establishing precise traceability between embedded systems datasheets and their corresponding code implementations remains a fundamental challenge in systems engineering, particularly for low-level software where manual mapping between…

Software Engineering · Computer Science 2026-01-21 Vedant Nipane , Pulkit Agrawal , Amit Singh

This paper discusses the fixed-hub single allocation problem (FHSAP). In this problem, a network consists of hub nodes and terminal nodes. Hubs are fixed and fully connected; each terminal node is connected to a single hub which routes all…

Data Structures and Algorithms · Computer Science 2014-02-19 Dongdong Ge , Zizhuo Wang , Lai Wei , Jiawei Zhang

Iterative Hessian sketch (IHS) is an effective sketching method for modeling large-scale data. It was originally proposed by Pilanci and Wainwright (2016; JMLR) based on randomized sketching matrices. However, it is computationally…

Machine Learning · Statistics 2020-03-10 Aijun Zhang , Hengtao Zhang , Guosheng Yin