中文
相关论文

相关论文: DRIVE: One-bit Distributed Mean Estimation

200 篇论文

Unsupervised learning aims to capture the underlying structure of potentially large and high-dimensional datasets. Traditionally, this involves using dimensionality reduction (DR) methods to project data onto lower-dimensional spaces or…

We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in…

机器学习 · 计算机科学 2021-12-08 Dan Alistarh , Janne H. Korhonen

In Federated Learning (FL), a number of clients or devices collaborate to train a model without sharing their data. Models are optimized locally at each client and further communicated to a central hub for aggregation. While FL is an…

机器学习 · 计算机科学 2023-07-25 Farshid Varno , Marzie Saghayi , Laya Rafiee Sevyeri , Sharut Gupta , Stan Matwin , Mohammad Havaei

We overview some results on distributed learning with focus on a family of recently proposed algorithms known as non-Bayesian social learning. We consider different approaches to the distributed learning problem and its algorithmic…

最优化与控制 · 数学 2016-09-27 Angelia Nedić , Alex Olshevsky , César A. Uribe

In massive multiple-input multiple-output (MIMO) systems, acquisition of the channel state information at the transmitter side (CSIT) is crucial. In this paper, a practical CSIT estimation scheme is proposed for frequency division duplexing…

网络与互联网体系结构 · 计算机科学 2016-10-13 Zhiyi Zhou , Xu Chen , Dongning Guo , Michael L. Honig

Deep learning has achieved tremendous success with independent and identically distributed (i.i.d.) data. However, the performance of neural networks often degenerates drastically when encountering out-of-distribution (OoD) data, i.e., when…

机器学习 · 计算机科学 2022-04-01 Nanyang Ye , Kaican Li , Haoyue Bai , Runpeng Yu , Lanqing Hong , Fengwei Zhou , Zhenguo Li , Jun Zhu

Districting-and-routing is a strategic problem aiming to aggregate basic geographical units (e.g., zip codes) into delivery districts. Its goal is to minimize the expected long-term routing cost of performing deliveries in each district…

最优化与控制 · 数学 2026-02-11 Arthur Ferraz , Cheikh Ahmed , Quentin Cappart , Thibaut Vidal

Federated Learning (FL) facilitates collaborative training of a global model whose performance is boosted by private data owned by distributed clients, without compromising data privacy. Yet the wide applicability of FL is hindered by…

分布式、并行与集群计算 · 计算机科学 2024-12-31 Xinyuan Zhao , Hanlin Gu , Lixin Fan , Yuxing Han , Qiang Yang

In decentralized federated learning (DFL), substantial traffic from frequent inter-node communication and non-independent and identically distributed (non-IID) data challenges high-accuracy model acquisition. We propose Tram-FL, a novel DFL…

机器学习 · 计算机科学 2024-10-28 Kota Maejima , Takayuki Nishio , Asato Yamazaki , Yuko Hara-Azumi

The traffic matrix estimation (TME) problem has been widely researched for decades of years. Recent progresses in deep generative models offer new opportunities to tackle TME problems in a more advanced way. In this paper, we leverage the…

机器学习 · 计算机科学 2024-10-22 Xinyu Yuan , Yan Qiao , Pei Zhao , Rongyao Hu , Benchu Zhang

Despite achieving excellent performance on benchmarks, deep neural networks often underperform in real-world deployment due to sensitivity to minor, often imperceptible shifts in input data, known as distributional shifts. These shifts are…

机器学习 · 计算机科学 2025-09-25 Birk Torpmann-Hagen , Pål Halvorsen , Michael A. Riegler , Dag Johansen

In the growing world of artificial intelligence, federated learning is a distributed learning framework enhanced to preserve the privacy of individuals' data. Federated learning lays the groundwork for collaborative research in areas where…

机器学习 · 计算机科学 2023-11-21 Elaheh Jafarigol , Theodore Trafalis , Talayeh Razzaghi , Mona Zamankhani

Robust estimation of location is a fundamental problem in statistics, particularly in scenarios where data contamination by outliers or model misspecification is a concern. In univariate settings, methods such as the sample median and…

统计理论 · 数学 2025-05-07 Alejandro Cholaquidis , Ricardo Fraiman , Leonardo Moreno , Gonzalo Perera

In distributed machine learning, data is dispatched to multiple machines for processing. Motivated by the fact that similar data points often belong to the same or similar classes, and more generally, classification rules of high accuracy…

机器学习 · 计算机科学 2016-12-16 Travis Dick , Mu Li , Venkata Krishna Pillutla , Colin White , Maria Florina Balcan , Alex Smola

Transportation and traffic are currently undergoing a rapid increase in terms of both scale and complexity. At the same time, an increasing share of traffic participants are being transformed into agents driven or supported by artificial…

机器学习 · 计算机科学 2018-10-24 Mark Schutera , Niklas Goby , Dirk Neumann , Markus Reischl

This paper introduces the notion of soft bits to address the rate-distortion optimization for learning-based image compression. Recent methods for such compression train an autoencoder end-to-end with an objective to strike a balance…

图像与视频处理 · 电气工程与系统科学 2019-05-02 David Alexandre , Chih-Peng Chang , Wen-Hsiao Peng , Hsueh-Ming Hang

We consider the problem of mean estimation assuming only finite variance. We study a new class of mean estimators constructed by integrating over random noise applied to a soft-truncated empirical mean estimator. For appropriate choices of…

统计理论 · 数学 2019-06-26 Matthew J. Holland

In frequency division duplex (FDD) massive MIMO systems, a major challenge lies in acquiring the downlink channel state information}\ (CSI) at the base station (BS) from limited feedback sent by the user equipment (UE). To tackle this…

信号处理 · 电气工程与系统科学 2025-09-11 Rajesh Shrestha , Mingjie Shao , Mingyi Hong , Wing-Kin Ma , Xiao Fu

We investigate the data distribution valuation problem, which aims to quantify the values of data distributions from their samples. This is a recently proposed problem that is related to but different from classical data valuation and can…

机器学习 · 计算机科学 2026-04-08 Cuong N. Nguyen , Cuong V. Nguyen

Although deep learning models are highly effective for various learning tasks, their high computational costs prohibit the deployment to scenarios where either memory or computational resources are limited. In this paper, we focus on…

计算机视觉与模式识别 · 计算机科学 2017-09-14 Cong Leng , Hao Li , Shenghuo Zhu , Rong Jin