English
Related papers

Related papers: Fast networked data selection via distributed smoo…

200 papers

We propose a simple and efficient clustering method for high-dimensional data with a large number of clusters. Our algorithm achieves high-performance by evaluating distances of datapoints with a subset of the cluster centres. Our…

Machine Learning · Computer Science 2022-03-30 Georgios Exarchakis , Omar Oubari , Gregor Lenz

We present new algorithms for optimizing non-smooth, non-convex stochastic objectives based on a novel analysis technique. This improves the current best-known complexity for finding a $(\delta,\epsilon)$-stationary point from…

Machine Learning · Computer Science 2025-08-08 Ashok Cutkosky , Harsh Mehta , Francesco Orabona

We consider a class of popular distributed non-convex optimization problems, in which agents connected by a network $\mathcal{G}$ collectively optimize a sum of smooth (possibly non-convex) local objective functions. We address the…

Optimization and Control · Mathematics 2020-01-08 Haoran Sun , Mingyi Hong

The best known solutions for $k$-message broadcast in dynamic networks of size $n$ require $\Omega(nk)$ rounds. In this paper, we see if these bounds can be improved by smoothed analysis. We study perhaps the most natural randomized…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-15 Michael Dinitz , Jeremy Fineman , Seth Gilbert , Calvin Newport

Selectivity estimation aims at estimating the number of database objects that satisfy a selection criterion. Answering this problem accurately and efficiently is essential to many applications, such as density estimation, outlier detection,…

Databases · Computer Science 2021-05-28 Yaoshu Wang , Chuan Xiao , Jianbin Qin , Rui Mao , Onizuka Makoto , Wei Wang , Rui Zhang , Yoshiharu Ishikawa

Large annotated datasets are crucial for the success of deep neural networks, but labeling data can be prohibitively expensive in domains such as medical imaging. This work tackles the subset selection problem: selecting a small set of the…

Machine Learning · Computer Science 2025-09-29 Noga Bar , Raja Giryes

We study distributed non-convex optimization on a time-varying multi-agent network. Each node has access to its own smooth local cost function, and the collective goal is to minimize the sum of these functions. We generalize the results…

Optimization and Control · Mathematics 2016-12-06 Tatiana Tatarenko , Behrouz Touri

Distributed learning has become a critical enabler of the massively connected world envisioned by many. This article discusses four key elements of scalable distributed processing and real-time intelligence --- problems, data, communication…

Machine Learning · Computer Science 2020-06-24 Tsung-Hui Chang , Mingyi Hong , Hoi-To Wai , Xinwei Zhang , Songtao Lu

The non-smooth finite-sum minimization is a fundamental problem in machine learning. This paper develops a distributed stochastic proximal-gradient algorithm with random reshuffling to solve the finite-sum minimization over time-varying…

Optimization and Control · Mathematics 2022-10-11 Xia Jiang , Xianlin Zeng , Jian Sun , Jie Chen , Lihua Xie

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

The recently developed Distributed Block Proximal Method, for solving stochastic big-data convex optimization problems, is studied in this paper under the assumption of constant stepsizes and strongly convex (possibly non-smooth) local…

Optimization and Control · Mathematics 2020-03-06 Francesco Farina , Giuseppe Notarstefano

We study the problem of sampling from a target distribution in $\mathbb{R}^d$ whose potential is not smooth. Compared with the sampling problem with smooth potentials, this problem is much less well-understood due to the lack of smoothness.…

Computation · Statistics 2023-07-25 Jiaojiao Fan , Bo Yuan , Jiaming Liang , Yongxin Chen

In this paper, we study the problem of distributed multi-agent optimization over a network, where each agent possesses a local cost function that is smooth and strongly convex. The global objective is to find a common solution that…

Optimization and Control · Mathematics 2019-08-02 Shi Pu , Angelia Nedić

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

We study distributed composite optimization over networks: agents minimize the sum of a smooth (strongly) convex function, the agents' sum-utility, plus a non-smooth (extended-valued) convex one. We propose a general algorithmic framework…

Optimization and Control · Mathematics 2019-10-23 Jinming Xu , Ying Sun , Ye Tian , Gesualdo Scutari

Top-k threshold estimation is the problem of estimating the score of the k-th highest ranking result of a search query. A good estimate can be used to speed up many common top-k query processing algorithms, and thus a number of researchers…

Information Retrieval · Computer Science 2024-12-17 Jinrui Gou , Yifan Liu , Minghao Shao , Torsten Suel

We investigate crowdsourcing algorithms for finding the top-quality item within a large collection of objects with unknown intrinsic quality values. This is an important problem with many relevant applications, for example in networked…

Human-Computer Interaction · Computer Science 2017-10-03 Alessandro Nordio , Alberto Tarable , Emilio Leonardi , Marco Ajmone Marsan

The problem of selecting small groups of itemsets that represent the data well has recently gained a lot of attention. We approach the problem by searching for the itemsets that compress the data efficiently. As a compression technique we…

Data Structures and Algorithms · Computer Science 2019-02-08 Nikolaj Tatti , Jilles Vreeken

In real world, our datasets often contain outliers. Moreover, the outliers can seriously affect the final machine learning result. Most existing algorithms for handling outliers take high time complexities (e.g. quadratic or cubic…

Computational Geometry · Computer Science 2020-02-28 Hu Ding , Zixiu Wang

In this paper, we consider the problem of identifying a linear map from measurements which are subject to intermittent and arbitarily large errors. This is a fundamental problem in many estimation-related applications such as fault…

Systems and Control · Computer Science 2016-08-09 Laurent Bako , Henrik Ohlsson