English
Related papers

Related papers: Escape of resources in distributed clustering proc…

200 papers

Conventional theoretical machine learning studies generally assume explicitly or implicitly that there are enough or even infinitely supplied computational resources. In real practice, however, computational resources are usually limited,…

Machine Learning · Computer Science 2024-08-27 Zhi-Hua Zhou

The distributed non-smooth resource allocation problem over multi-agent networks is studied in this paper, where each agent is subject to globally coupled network resource constraints and local feasibility constraints described in terms of…

Optimization and Control · Mathematics 2022-03-11 Xiaohong Nian , Fan Li , Dongxin Liu

Efficient extraction of useful knowledge from these data is still a challenge, mainly when the data is distributed, heterogeneous and of different quality depending on its corresponding local infrastructure. To reduce the overhead cost,…

Databases · Computer Science 2017-04-17 Nhien-An Le-Khac , M-Tahar Kechadi

The resource theory of imaginarity studies the operational value of imaginary parts in quantum states, operations, and measurements. Here we introduce and study the distillation and conversion of imaginarity in distributed scenario. This…

We consider distributed iterative algorithms for the averaging problem over time-varying topologies. Our focus is on the convergence time of such algorithms when complete (unquantized) information is available, and on the degradation of…

Optimization and Control · Mathematics 2009-01-14 Angelia Nedić , Alex Olshevsky , Asuman Ozdaglar , John Tsitsiklis

Distributed computing, in which a resource-intensive task is divided into subtasks and distributed among different machines, plays a key role in solving large-scale problems. Coded computing is a recently emerging paradigm where redundancy…

Information Theory · Computer Science 2023-03-15 Hoang Dau , Ryan Gabrys , Yu-Chih Huang , Chen Feng , Quang-Hung Luu , Eidah Alzahrani , Zahir Tari

Resource allocation problems are a fundamental domain in which to evaluate the fairness properties of algorithms. The trade-offs between fairness and utilization have a long history in this domain. A recent line of work has considered…

Data Structures and Algorithms · Computer Science 2020-10-20 Kate Donahue , Jon Kleinberg

We consider the setting of distributed storage system where a single file is subdivided into smaller fragments of same size which are then replicated with a common replication factor across servers of identical cache size. An incoming file…

Information Theory · Computer Science 2022-06-27 Rooji Jinan , Ajay Badita , Pradeep Sarvepalli , Parimal Parag

Distributed optimization for resource allocation problems is investigated and a sub-optimal continuous-time algorithm is proposed. Our algorithm has lower order dynamics than others to reduce burdens of computation and communication, and is…

Optimization and Control · Mathematics 2020-02-13 Shu Liang , Xianlin Zeng , Guanpu Chen , Yiguang Hong

Part I of this work [2] developed the exact diffusion algorithm to remove the bias that is characteristic of distributed solutions for deterministic optimization problems. The algorithm was shown to be applicable to a larger set of…

Optimization and Control · Mathematics 2017-12-27 Kun Yuan , Bicheng Ying , Xiaochuan Zhao , Ali H. Sayed

In this paper two novel possibilistic clustering algorithms are presented, which utilize the concept of sparsity. The first one, called sparse possibilistic c-means, exploits sparsity and can deal well with closely located clusters that may…

Computer Vision and Pattern Recognition · Computer Science 2015-10-16 Spyridoula D. Xenaki , Konstantinos D. Koutroumbas , Athanasios A. Rontogiannis

This work studies the learning ability of consensus and diffusion distributed learners from continuous streams of data arising from different but related statistical distributions. Four distinctive features for diffusion learners are…

Optimization and Control · Mathematics 2016-07-19 Zaid J. Towfic , Jianshu Chen , Ali H. Sayed

We introduce a modified model of random walk, and then develop two novel clustering algorithms based on it. In the algorithms, each data point in a dataset is considered as a particle which can move at random in space according to the…

Machine Learning · Computer Science 2008-10-31 Qiang Li , Yan He , Jing-ping Jiang

Involution, a phenomenon of excessive competition with diminishing returns, has become a pressing socio-economic concern in contemporary China, prompting both academic inquiry and policy interventions. This paper proposes an evolutionary…

Physics and Society · Physics 2026-03-16 Bo Li , Qiwen Ge , Yong Shi

To improve the utility of learning applications and render machine learning solutions feasible for complex applications, a substantial amount of heavy computations is needed. Thus, it is essential to delegate the computations among several…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-29 Homa Esfahanizadeh , Alejandro Cohen , Muriel Medard

We present a clustering method and provide a theoretical analysis and an explanation to a phenomenon encountered in the applied statistical literature since the 1990's. This phenomenon is the natural adaptability of the order when using a…

Statistics Theory · Mathematics 2022-03-23 Thierry Dumont

We present prior robust algorithms for a large class of resource allocation problems where requests arrive one-by-one (online), drawn independently from an unknown distribution at every step. We design a single algorithm that, for every…

Data Structures and Algorithms · Computer Science 2019-03-12 Nikhil R. Devanur , Kamal Jain , Balasubramanian Sivan , Christopher A. Wilkens

Owing to data-intensive large-scale applications, distributed computation systems have gained significant recent interest, due to their ability of running such tasks over a large number of commodity nodes in a time efficient manner. One of…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-23 Mohamed A. Attia , Ravi Tandon

We study the performance of a best reply algorithm for online resource allocation problems with a diseconomy of scale. In an online resource allocation problem, we are given a set of resources and a set of requests that arrive in an online…

Data Structures and Algorithms · Computer Science 2019-07-18 Max Klimm , Daniel Schmand , Andreas Tönnis

In this paper, we study the problem of {\em $k$-center clustering with outliers}. The problem has many important applications in real world, but the presence of outliers can significantly increase the computational complexity. Though a…

Machine Learning · Computer Science 2023-01-10 Hu Ding , Ruomin Huang , Kai Liu , Haikuo Yu , Zixiu Wang