English
Related papers

Related papers: DIAL: Decentralized I/O AutoTuning via Learned Cli…

200 papers

In some of the complicated control problems we have to use the controllers that apply nonlocal operators to the error signal to generate the control. Currently, the most famous controller with nonlocal operators is the fractional-order PID…

Optimization and Control · Mathematics 2014-05-02 Farshad Merrikh-Bayat , Seyedeh-Nafiseh Mirebrahimi , Mohammad-Reza Khalili

Machine learning applications often require hyperparameter tuning. The hyperparameters usually drive both the efficiency of the model training process and the resulting model quality. For hyperparameter tuning, machine learning algorithms…

Machine Learning · Computer Science 2018-08-06 Patrick Koch , Oleg Golovidov , Steven Gardner , Brett Wujek , Joshua Griffin , Yan Xu

Large-scale decentralized systems of autonomous agents interacting via asynchronous communication often experience the following self-healing dilemma: fault detection inherits network uncertainties making a remote faulty process…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-06-25 Jovan Nikolic , Nursultan Jubatyrov , Evangelos Pournaras

Federated learning (FL) is a privacy preserving machine learning paradigm designed to collaboratively learn a global model without data leakage. Specifically, in a typical FL system, the central server solely functions as an coordinator to…

Machine Learning · Computer Science 2024-12-17 Hangyu Zhu , Yuxiang Fan , Zhenping Xie

The Federated Learning (FL) paradigm is known to face challenges under heterogeneous client data. Local training on non-iid distributed data results in deflected local optimum, which causes the client models drift further away from each…

Machine Learning · Computer Science 2022-11-22 Renjie Pi , Weizhong Zhang , Yueqi Xie , Jiahui Gao , Xiaoyu Wang , Sunghun Kim , Qifeng Chen

Profiling techniques are used extensively at different parts of the computing stack to achieve many goals. One major goal is to make a piece of software execute more efficiently on a specific hardware platform, where efficiency spans…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-11-07 Chris Quackenbush , Mohamed Zahran

There is a lot of interest today in building autonomous (or, self-driving) data processing systems. An emerging school of thought is to leverage AI-driven "black box" algorithms for this purpose. In this paper, we present a contrarian view.…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-02-28 Mayuresh Kunjir , Shivnath Babu

Federated learning (FL) is an appealing paradigm that allows a group of machines (a.k.a. clients) to learn collectively while keeping their data local. However, due to the heterogeneity between the clients' data distributions, the model…

Machine Learning · Computer Science 2024-10-01 Youssef Allouah , Abdellah El Mrini , Rachid Guerraoui , Nirupam Gupta , Rafael Pinot

Distributed Asynchronous Object Store (DAOS) is a novel software-defined object store leveraging Non-Volatile Memory (NVM) devices, designed for high performance. It provides a number of interfaces for applications to undertake I/O, ranging…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-30 Nicolau Manubens , Johann Lombardi , Simon D. Smart , Emanuele Danovaro , Tiago Quintino , Dean Hildebrand , Adrian Jackson

Federated Learning (FL) is designed as a decentralized, privacy-preserving machine learning paradigm that enables multiple clients to collaboratively train a model without sharing their data. In real-world scenarios, however, clients often…

Machine Learning · Computer Science 2025-10-17 Maulidi Adi Prasetia , Muhamad Risqi U. Saputra , Guntur Dharma Putra

In this study, we introduce a methodology for automatically transforming user applications in the radar and communication domain written in C/C++ based on dynamic profiling to a parallel representation targeted for a heterogeneous SoC. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-29 Liangliang Chang , Joshua Mack , Benjamin Willis , Xing Chen , John Brunhaver , Ali Akoglu , Chaitali Chakrabarti

Instruction tuning is a crucial step in improving the responsiveness of pretrained large language models (LLMs) to human instructions. Federated learning (FL) helps to exploit the use of vast private instruction data from clients, becoming…

Machine Learning · Computer Science 2025-06-30 Zhen Qin , Zhaomin Wu , Bingsheng He , Shuiguang Deng

Modern cloud databases present scaling as a binary decision: scale-out by adding nodes or scale-up by increasing per-node resources. This one-dimensional view is limiting because database performance, cost, and coordination overhead emerge…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-05-05 Shahir Abdullah , Syed Rohit Zaman

In the realm of real-world devices, centralized servers in Federated Learning (FL) present challenges including communication bottlenecks and susceptibility to a single point of failure. Additionally, contemporary devices inherently exhibit…

Machine Learning · Computer Science 2024-08-15 Yasser H. Khalil , Amir H. Estiri , Mahdi Beitollahi , Nader Asadi , Sobhan Hemati , Xu Li , Guojun Zhang , Xi Chen

The full potential of large pretrained models remains largely untapped in control domains like robotics. This is mainly because of the scarcity of data and the computational challenges associated with training or fine-tuning these large…

Machine Learning · Computer Science 2024-03-11 Zuxin Liu , Jesse Zhang , Kavosh Asadi , Yao Liu , Ding Zhao , Shoham Sabach , Rasool Fakoor

Federated Learning (FL) is a distributed framework for collaborative model training over large-scale distributed data, enabling higher performance while maintaining client data privacy. However, the nature of model aggregation at the…

Machine Learning · Computer Science 2025-06-10 Ali Murad , Bo Hui , Wei-Shinn Ku

Personalisation is a standard feature of conversational AI systems used by millions; yet, the efficacy of personalisation methods is often evaluated in academic research using simulated users rather than real people. This raises questions…

Computation and Language · Computer Science 2026-05-14 Hannah Rose Kirk , Liu Leqi , Fanzhi Zeng , Henry Davidson , Bertie Vidgen , Christopher Summerfield , Scott A. Hale

In the realm of edge computing, the increasing demand for high Quality of Service (QoS), particularly in dynamic multimedia streaming applications (e.g., Augmented Reality/Virtual Reality and online gaming), has prompted the need for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-12-29 Cheng Zhang , Yinuo Deng , Hailiang Zhao , Tianlv Chen , Shuiguang Deng

Federated Learning (FL) is a decentralized learning approach that protects sensitive information by utilizing local model parameters rather than sharing clients' raw datasets. While this privacy-preserving method is widely employed across…

Machine Learning · Computer Science 2024-11-20 Yasaman Saadati , M. Hadi Amini

The use of under-utilized Internet resources is widely recognized as a viable form of high performance computing. Sustained processing power of roughly 40T FLOPS using 4 million volunteered Internet hosts has been reported for…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Scott Douglas , Aaron Harwood