English
Related papers

Related papers: DIAL: Decentralized I/O AutoTuning via Learned Cli…

200 papers

Tuning parallel file system in High-Performance Computing (HPC) systems remains challenging due to the complex I/O paths, diverse I/O patterns, and dynamic system conditions. While existing autotuning frameworks have shown promising results…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-27 Md Hasanur Rashid , Nathan R. Tallent , Forrest Sheng Bao , Dong Dai

Parallel file systems contain complicated I/O paths from clients to storage servers. An efficient I/O path requires proper settings of multiple parameters, as the default settings often fail to deliver optimal performance, especially for…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-18 Md. Hasanur Rashid , Youbiao He , Forrest Sheng Bao , Dong Dai

Parallel application I/O performance often does not meet user expectations. Additionally, slight access pattern modifications may lead to significant changes in performance due to complex interactions between hardware and software. These…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-07-19 Julian M. Kunkel , Eugen Betke , Matt Bryson , Philip Carns , Rosemary Francis , Wolfgang Frings , Roland Laifer , Sandra Mendez

I/O performance is crucial to efficiency in data-intensive scientific computing; but tuning large-scale storage systems is complex, costly, and notoriously manpower-intensive, making it inaccessible for most domain scientists. To address…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-02-27 Chris Egersdoerfer , Philip Carns , Shane Snyder , Robert Ross , Dong Dai

Personalized federated learning is proposed to handle the data heterogeneity problem amongst clients by learning dedicated tailored local models for each user. However, existing works are often built in a centralized way, leading to high…

Machine Learning · Computer Science 2022-06-02 Rong Dai , Li Shen , Fengxiang He , Xinmei Tian , Dacheng Tao

Due to the sensitivity of data, Federated Learning (FL) is employed to enable distributed machine learning while safeguarding data privacy and accommodating the requirements of various devices. However, in the context of semi-decentralized…

Machine Learning · Computer Science 2024-12-20 Gangqiang Hu , Jianfeng Lu , Jianmin Han , Shuqin Cao , Jing Liu , Hao Fu

Personalized Federated Learning (PFL) is widely employed in IoT applications to handle high-volume, non-iid client data while ensuring data privacy. However, heterogeneous edge devices owned by clients may impose varying degrees of resource…

Machine Learning · Computer Science 2025-04-15 Ziru Niu , Hai Dong , A. K. Qin

Realistic user simulation is crucial for training and evaluating multi-turn dialogue systems, yet creating simulators that accurately replicate human behavior remains a significant challenge. An effective simulator must expose the failure…

Computation and Language · Computer Science 2026-05-07 Ziyi Zhu , Olivier Tieleman , Caitlin A. Stamatis , Luka Smyth , Thomas D. Hull , Daniel R. Cahn , Jinghong Chen , Matteo Malgaroli

Large language models (LLMs) have emerged as important components across various fields, yet their training requires substantial computation resources and abundant labeled data. It poses a challenge to robustly training LLMs for individual…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-13 Jiaxing QI , Zhongzhi Luan , Shaohan Huang , Carol Fung , Hailong Yang , Depei Qian

In-situ parallel workflows couple multiple component applications, such as simulation and analysis, via streaming data transfer. in order to avoid data exchange via shared file systems. Such workflows are challenging to configure for…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-18 Tong Shu , Yanfei Guo , Justin Wozniak , Xiaoning Ding , Ian Foster , Tahsin Kurc

Deep learning has made revolutionary advances to diverse applications in the presence of large-scale labeled datasets. However, it is prohibitively time-costly and labor-expensive to collect sufficient labeled data in most realistic…

Machine Learning · Computer Science 2021-07-22 Ximei Wang , Jinghan Gao , Mingsheng Long , Jianmin Wang

We consider a large-scale parallel-server system, where each server independently adjusts its processing speed in a decentralized manner. The objective is to minimize the overall cost, which comprises the average cost of maintaining the…

Optimization and Control · Mathematics 2023-06-06 Daan Rutten , Martin Zubeldia , Debankur Mukherjee

Personalized motion planning holds significant importance within urban automated driving, catering to the unique requirements of individual users. Nevertheless, prior endeavors have frequently encountered difficulties in simultaneously…

Robotics · Computer Science 2024-08-06 Fangze Lin , Ying He , Fei Yu

Recent advancements in Large Language Models (LLMs) have emphasized the critical role of fine-tuning (FT) techniques in adapting LLMs to specific tasks, especially when retraining from scratch is computationally infeasible. Fine-tuning…

Artificial Intelligence · Computer Science 2025-10-23 Xiao Han , Zimo Zhao , Wanyu Wang , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

Fine-tuning foundation models is critical for superior performance on personalized downstream tasks, compared to using pre-trained models. Collaborative learning can leverage local clients' datasets for fine-tuning, but limited client data…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-15 Tianjun Yuan , Jiaxiang Geng , Pengchao Han , Xianhao Chen , Bing Luo

The rise of mobile devices with abundant sensory data and local computing capabilities has driven the trend of federated learning (FL) on these devices. And personalized FL (PFL) emerges to train specific deep models for each mobile device…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-01-30 Xiaochen Li , Sicong Liu , Zimu Zhou , Bin Guo , Yuan Xu , Zhiwen Yu

Safe reinforcement learning has traditionally relied on predefined constraint functions to ensure safety in complex real-world tasks, such as autonomous driving. However, defining these functions accurately for varied tasks is a persistent…

Machine Learning · Computer Science 2025-01-31 Se-Wook Yoo , Seung-Woo Seo

We present DIO, a generic tool for observing inefficient and erroneous I/O interactions between applications and in-kernel storage systems that lead to performance, dependability, and correctness issues. DIO facilitates the analysis and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-04-19 Tânia Esteves , Ricardo Macedo , Rui Oliveira , João Paulo

The traditional framework of federated learning (FL) requires each client to re-train their models in every iteration, making it infeasible for resource-constrained mobile devices to train deep-learning (DL) models. Split learning (SL)…

Machine Learning · Computer Science 2023-03-21 Manas Wadhwa , Gagan Raj Gupta , Ashutosh Sahu , Rahul Saini , Vidhi Mittal

Autotuning of performance-relevant source-code parameters allows to automatically tune applications without hard coding optimizations and thus helps with keeping the performance portable. In this paper, we introduce a benchmark set of ten…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-02 Filip Petrovič , David Střelák , Jana Hozzová , Jaroslav Oľha , Richard Trembecký , Siegfried Benkner , Jiří Filipovič
‹ Prev 1 2 3 10 Next ›