English
Related papers

Related papers: FlexDM: Enabling robust and reliable parallel data…

200 papers

Summary: Modern omics experiments now involve multiple conditions and complex designs, producing an increasingly large set of differential expression and functional enrichment analysis results. However, no standardized data structure exists…

Genomics · Quantitative Biology 2026-03-10 Najla Abassi , Lea Schwarz , Edoardo Filippi , Federico Marini

With ever-increasing computational capabilities, robust and automated research workflows have become essential for orchestrating large numbers of interdependent simulations. However, significant technical expertise is still required to…

Many scientific problems require multiple distinct computational tasks to be executed in order to achieve a desired solution. We introduce the Ensemble Toolkit (EnTK) to address the challenges of scale, diversity and reliability they pose.…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-05-17 Vivek Balasubramanian , Matteo Turilli , Weiming Hu , Matthieu Lefebvre , Wenjie Lei , Guido Cervone , Jeroen Tromp , Shantenu Jha

In recent years, the research community has raised serious questions about the reproducibility of scientific work. In particular, since many studies include some kind of computing work, reproducibility is also a technological challenge, not…

Software Engineering · Computer Science 2023-08-03 Lázaro Costa , Susana Barbosa , Jácome Cunha

This paper delivers a software -- libEMM -- for 3D controlled-source electromagnetics (CSEM) modelling in fictitious wave domain, based on the newly developed high-order finite-difference time-domain (FDTD) method on non-uniform grid. The…

Geophysics · Physics 2023-05-03 Pengliang Yang

As deep learning models become increasingly large, they pose significant challenges in heterogeneous devices environments. The size of deep learning models makes it difficult to deploy them on low-power or resource-constrained devices,…

Machine Learning · Computer Science 2023-11-27 Mert Unsal , Ali Maatouk , Antonio De Domenico , Nicola Piovesan , Fadhel Ayed

Molecular relational learning (MRL) is crucial for understanding the interaction behaviors between molecular pairs, a critical aspect of drug discovery and development. However, the large feasible model space of MRL poses significant…

Machine Learning · Computer Science 2024-10-22 Sizhe Liu , Jun Xia , Lecheng Zhang , Yuchen Liu , Yue Liu , Wenjie Du , Zhangyang Gao , Bozhen Hu , Cheng Tan , Hongxin Xiang , Stan Z. Li

Machine Learning for Source Code (ML4Code) is an active research field in which extensive experimentation is needed to discover how to best use source code's richly structured information. With this in mind, we introduce JEMMA, an…

Software Engineering · Computer Science 2022-12-20 Anjan Karmakar , Miltiadis Allamanis , Romain Robbes

Deploying large language models (LLMs) in mobile and edge computing environments is constrained by limited on-device resources, scarce wireless bandwidth, and frequent model evolution. Although edge-cloud collaborative inference with…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-05 Yuchen Li , Rui Kong , Zhonghao Lyu , Qiyang Li , Xinran Chen , Hengyi Cai , Lingyong Yan , Shuaiqiang Wang , Jiashu Zhao , Guangxu Zhu , Linghe Kong , Guihai Chen , Haoyi Xiong , Dawei Yin

The recent developments and research in distributed ledger technologies and blockchain have contributed to the increasing adoption of distributed systems. To collect relevant insights into systems' behavior, we observe many evaluation…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-27 Filip Rezabek , Kilian Glas , Richard von Seck , Achraf Aroua , Tizian Leonhardt , Georg Carle

Pipeline parallelism is an essential distributed parallelism method. Increasingly complex and diverse DNN models necessitate meticulously customized pipeline schedules for performance. However, existing practices typically rely on…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-10 Lijuan Jiang , Xingjian Qian , Zhenxiang Ma , Zan Zong , Hengjie Li , Chao Yang , Jidong Zhai

Innovations in Next-Generation Sequencing are enabling generation of DNA sequence data at ever faster rates and at very low cost. Large sequencing centers typically employ hundreds of such systems. Such high-throughput and low-cost…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-31 Vasimuddin Md , Sanchit Misra , Heng Li , Srinivas Aluru

Large Language Models (LLMs) excel in natural language processing tasks but pose significant computational and memory challenges for edge deployment due to their intensive resource demands. This work addresses the efficiency of LLM…

Hardware Architecture · Computer Science 2025-07-02 Zhican Wang , Hongxiang Fan , Haroon Waris , Gang Wang , Zhenyu Li , Jianfei Jiang , Yanan Sun , Guanghui He

We introduce FlexOlmo, a new class of language models (LMs) that supports (1) distributed training without data sharing, where different model parameters are independently trained on closed datasets, and (2) data-flexible inference, where…

The Expectation Maximization (EM) algorithm is the default algorithm for inference in latent variable models. As in any other field of machine learning, applications of latent variable models to very large datasets make the use of advanced…

Optimization and Control · Mathematics 2021-11-11 Aymeric Dieuleveut , Gersende Fort , Eric Moulines , Geneviève Robin

WebAssembly (Wasm) has become a key compilation target for portable and efficient execution across diverse platforms. Benchmarking its performance, however, is a multi-dimensional challenge: it depends not only on the choice of runtime…

Performance · Computer Science 2026-02-06 Riccardo Carissimi , Ben L. Titzer

Many scientific applications are I/O intensive and generate or access large data sets, spanning hundreds or thousands of "files." Management, storage, efficient access, and analysis of this data present an extremely challenging task. We…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Jaechun No , Rajeev Thakur , Dinesh Kaushik , Lori Freitag , Alok Choudhary

Software engineering activities frequently involve edits to existing code. However, contemporary code language models (LMs) lack the ability to handle diverse types of code-edit requirements. In this work, we attempt to overcome this…

Software Engineering · Computer Science 2025-05-13 Tushar Aggarwal , Swayam Singh , Abhijeet Awasthi , Aditya Kanade , Nagarajan Natarajan

Scalable and efficient numerical simulations continue to gain importance, as computation is firmly established as the third pillar of discovery, alongside theory and experiment. Meanwhile, the performance of computing hardware grows through…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-06-26 Pietro Incardona , Antonio Leo , Yaroslav Zaluzhnyi , Rajesh Ramaswamy , Ivo F. Sbalzarini

This paper presents ExPECA, an edge computing and wireless communication research testbed designed to tackle two pressing challenges: comprehensive end-to-end experimentation and high levels of experimental reproducibility. Leveraging…

Networking and Internet Architecture · Computer Science 2023-11-03 Samie Mostafavi , Vishnu Narayanan Moothedath , Stefan Rönngren , Neelabhro Roy , Gourav Prateek Sharma , Sangwon Seo , Manuel Olguín Muñoz , James Gross