English
Related papers

Related papers: Portable, heterogeneous ensemble workflows at scal…

200 papers

Ensemble learning has proven effective in boosting predictive performance, but traditional methods such as bagging, boosting, and dynamic ensemble selection (DES) suffer from high computational cost and limited adaptability to heterogeneous…

Massive upgrades to science infrastructure are driving data velocities upwards while stimulating adoption of increasingly data-intensive analytics. While next-generation exascale supercomputers promise strong support for I/O-intensive…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-06 Michael Salim , Thomas Uram , J. Taylor Childers , Venkat Vishwanath , Michael E. Papka

Modern RL-based post-training for large language models (LLMs) co-locate trajectory sampling and policy optimisation on the same GPU cluster, forcing the system to switch between inference and training workloads. This serial context…

Machine Learning · Computer Science 2025-08-13 Jie Xiao , Changyuan Fan , Qingnan Ren , Alfred Long , Yuchen Zhang , Rymon Yu , Eric Yang , Lynn Ai , Shaoduo Gan

Machine learning (ML) algorithms are showing a growing trend in helping the scientific communities across different disciplines and institutions to address large and diverse data problems. However, many available ML tools are…

We introduce Diffuse, a system that dynamically performs task and kernel fusion in distributed, task-based runtime systems. The key component of Diffuse is an intermediate representation of distributed computation that enables the necessary…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-17 Rohan Yadav , Shiv Sundram , Wonchan Lee , Michael Garland , Michael Bauer , Alex Aiken , Fredrik Kjolstad

Scaling up executable code data is significant for improving language models' software engineering capability. The intricate nature of the process makes it labor-intensive, time-consuming and expert-knowledge-dependent to build a large…

Software Engineering · Computer Science 2025-10-21 Ruida Hu , Chao Peng , Xinchen Wang , Junjielong Xu , Cuiyun Gao

As LLM agents are increasingly built around reusable skills, a central challenge is no longer only whether agents can use provided skills, but whether they can generate correct, reusable, and executable skills from repositories and…

Artificial Intelligence · Computer Science 2026-05-19 Yifan Zhou , Zhentao Zhang , Ziming Cheng , Shuo Zhang , Qizhen Lan , Zhangquan Chen , Zhi Yang , QianyuXu , Ronghao Chen , Huacan Wang , Sen Hu

In biomolecular systems (especially all-atom models) with many degrees of freedom such as proteins and nucleic acids, there exist an astronomically large number of local-minimum-energy states. Conventional simulations in the canonical…

Statistical Mechanics · Physics 2010-12-30 Ayori Mitsutake , Yoshiharu Mori , Yuko Okamoto

The Hiperwalk package is designed to facilitate the simulation of quantum walks using heterogeneous high-performance computing, taking advantage of the parallel processing power of diverse processors such as CPUs, GPUs, and acceleration…

Quantum Physics · Physics 2024-06-13 Paulo Motta , Gustavo A. Bezerra , Anderson F. P. Santos , Renato Portugal

We present EasyGen, an efficient model designed to enhance multimodal understanding and generation by harnessing the capabilities of diffusion models and large language models (LLMs), Unlike existing multimodal models that predominately…

Artificial Intelligence · Computer Science 2024-05-20 Xiangyu Zhao , Bo Liu , Qijiong Liu , Guangyuan Shi , Xiao-Ming Wu

Large language models (LLMs) exhibit varying strengths and weaknesses across different tasks, prompting recent studies to explore the benefits of ensembling models to leverage their complementary advantages. However, existing LLM ensembling…

Computation and Language · Computer Science 2025-02-26 Yuxuan Yao , Han Wu , Mingyang Liu , Sichun Luo , Xiongwei Han , Jie Liu , Zhijiang Guo , Linqi Song

More widespread adoption requires swarms of robots to be more flexible for real-world applications. Multiple challenges remain in complex scenarios where a large amount of data needs to be processed in real-time and high degrees of…

Robotics · Computer Science 2020-04-30 Jorge Peña Queralta , Li Qingqing , Tuan Nguyen Gia , Hong-Linh Truong , Tomi Westerlund

The need for computational resources grows as computational algorithms gain popularity in different sectors of the scientific community. This search has stimulated the development of several cloud platforms that abstract the complexity of…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-18 Henrique C. T. Santos , Luciano S. de Souza , Jonathan H. A. de Carvalho , Tiago A. E. Ferreira

Hardware heterogeneity is here to stay for high-performance computing. Large-scale systems are currently equipped with multiple GPU accelerators per compute node and are expected to incorporate more specialized hardware in the future. This…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-10-05 Polykarpos Thomadakis , Nikos Chrisochoides

NLP Workbench is a web-based platform for text mining that allows non-expert users to obtain semantic understanding of large-scale corpora using state-of-the-art text mining models. The platform is built upon latest pre-trained models and…

Computation and Language · Computer Science 2024-03-06 Peiran Yao , Matej Kosmajac , Abeer Waheed , Kostyantyn Guzhva , Natalie Hervieux , Denilson Barbosa

Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems…

The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization…

The advent of the Internet of Things (IoT) gives the opportunity to numerous devices to interact with their environment, collect and process data. Data are transferred, in an upwards mode, to the Cloud through the Edge Computing (EC)…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-07-29 T. Koukaras , K. Kolomvatsos

With the increasing popularity of accelerator technologies (e.g., GPUs and TPUs) and the emergence of domain-specific computing via ASICs and FPGA, the matter of heterogeneity and understanding its ramifications on the performance has…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-03-21 Ali Mokhtari , Drake Rawls , Tony Huynh , Jeremiah Green , Mohsen Amini Salehi

Large Language Models (LLMs) equipped with external tools have demonstrated enhanced performance on complex reasoning tasks. The widespread adoption of this tool-augmented reasoning is hindered by the scarcity of domain-specific tools. For…

Computation and Language · Computer Science 2025-10-10 Murong Yue , Zhiwei Liu , Liangwei Yang , Jianguo Zhang , Zuxin Liu , Haolin Chen , Ziyu Yao , Silvio Savarese , Caiming Xiong , Shelby Heinecke , Huan Wang