English
Related papers

Related papers: Thallus: An RDMA-based Columnar Data Transport Pro…

200 papers

Read-optimized columnar databases use differential updates to handle writes by maintaining a separate write-optimized delta partition which is periodically merged with the read-optimized and compressed main partition. This merge process…

The metadata service (MDS) sits on the critical path for distributed file system (DFS) operations, and therefore it is key to the overall performance of a large-scale DFS. Common "serverful" MDS architectures, such as a single server or…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-22 Benjamin Carver , Runzhou Han , Jingyaun Zhang , Mai Zheng , Yue Cheng

This paper presents a modern and scalable framework for analyzing Detector Control System (DCS) data from the ATLAS experiment at CERN. The DCS data, stored in an Oracle database via the WinCC OA system, is optimized for transactional…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-24 Luca Canali , Andrea Formica , Michelle Ann Solis

Large Language Models (LLMs) are rapidly being integrated into real-world applications, yet their autoregressive architectures introduce significant inference time variability, especially when deployed across heterogeneous edge-cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-30 Panlong Wu , Yifei Zhong , Danyang Chen , Ting Wang , Fangxin Wang

The increasing complexity of IoT applications and the continuous growth in data generated by connected devices have led to significant challenges in managing resources and meeting performance requirements in computing continuum…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-22 Sergio Laso , Ilir Murturi , Pantelis Frangoudis , Juan Luis Herrera , Juan M. Murillo , Schahram Dustdar

What is a systematic way to efficiently apply a wide spectrum of advanced ML programs to industrial scale problems, using Big Models (up to 100s of billions of parameters) on Big Data (up to terabytes or petabytes)? Modern parallelization…

This paper presents an RDMA over Ethernet protocol used for data acquisition systems, currently under development at the ESRF. The protocol is implemented on Xilinx Ultrascale + FPGAs thanks to the 100G hard MAC IP. The proposed protocol is…

Instrumentation and Detectors · Physics 2019-09-04 Wassim Mansour , Nicolas Janvier , Pablo Fajardo

Existing work that schedules concurrent transmissions collision-free suffers from low channel utilization. We propose the Optimal Node Activation Multiple Access (ONAMA) protocol to achieve maximal channel spatial reuse through a…

Networking and Internet Architecture · Computer Science 2014-04-02 Xiaohui Liu , Hongwei Zhang

Recent deep learning workloads increasingly push computational demand beyond what current memory systems can sustain, with many kernels stalling on data movement rather than computation. While modern dataflow accelerators incorporate…

Programming Languages · Computer Science 2025-09-09 Shihan Fang , Hongzheng Chen , Niansong Zhang , Jiajie Li , Han Meng , Adrian Liu , Zhiru Zhang

The increasing use of statistical data analysis in enterprise applications has created an arms race among database vendors to offer ever more sophisticated in-database analytics. One challenge in this race is that each new statistical…

Databases · Computer Science 2015-03-20 Xixuan Feng , Arun Kumar , Ben Recht , Christopher Ré

Optimization has been widely used to generate smooth trajectories for motion planning. However, existing trajectory optimization methods show weakness when dealing with large-scale long trajectories. Recent advances in parallel computing…

Robotics · Computer Science 2025-07-18 Jiajun Yu , Nanhe Chen , Guodong Liu , Chao Xu , Fei Gao , Yanjun Cao

As modern AI workloads increasingly rely on heterogeneous accelerators, ensuring high-bandwidth and layout-flexible data movements between accelerator memories has become a pressing challenge. Direct Memory Access (DMA) engines promise high…

Hardware Architecture · Computer Science 2025-08-13 Fanchen Kong , Yunhao Deng , Xiaoling Yi , Ryan Antonio , Marian Verhelst

Nowadays, data caching is being used as a high-speed data storage layer in mobile edge computing networks employing flow control methodologies at an exponential rate. This study shows how to discover the best architecture for backhaul…

Networking and Internet Architecture · Computer Science 2022-11-29 Amir Ziaeddini , Amin Mohajer , Davoud Yousefi , A. Mirzaei , Shu Gonglee

In last decade, data analytics have rapidly progressed from traditional disk-based processing to modern in-memory processing. However, little effort has been devoted at enhancing performance at micro-architecture level. This paper…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-17 Ahsan Javed Awan , Mats Brorsson , Vladimir Vlassov , Eduard Ayguade

Ensuring robustness in ML-enabled software systems requires addressing critical challenges, such as silent failures, out-of-distribution (OOD) data, and adversarial attacks. Traditional software engineering practices, which rely on…

Software Engineering · Computer Science 2025-10-22 Hala Abdelkader , Mohamed Abdelrazek , Priya Rani , Rajesh Vasa , Jean-Guy Schneider

Relational data stored in RDBMS is foundational to many real-world applications across domains such as e-commerce, finance, and sociality. While deep neural networks (DNNs) have achieved strong performance on tabular data with a single…

Databases · Computer Science 2026-05-15 Lingze Zeng , Shaofeng Cai , Changshuo Liu , Zhongle Xie , Yuncheng Wu , Beng Chin Ooi

Rail-optimized network fabrics have become the de facto datacenter scale-out fabric for large-scale ML training. However, the use of high-radix electrical switches to provide all-to-all connectivity in rails imposes massive power and cost.…

Networking and Internet Architecture · Computer Science 2026-03-18 Eric Ding , Barry Lyu , Bhaskar Kataria , Rachee Singh

Asynchronous Distributed Reinforcement Learning (DRL) can suffer from degraded convergence when model updates become stale, often the result of network congestion and packet loss during large-scale training. This work introduces a network…

Networking and Internet Architecture · Computer Science 2025-07-09 Nehal Baganal Krishna , Anam Tahir , Firas Khamis , Mina Tahmasbi Arashloo , Michael Zink , Amr Rizk

Data-flow is a natural approach to parallelism. However, describing dependencies and control between fine-grained data-flow tasks can be complex and present unwanted overheads. TALM (TALM is an Architecture and Language for Multi-threading)…

Distributed, Parallel, and Cluster Computing · Computer Science 2011-09-23 Leandro A. J. Marzulo , Tiago A. O. Alves , Felipe M. G. França , Vítor Santos Costa

Dataframes are a popular abstraction to represent, prepare, and analyze data. Despite the remarkable success of dataframe libraries in Rand Python, dataframes face performance issues even on moderately large datasets. Moreover, there is…