English
Related papers

Related papers: Parallel Writing of Nested Data in Columnar Format…

200 papers

The challenge to fully exploit the potential of existing and upcoming scientific instruments like large single-dish radio telescopes is to process the collected massive data effectively and efficiently. As a "quasi 2D stencil computation"…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-07-12 Hao Wang , Ce Yu , Jian Xiao , Shanjiang Tang , Min Long , Ming Zhu

Despite the growing availability of Electronic Health Record (EHR) data, researchers often face substantial barriers in effectively using these data for translational research due to their complexity, heterogeneity, and lack of standardized…

Neuromorphic computing systems comprise networks of neurons that use asynchronous events for both computation and communication. This type of representation offers several advantages in terms of bandwidth and power consumption in…

Hardware Architecture · Computer Science 2017-11-07 Saber Moradi , Ning Qiao , Fabio Stefanini , Giacomo Indiveri

We consider the problem of developing an efficient multi-threaded implementation of the matrix-vector multiplication algorithm for sparse matrices with structural symmetry. Matrices are stored using the compressed sparse row-column format…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-18 Vicente H. F. Batista , George O. Ainsworth , Fernando L. B. Ribeiro

Dense embedding models are commonly deployed in commercial search engines, wherein all the document vectors are pre-computed, and near-neighbor search (NNS) is performed with the query vector to find relevant documents. However, the…

Machine Learning · Computer Science 2020-09-01 Tharun Medini , Beidi Chen , Anshumali Shrivastava

Numerical studies of shock waves in large scale systems via kinetic simulations with millions of particles are too computationally demanding to be processed in serial. In this work we focus on optimizing the parallel performance of a…

Computational Physics · Physics 2015-07-10 Jim Howell , Wolfgang Bauer , Dirk Colbry , Rodney Pickett , Alec Staber , Irina Sagert , Terrance Strother

One of the major performance and scalability bottlenecks in large scientific applications is parallel reading and writing to supercomputer I/O systems. The usage of parallel file systems and consistency requirements of POSIX, that all the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-30 Steven Wei-der Chien , Stefano Markidis , Rami Karim , Erwin Laure , Sai Narasimhamurthy

We propose a methodology for automatic generation of divide-and-conquer parallel implementations of sequential nested loops. We focus on a class of loops that traverse read-only multidimensional collections (lists or arrays) and compute a…

Programming Languages · Computer Science 2019-04-03 Azadeh Farzan , Victor Nicolet

Ensuring the trustworthiness of data from distributed and resource-constrained environments, such as Wireless Sensor Networks or IoT devices, is critical. Existing Reversible Data Hiding (RDH) methods for scalar data suffer from low…

Cryptography and Security · Computer Science 2026-02-23 David Megias

With the slowdown of Moore's law, CPU-oriented packet processing in software will be significantly outpaced by emerging line speeds of network interface cards (NICs). Single-core packet-processing throughput has saturated. We consider the…

Networking and Internet Architecture · Computer Science 2024-06-18 Qiongwen Xu , Sebastiano Miano , Xiangyu Gao , Tao Wang , Adithya Murugadass , Songyuan Zhang , Anirudh Sivaraman , Gianni Antichi , Srinivas Narayana

In this paper, we investigate the parallelization of $k$-core decomposition, a method used in graph analysis to identify cohesive substructures and assess node centrality. Although efficient sequential algorithms exist for this task, the…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-02 Davide Rucci , Sebastian Parfeniuc , Matteo Mordacchini , Emanuele Carlini , Alfredo Cuzzocrea , Patrizio Dazzi

In order to achieve high efficiency of classification in intrusion detection, a compressed model is proposed in this paper which combines horizontal compression with vertical compression. OneR is utilized as horizontal com-pression for…

Machine Learning · Computer Science 2014-05-15 Tieming Chen , Xu Zhang , Shichao Jin , Okhee Kim

We present Rhino, a system for accelerating tensor programs with automatic parallelization on AI platform for real production environment. It transforms a tensor program written for a single device into an equivalent distributed program…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-02-17 Shiwei Zhang , Lansong Diao , Siyu Wang , Zongyan Cao , Yiliang Gu , Chang Si , Ziji Shi , Zhen Zheng , Chuan Wu , Wei Lin

Distributed systems that manage and process graph-structured data internally solve a graph partitioning problem to minimize their communication overhead and query run-time. Besides computational complexity -- optimal graph partitioning is…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-03-24 Ruben Mayer , Hans-Arno Jacobsen

High-level I/O libraries, such as HDF5 and PnetCDF, are commonly used by large-scale scientific applications to perform I/O tasks in parallel. These I/O libraries store the metadata such as data types and dimensionality along with the raw…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Youjia Li , Robert Latham , Robert Ross , Ankit Agrawal , Alok Choudhary , Wei-Keng Liao

The need to understand the structure of hierarchical or high-dimensional data is present in a variety of fields. Hyperbolic spaces have proven to be an important tool for embedding computations and analysis tasks as their non-linear nature…

Human-Computer Interaction · Computer Science 2024-01-26 Martin Skrodzki , Hunter van Geffen , Nicolas F. Chaves-de-Plaza , Thomas Höllt , Elmar Eisemann , Klaus Hildebrandt

R has become a cornerstone of scientific and statistical computing due to its extensive package ecosystem, expressive syntax, and strong support for reproducible analysis. However, as data sizes and computational demands grow, native R…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-13 Xiran Zhang , Javier Conejero , Sameh Abdulah , Jorge Ejarque , Ying Sun , Rosa M. Badia , David E. Keyes , Marc G. Genton

Subspace clustering aims to group data points into multiple clusters of which each corresponds to one subspace. Most existing subspace clustering approaches assume that input data lie on linear subspaces. In practice, however, this…

Computer Vision and Pattern Recognition · Computer Science 2020-03-30 Liangli Zhen , Dezhong Peng , Wei Wang , Xin Yao

Scheduling query execution plans is a particularly complex problem in shared-nothing parallel systems, where each site consists of a collection of local time-shared (e.g., CPU(s) or disk(s)) and space-shared (e.g., memory) resources and…

Databases · Computer Science 2014-04-01 Minos Garofalakis , Yannis Ioannidis

We present a technique for automatically transforming kernel-based computations in disparate, nested loops into a fused, vectorized form that can reduce intermediate storage needs and lead to improved performance on contemporary hardware.…

Performance · Computer Science 2017-10-25 Jason Sewall , Simon J. Pennycook