English
Related papers

Related papers: Parallel Writing of Nested Data in Columnar Format…

200 papers

Electronic Health Records (EHRs) have become increasingly popular to support clinical decision-making and healthcare in recent decades. EHRs usually contain heterogeneous information, such as structural data in tabular form and unstructured…

Machine Learning · Computer Science 2024-03-15 Hejie Cui , Xinyu Fang , Ran Xu , Xuan Kan , Joyce C. Ho , Carl Yang

Array operations are one of the most concise ways of expressing common filtering and simple aggregation operations that is the hallmark of the first step of a particle physics analysis: selection, filtering, basic vector operations, and…

Databases · Computer Science 2021-09-08 Gordon Watts

Deep neural networks have achieved remarkable breakthroughs by leveraging multiple layers of data processing to extract hidden representations, albeit at the cost of large electronic computing power. To enhance energy efficiency and speed,…

Lossy compression is one of the most efficient solutions to reduce storage overhead and improve I/O performance for HPC applications. However, existing parallel I/O libraries cannot fully utilize lossy compression to accelerate parallel…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-30 Sian Jin , Dingwen Tao , Houjun Tang , Sheng Di , Suren Byna , Zarija Lukic , Franck Cappello

In the evolving landscape of neural network models, one prominent challenge stand out: the significant memory overheads associated with training expansive models. Addressing this challenge, this study delves deep into the Rotated Tensor…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-11-06 Cheng Luo , Tianle Zhong , Geoffrey Fox

Deduplication has been largely employed in distributed storage systems to improve space efficiency. Traditional deduplication research ignores the design specifications of shared-nothing distributed storage systems such as no central…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-22 Awais Khan , Chang-Gyu Lee , Prince Hamandawana , Sungyong Park , Youngjae Kim

Error-controlled lossy compressors have been widely used in scientific applications to reduce the unprecedented size of scientific data while keeping data distortion within a user-specified threshold. While they significantly mitigate the…

Databases · Computer Science 2026-03-27 Xuan Wu , Sheng Di , Tripti Agarwal , Kai Zhao , Xin Liang , Franck Cappello

Symmetric tensor operations arise in a wide variety of computations. However, the benefits of exploiting symmetry in order to reduce storage and computation is in conflict with a desire to simplify memory access patterns. In this paper, we…

Numerical Analysis · Mathematics 2014-10-21 Martin D. Schatz , Tze Meng Low , Robert A. van de Geijn , Tamara G. Kolda

Supercomputers are equipped with an increasingly large number of cores to use computational power as a way of solving problems that are otherwise intractable. Unfortunately, getting serial algorithms to run in parallel to take advantage of…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-12-31 Faisal N. Abu-Khzam , Khuzaima Daudjee , Amer E. Mouawad , Naomi Nishimura

In the era of diminishing returns from Moores Law, heterogeneous computing systems have emerged as a vital approach to enhance computational efficiency. This paper introduces a novel MLIR-based dialect, named hyper, designed to optimize…

Cryptography and Security · Computer Science 2025-06-05 Zhiyuan Tan , Liutong Han , Mingjie Xing , Yanjun Wu

As the Large Hadron Collider (LHC) continues its upward progression in energy and luminosity towards the planned High-Luminosity LHC (HL-LHC) in 2025, the challenges of the experiments in processing increasingly complex events will also…

Instrumentation and Detectors · Physics 2022-10-05 Paul Lujan , Valerie Halyo

We explore using multilingual document embeddings for nearest neighbor mining of parallel data. Three document-level representations are investigated: (i) document embeddings generated by simply averaging multilingual sentence embeddings;…

Computation and Language · Computer Science 2019-07-02 Mandy Guo , Yinfei Yang , Keith Stevens , Daniel Cer , Heming Ge , Yun-Hsuan Sung , Brian Strope , Ray Kurzweil

In mesh-based numerical simulations, sweep is an important computation pattern. During sweeping a mesh, computations on cells are strictly ordered by data dependencies in given directions. Due to such a serial order, parallelizing sweep is…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-03-28 Jie Yan , Zhang Yang , Aiqing Zhang , Zeyao Mo

The development of the Parallel ROOT Facility, PROOF, enables a physicist to analyze and understand much larger data sets on a shorter time scale. It makes use of the inherent parallelism in event data and implements an architecture that…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Maarten Ballintijn , Rene Brun , Fons Rademakers , Gunther Roland

Fully Homomorphic Encryption (FHE) allows for computation directly on encrypted data and enables privacy-preserving neural inference in the cloud. Prior work has focused on models with dense inputs (e.g., CNNs), with less attention given to…

Cryptography and Security · Computer Science 2026-02-23 Karthik Garimella , Austin Ebel , Gabrielle De Micheli , Brandon Reagen

Heterogeneous many-cores are now an integral part of modern computing systems ranging from embedding systems to supercomputers. While heterogeneous many-core design offers the potential for energy-efficient high-performance, such potential…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-05-11 Jianbin Fang , Chun Huang , Tao Tang , Zheng Wang

Making the most use of abundant information in electronic health records (EHR) is rapidly becoming an important topic in the medical domain. Recent work presented a promising framework that embeds entire features in raw EHR data regardless…

Machine Learning · Computer Science 2023-05-11 Eunbyeol Cho , Min Jae Lee , Kyunghoon Hur , Jiyoun Kim , Jinsung Yoon , Edward Choi

Columnar storage is a core component of a modern data analytics system. Although many database management systems (DBMSs) have proprietary storage formats, most provide extensive support to open-source storage formats such as Parquet and…

Databases · Computer Science 2023-11-08 Xinyu Zeng , Yulong Hui , Jiahong Shen , Andrew Pavlo , Wes McKinney , Huanchen Zhang

We describe a methodology for designing efficient parallel and distributed scientific software. This methodology utilizes sequences of mechanizable algebra--based optimizing transformations. In this study, we apply our methodology to the…

Software Engineering · Computer Science 2008-11-18 Harry B. Hunt , Lenore R. Mullin , Daniel J. Rosenkrantz , James E. Raynolds

We present algorithmic improvements to the loading operations of certain reduced data ensembles produced from neutron scattering experiments at Oak Ridge National Laboratory (ORNL) facilities. Ensembles from multiple measurements are…

Databases · Computer Science 2022-09-07 William F Godoy , Andrei T Savici , Steven E Hahn , Peter F Peterson