English
Related papers

Related papers: Parallel Data Object Creation: Towards Scalable Me…

200 papers

Fast and scalable metadata management across multiple metadata servers is crucial for distributed file systems to handle numerous files and directories. Client-side caching of frequently accessed metadata can mitigate server loads, but…

Hardware Architecture · Computer Science 2026-05-06 Qingxiu Liu , Jiazhen Cai , Siyuan Sheng , Yuhui Chen , Lu Tang , Zhirong Shen , Patrick P. C. Lee

Today's computing systems require moving data back-and-forth between computing resources (e.g., CPUs, GPUs, accelerators) and off-chip main memory so that computation can take place on the data. Unfortunately, this data movement is a major…

Hardware Architecture · Computer Science 2022-05-31 Geraldo F. Oliveira , Amirali Boroumand , Saugata Ghose , Juan Gómez-Luna , Onur Mutlu

Detecting anomalous behavior in network traffic is a major challenge due to the volume and velocity of network traffic. For example, a 10 Gigabit Ethernet connection can generate over 50 MB/s of packet headers. For global network providers,…

Modern large-scale scientific discovery requires multidisciplinary collaboration across diverse computing facilities, including High Performance Computing (HPC) machines and the Edge-to-Cloud continuum. Integrated data analysis plays a…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-08-21 Renan Souza , Tyler J. Skluzacek , Sean R. Wilkinson , Maxim Ziatdinov , Rafael Ferreira da Silva

Transformer models serve as the backbone of many state-ofthe-art language models, and most use the scaled dot-product attention (SDPA) mechanism to capture relationships between tokens. However, the straightforward implementation of SDPA…

Hardware Architecture · Computer Science 2024-08-09 Gina Sohn , Nathan Zhang , Kunle Olukotun

Modern applications commonly need to manage dataset types composed of heterogeneous data and schemas, making it difficult to access them in an integrated way. A single data store to manage heterogeneous data using a common data model is not…

Machine Learning (ML) functions are becoming ubiquitous in latency- and privacy-sensitive IoT applications, prompting a shift toward near-sensor processing at the extreme edge and the consequent increasing adoption of Parallel Ultra-Low…

Hardware Architecture · Computer Science 2022-11-15 Enrico Tabanelli , Giuseppe Tagliavini , Luca Benini

Today's high resolution, high frame rate cameras in autonomous vehicles generate a large volume of data that needs to be transferred and processed by a downstream processor or machine learning (ML) accelerator to enable intelligent…

Heterogeneous computing platforms consisting of general purpose processors (GPPs) and graphics processing units (GPUs) have become commonplace in personal mobile devices and embedded systems. For years, programming of these platforms was…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-11 Jani Boutellier , Ilkka Hautala

Rapid growth in scientific data and a widening gap between computational speed and I/O bandwidth makes it increasingly infeasible to store and share all data produced by scientific simulations. Instead, we need methods for reducing data…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-28 Jieyang Chen , Lipeng Wan , Xin Liang , Ben Whitney , Qing Liu , Qian Gong , David Pugmire , Nicholas Thompson , Jong Youl Choi , Matthew Wolf , Todd Munson , Ian Foster , Scott Klasky

There is an ever-present need for shared memory parallelization schemes to exploit the full potential of multi-core architectures. The most common parallelization API addressing this need today is OpenMP. Nevertheless, writing parallel code…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-05-23 Tal Kadosh , Nadav Schneider , Niranjan Hasabnis , Timothy Mattson , Yuval Pinter , Gal Oren

Scientists are increasingly turning to datacenter-scale computers to produce and analyze massive arrays. Despite decades of database research that extols the virtues of declarative query processing, scientists still write, debug and…

Databases · Computer Science 2017-02-28 Haoyuan Xing , Sofoklis Floratos , Spyros Blanas , Suren Byna , Prabhat , Kesheng Wu , Paul Brown

Scientific simulation leveraging high-performance computing (HPC) systems is crucial for modeling complex systems and phenomena in fields such as astrophysics, climate science, and fluid dynamics, generating massive datasets that often…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-07-03 Wenqi Jia , Ying Huang , Jian Xu , Zhewen Hu , Sian Jin , Jiannan Tian , Yuede Ji , Miao Yin

Federated learning (FL) collaboratively models user data in a decentralized way. However, in the real world, non-identical and independent data distributions (non-IID) among clients hinder the performance of FL due to three issues, i.e.,…

Machine Learning · Computer Science 2023-07-28 Xinting Liao , Weiming Liu , Chaochao Chen , Pengyang Zhou , Huabin Zhu , Yanchao Tan , Jun Wang , Yue Qi

We define an abstract framework for object-oriented programming and show that object-oriented languages, such as C++, can be interpreted as parallel programming languages. Parallel C++ code is typically more than ten times shorter than the…

Programming Languages · Computer Science 2019-03-04 Edward Givelberg

Parallel data processing has become indispensable for processing applications involving huge data sets. This brings into focus the Graphics Processing Units (GPUs) which emphasize on many-core computing. With the advent of General Purpose…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-05-22 Poorna Banerjee , Amit Dave

High-level applications, such as machine learning, are evolving from simple models based on multilayer perceptrons for simple image recognition to much deeper and more complex neural networks for self-driving vehicle control systems.The…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-10-12 Guixiang Ma , Yao Xiao , Theodore L. Willke , Nesreen K. Ahmed , Shahin Nazarian , Paul Bogdan

Present day computational fluid dynamics simulations generate extremely large amounts of data, sometimes on the order of TB/s. Often, a significant fraction of this data is discarded because current storage systems are unable to keep pace.…

Computational Engineering, Finance, and Science · Computer Science 2021-03-03 Heather Pacella , Alec Dunton , Alireza Doostan , Gianluca Iaccarino

Data skipping reduces I/O for SQL queries by skipping over irrelevant data objects (files) based on their metadata. We extend this notion by allowing developers to define their own data skipping metadata types and indexes using a flexible…

Databases · Computer Science 2020-11-17 Paula Ta-Shma , Guy Khazma , Gal Lushi , Oshrit Feder

Object detection is a basic but challenging task in computer vision, which plays a key role in a variety of industrial applications. However, object detectors based on deep learning usually require greater storage requirements and longer…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Ying Xin , Guanzhong Wang , Mingyuan Mao , Yuan Feng , Qingqing Dang , Yanjun Ma , Errui Ding , Shumin Han