中文
相关论文

相关论文: Putting Data Science Pipelines on the Edge

200 篇论文

Compiling high-level programs to target high-speed packet-processing pipelines is a challenging combinatorial optimization problem. The compiler must configure the pipeline's resources to match the high-level semantics of the program, while…

网络与互联网体系结构 · 计算机科学 2022-11-22 Xiangyu Gao , Divya Raghunathan , Ruijie Fang , Tao Wang , Xiaotong Zhu , Anirudh Sivaraman , Srinivas Narayana , Aarti Gupta

Datacenter-scale AI training clusters consisting of thousands of domain-specific accelerators (DSA) are used to train increasingly-complex deep learning models. These clusters rely on a data storage and ingestion (DSI) pipeline, responsible…

Data pipeline frameworks provide abstractions for implementing sequences of data-intensive transformation operators, automating the deployment and execution of such transformations in a cluster. Deploying a data pipeline, however, requires…

The heterogeneous edge-cloud computing paradigm can provide a more optimal direction to deploy scientific workflows than traditional distributed computing or cloud computing environments. Due to the different sizes of scientific datasets…

分布式、并行与集群计算 · 计算机科学 2021-04-14 Xin Du , Songtao Tang , Zhihui Lu , Keke Gai , Jie Wu , Patrick C. K. Hung

The progress of the network and device technologies enables any device to be connected to the Internet thereby forming an Internet of Things (IoT) architecture. Internet-related activities based on the IoT services can inevitably generate a…

网络与互联网体系结构 · 计算机科学 2020-06-30 Shahzad , Eun-Sung Jung

Data center networks leverage multiple parallel paths connecting end host pairs to offer high bisection bandwidth for cluster computing applications. However, state of the art distributed multi-pathing protocols such as Equal Cost Multipath…

网络与互联网体系结构 · 计算机科学 2013-07-30 Wenzhi Cui , Chen Qian

Exponential increases in scientific experimental data are outstripping the rate of progress in silicon technology. As a result, heterogeneous combinations of architectures and process or device technologies are increasingly important to…

分布式、并行与集群计算 · 计算机科学 2024-07-02 Wilkie Olin-Ammentorp , Xingfu Wu , Andrew A. Chien

Mining data streams is a challenge per se. It must be ready to deal with an enormous amount of data and with problems not present in batch machine learning, such as concept drift. Therefore, applying a batch-designed technique, such as…

机器学习 · 计算机科学 2020-08-21 Lucca Portes Cavalheiro , Jean Paul Barddal , Alceu de Souza Britto , Laurent Heutte

As a typical Cyber-Physical System (CPS), smart water distribution networks require monitoring of underground water pipes with high sample rates for precise data analysis and water network control. Due to poor underground wireless channel…

社会与信息网络 · 计算机科学 2017-03-30 Sokratis Kartakis , Shusen Yang , Julie A. McCann

Suitable composable data center networks (DCNs) are essential to support the disaggregation of compute components in highly efficient next generation data centers (DCs). However, designing such composable DCNs can be challenging. A…

网络与互联网体系结构 · 计算机科学 2021-06-10 Opeyemi O. Ajibola , Taisir E. H. El-Gorashi , Jaafar M. H. Elmirghani

The rapid urbanization growth has underscored the need for innovative solutions to enhance transportation efficiency and safety. Intelligent Transportation Systems (ITS) have emerged as a promising solution in this context. However,…

By 2025, there are zettabytes of data generated every year. The size and complexity of modern large-scale computing infrastructures like High-Performance Computing (HPC) systems continue to evolve and become complex, leaving us wondering…

分布式、并行与集群计算 · 计算机科学 2026-03-20 Shekhar Suman , Xiaoyu Chu , Alexandru Iosup

As the amount of scientific data continues to grow at ever faster rates, the research community is increasingly in need of flexible computational infrastructure that can support the entirety of the data science lifecycle, including…

计算机与社会 · 计算机科学 2016-04-12 Robert L. Grossman , Allison Heath , Mark Murphy , Maria Patterson , Walt Wells

The future of computing systems is inevitably embracing a disaggregated and composable pattern: from clusters of computers to pools of resources that can be dynamically combined together and tailored around applications requirements.…

分布式、并行与集群计算 · 计算机科学 2024-07-02 Christian Pinto , Dong Li , Thaleia Dimitra Doudali , Christina Giannoula , Jie Ren

Deep learning-based personalized recommendation systems are widely used for online user-facing services in production datacenters, where a large amount of hardware resources are procured and managed to reliably provide low-latency services…

分布式、并行与集群计算 · 计算机科学 2022-12-05 Liu Ke , Xuan Zhang , Benjamin Lee , G. Edward Suh , Hsien-Hsin S. Lee

In recent years, the growing demand to process large graphs and sparse datasets has led to increased research efforts to develop hardware- and software-based architectural solutions to accelerate them. While some of these approaches achieve…

硬件体系结构 · 计算机科学 2024-02-27 Marcelo Orenes-Vera , Esin Tureci , Margaret Martonosi , David Wentzlaff

The advent of the Internet of Things (IoT) gives the opportunity to numerous devices to interact with their environment, collect and process data. Data are transferred, in an upwards mode, to the Cloud through the Edge Computing (EC)…

分布式、并行与集群计算 · 计算机科学 2020-07-29 T. Koukaras , K. Kolomvatsos

Due to the long runtime of Data Science (DS) pipelines, even small programming mistakes can be very costly, if they are not detected statically. However, even basic static type checking of DS pipelines is difficult because most are written…

软件工程 · 计算机科学 2023-04-10 Lars Reimann , Günter Kniesel-Wünsche

The continuously increasing degree of automation in many areas (e.g. manufacturing engineering, public infrastructure) lead to the construction of cyber-physical systems and cyber-physical networks. To both, time and energy are the most…

网络与互联网体系结构 · 计算机科学 2019-05-29 Stefan Reif , Andreas Schmidt , Timo Hönig , Thorsten Herfet , Wolfgang Schröder-Preikschat

Networks are designed with functionality, security, performance, and cost in mind. Tools exist to check or optimize individual properties of a network. These properties may conflict, so it is not always possible to run these tools in series…

密码学与安全 · 计算机科学 2019-02-19 Timothy Curry , Devon Callahan , Benjamin Fuller , Laurent Michel