English
Related papers

Related papers: Accelerating Cloud-Based Transcriptomics: Performa…

200 papers

Slow working nodes, known as stragglers, can greatly reduce the speed of distributed computation. Coded matrix multiplication is a recently introduced technique that enables straggler-resistant distributed multiplication of large matrices.…

Information Theory · Computer Science 2019-07-23 Shahrzad Kiani , Nuwan Ferdinand , Stark C. Draper

State-of-the-art optimization is steadily shifting towards massively parallel pipelines with extremely large batch sizes. As a consequence, CPU-bound preprocessing and disk/memory/network operations have emerged as new performance…

Machine Learning · Computer Science 2020-10-27 Naman Agarwal , Rohan Anil , Tomer Koren , Kunal Talwar , Cyril Zhang

Over the past ten years, many different approaches have been proposed for different aspects of the problem of resources management for long running, dynamic and diverse workloads such as processing query streams or distributed deep…

Performance · Computer Science 2023-08-24 Nader Alfares , George Kesidis , Ata Fatahi Baarzi , Aman Jain

The ever increasing sizes of Large Language Models (LLMs) beyond hundreds of billions of parameters have generated enormous pressure on the manufacturers of dedicated hardware accelerators and made the innovative design of the latter one of…

Machine Learning · Computer Science 2024-10-15 Mahsa Salmani , Nikita Trukhanov , Ilya Soloveychik

Cloud analysis is a critical component of weather and climate science, impacting various sectors like disaster management. However, achieving fine-grained cloud analysis, such as cloud segmentation, in remote sensing remains challenging due…

Computer Vision and Pattern Recognition · Computer Science 2023-11-10 Jay Gala , Sauradip Nag , Huichou Huang , Ruirui Liu , Xiatian Zhu

We present a scalable, cloud-based science platform solution designed to enable next-to-the-data analyses of terabyte-scale astronomical tabular datasets. The presented platform is built on Amazon Web Services (over Kubernetes and S3…

Instrumentation and Methods for Astrophysics · Physics 2022-08-03 Steven Stetzler , Mario Jurić , Kyle Boone , Andrew Connolly , Colin T. Slater , Petar Zečević

As unmanned aircraft systems (UASs) continue to integrate into the U.S. National Airspace System (NAS), there is a need to quantify the risk of airborne collisions between unmanned and manned aircraft to support regulation and standards…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-26 Andrew Weinert , Marc Brittain , Ngaire Underhill , Christine Serres

As comprehensive large model evaluation becomes prohibitively expensive, predicting model performance from limited observations has become essential. However, existing statistical methods struggle with pattern shifts, data sparsity, and…

Artificial Intelligence · Computer Science 2026-02-13 Xiaoxiao Wang , Chunxiao Li , Junying Wang , Yijin Guo , Zijian Chen , Chunyi Li , Xiaohong Liu , Zicheng Zhang , Guangtao Zhai

A simultaneously transmitting and reflecting surface (STARS) enabled edge caching system is proposed for reducing backhaul traffic and ensuring the quality of service. A novel Caching-at-STARS structure, where a dedicated smart controller…

Systems and Control · Electrical Eng. & Systems 2023-08-02 Zhaoming Hu , Ruikang Zhong , Chao Fang , Yuanwei Liu

Cloud computing has grown rapidly in recent years, mainly due to the sharp increase in data transferred over the internet. This growth makes load balancing a key part of cloud systems, as it helps distribute user requests across servers to…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-08-11 Shadman Sakib , Ajay Katangur , Rahul Dubey

Small spacecraft now have precise attitude control systems available commercially, allowing them to slew in 3 degrees of freedom, and capture images within short notice. When combined with appropriate software, this agility can…

Systems and Control · Electrical Eng. & Systems 2020-10-21 Sreeja Nag , Alan S. Li , Vinay Ravindra , Marc Sanchez Net , Kar-Ming Cheung , Rod Lammers , Brian Bledsoe

Recent technology advancements in the areas of compute, storage and networking, along with the increased demand for organizations to cut costs while remaining responsive to increasing service demands have led to the growth in the adoption…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-07-31 Frederick Nwanganga , Mandana Saebi , Gregory Madey , Nitesh Chawla

Energy-aware architectures provide applications with a mix of low (LITTLE) and high (big) frequency cores. Choosing the best hardware configuration for a program running on such an architecture is difficult, because program parts benefit…

Programming Languages · Computer Science 2019-03-19 Marcelo Novaes , Vinícius Petrucci , Abdoulaye Gamatié , Fernando Quintão

This paper presents a novel storage aware routing (STAR) protocol designed to provide a general networking solution over a broad range of wired and wireless usage scenarios. STAR enables routing policies which adapt seamlessly from a…

Networking and Internet Architecture · Computer Science 2021-05-18 Shweta Jain , Snehapreethi Gopinath , Dipankar Raychaudhuri

When orchestrating highly distributed and data-intensive Web service workflows the geographical placement of the orchestration engine can greatly affect the overall performance of a workflow. Orchestration engines are typically run from…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-02-04 Michael Luckeneder , Adam Barker

This paper proposes an architectural framework for the efficient orchestration of containers in cloud environments. It centres around resource scheduling and rescheduling policies as well as autoscaling algorithms that enable the creation…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-26 Rajkumar Buyya , Maria A. Rodriguez , Adel Nadjaran Toosi , Jaeman Park

The cloud datacenter has numerous hosts as well as application requests where resources are dynamic. The demands placed on the resource allocation are diverse. These factors could lead to load imbalances, which affect scheduling efficiency…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-11-07 Sakshi Chhabra , Ashutosh Kumar Singh

This paper studies the computational challenges of large-scale attention-based models in artificial intelligence by utilizing importance sampling methods in the streaming setting. Inspired by the classical definition of the $\ell_2$ sampler…

Machine Learning · Computer Science 2025-10-07 Zhao Song , Shenghao Xie , Samson Zhou

Context-dependent semantic parsing has proven to be an important yet challenging task. To leverage the advances in context-independent semantic parsing, we propose to perform follow-up query analysis, aiming to restate context-dependent…

Computation and Language · Computer Science 2019-09-20 Qian Liu , Bei Chen , Haoyan Liu , Lei Fang , Jian-Guang Lou , Bin Zhou , Dongmei Zhang

As HPC facilities grow their resources, adaptation of classic HEP/NP workflows becomes a need. Linux containers may very well offer a way to lower the bar to exploiting such resources and at the time, help collaboration to reach vast…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Mustafa Mustafa , Jan Balewski , Jérôme Lauret , Jefferson Porter , Shane Canon , Lisa Gerhardt , Levente Hajdu , Mark Lukascsyk