English
Related papers

Related papers: SpotLake: Diverse Spot Instance Dataset Archive Se…

200 papers

We study the problem of optimizing data storage and access costs on the cloud while ensuring that the desired performance or latency is unaffected. We first propose an optimizer that optimizes the data placement tier (on the cloud) and the…

This paper introduces Data Stations, a new data architecture that we are designing to tackle some of the most challenging data problems that we face today: access to sensitive data; data discovery and integration; and governance and…

We study online resource allocation in a cloud computing platform, through a posted pricing mechanism: The cloud provider publishes a unit price for each resource type, which may vary over time; upon arrival at the cloud system, a cloud…

Networking and Internet Architecture · Computer Science 2017-04-20 Zijun Zhang , Zongpeng Li , Chuan Wu

TCP/IP network stack is irreplaceable for Web services in datacenter front-end servers, and the demand for which is growing rapidly for emerging high concurrency network service applications (including Internet, Internet of Things, mobile…

Networking and Internet Architecture · Computer Science 2022-10-18 WL Zhang , YF Shen , H Song , Zh Zhang , K Liu , Q Huang , MY Chen

In Amazon EC2, cloud resources are sold through a combination of an on-demand market, in which customers buy resources at a fixed price, and a spot market, in which customers bid for an uncertain supply of excess resources. Standard market…

Computer Science and Game Theory · Computer Science 2016-12-20 Darrell Hoy , Nicole Immorlica , Brendan Lucier

Premier cloud service providers (CSPs) offer two types of purchase options, namely on-demand and spot instances, with time-varying features in availability and price. Users like startups have to operate on a limited budget and similarly…

Performance · Computer Science 2021-06-04 Xiaohu Wu , Han Yu , Giuliano Casale , Guanyu Gao

AI batch jobs such as model training, inference pipelines, and data analytics require substantial GPU resources and often need to finish before a deadline. Spot instances offer 3-10x lower cost than on-demand instances, but their…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-13 Zhifei Li , Tian Xia , Ziming Mao , Zihan Zhou , Ethan J. Jackson , Jamison Kerney , Zhanghao Wu , Pratik Mishra , Yi Xu , Yifan Qiao , Scott Shenker , Ion Stoica

Data only generates value for a few organizations with expertise and resources to make data shareable, discoverable, and easy to integrate. Sharing data that is easy to discover and integrate is hard because data owners lack information…

Databases · Computer Science 2020-07-03 Raul Castro Fernandez , Pranav Subramaniam , Michael J. Franklin

Data analytics stands to benefit from the increasing availability of datasets that are held without their conceptual relationships being explicitly known. When collected, these datasets form a data lake from which, by processes like data…

Databases · Computer Science 2020-11-23 Alex Bogatu , Alvaro A. A. Fernandes , Norman W. Paton , Nikolaos Konstantinou

Microservice architectures are increasingly used to modularize IoT applications and deploy them in distributed and heterogeneous edge computing environments. Over time, these microservice-based IoT applications are susceptible to…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-06 Duneesha Fernando , Maria A. Rodriguez , Rajkumar Buyya

Cloud providers have introduced pricing models to incentivize long-term commitments of compute capacity. These long-term commitments allow the cloud providers to get guaranteed revenue for their investments in data centers and computing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-05-01 Murray Stokely , Neel Nadgir , Jack Peele , Orestis Kostakis

Spark is an in-memory analytics platform that targets commodity server environments today. It relies on the Hadoop Distributed File System (HDFS) to persist intermediate checkpoint states and final processing results. In Spark, immutable…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-08-22 Mijung Kim , Jun Li , Haris Volos , Manish Marwah , Alexander Ulanov , Kimberly Keeton , Joseph Tucek , Lucy Cherkasova , Le Xu , Pradeep Fernando

Current scene graph datasets suffer from strong long-tail distributions of their predicate classes. Due to a very low number of some predicate classes in the test sets, no reliable metrics can be retrieved for the rarest classes. We…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Julian Lorenz , Florian Barthel , Daniel Kienzle , Rainer Lienhart

Vehicles are sophisticated machines equipped with sensors that provide real-time data for onboard driving assistance systems. Due to the wide variety of traffic, road, and weather conditions, continuous system enhancements are essential.…

Networking and Internet Architecture · Computer Science 2024-10-30 Felipe Mogollon , Zaloa Fernandez , Angel Martin , Juan Diego Ortega , Gorka Velez

Serverless computing platforms currently rely on basic pricing schemes that are static and do not reflect customer feedback. This leads to significant inefficiencies from a total utility perspective. As one of the fastest-growing cloud…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-01-26 Vipul Gupta , Soham Phade , Thomas Courtade , Kannan Ramchandran

As the amount of scientific data continues to grow at ever faster rates, the research community is increasingly in need of flexible computational infrastructure that can support the entirety of the data science lifecycle, including…

Computers and Society · Computer Science 2016-04-12 Robert L. Grossman , Allison Heath , Mark Murphy , Maria Patterson , Walt Wells

Load Balancing plays a vital role in modern data centers to distribute traffic among instances of network functions or services. State-of-the-art load balancers such as Silkroad dispatch traffic obliviously without considering the real-time…

Networking and Internet Architecture · Computer Science 2019-02-26 Ashkan Aghdai , Cing-Yu Chu , Yang Xu , David H. Dai , Jun Xu , H. Jonathan Chao

Cloud services are critical to society. However, their reliability is poorly understood. Towards solving the problem, we propose a standard repository for cloud uptime data. We populate this repository with the data we collect containing…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-15 Sacheendra Talluri , Dante Niewenhuis , Xiaoyu Chu , Jakob Kyselica , Mehmet Cetin , Alexander Balgavy , Alexandru Iosup

We consider "time-of-use" pricing as a technique for matching supply and demand of temporal resources with the goal of maximizing social welfare. Relevant examples include energy, computing resources on a cloud computing platform, and…

Computer Science and Game Theory · Computer Science 2017-04-11 Shuchi Chawla , Nikhil R. Devanur , Alexander E. Holroyd , Anna Karlin , James Martin , Balasubramanian Sivan

Any information is valuable as long as it has related data. If related data are not put together, the information is meaningless as unrelated data has no value. The mapped information is required only by authenticated users. So there is no…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-10-21 Veena Rawat