中文
相关论文

相关论文: A Cost-based Storage Format Selector for Materiali…

200 篇论文

Driven by scientific and industry ambition, HPC and AI applications such as operational Numerical Weather Prediction (NWP) require processing and storing ever-increasing data volumes as fast as possible. Whilst POSIX distributed file…

分布式、并行与集群计算 · 计算机科学 2026-02-20 Nicolau Manubens Gil

The rapidly growing size of RDF graphs in recent years necessitates distributed storage and parallel processing strategies. To obtain efficient query processing using computer clusters a wide variety of different approaches have been…

数据库 · 计算机科学 2018-02-19 Matteo Cossu , Michael Färber , Georg Lausen

Caching is crucial for enabling high-throughput networks for data intensive applications. Traditional caching technology relies on DRAM, as it can transfer data at a high rate. However, DRAM capacity is subject to contention by most system…

网络与互联网体系结构 · 计算机科学 2023-10-12 Faruk Volkan Mutlu , Edmund Yeh

Today's era is the digitized era. Managing such generated big data is an important factor for data scientists. Day by day, it increases the demand for big data storage systems. Different organizations are involved in providing…

This paper investigates sequencing policies for file reading requests in linear storage devices, such as magnetic tapes. Tapes are the technology of choice for long-term storage in data centers due to their low cost and reliability.…

数据结构与算法 · 计算机科学 2022-05-11 Carlos H. Cardonha , Andre A. Cire , Lucas C. Villa Real

Allocation of (redundant) file chunks throughout a distributed storage system affects important performance metrics such as the probability of file recovery, data download time, or the service rate of the system under a given data access…

分布式、并行与集群计算 · 计算机科学 2018-08-24 Pei Peng , Emina Soljanin

With the ever-increasing dataset sizes, several file formats such as Parquet, ORC, and Avro have been developed to store data efficiently, save the network, and interconnect bandwidth at the price of additional CPU utilization. However,…

分布式、并行与集群计算 · 计算机科学 2022-04-14 Jayjeet Chakraborty , Ivo Jimenez , Sebastiaan Alvarez Rodriguez , Alexandru Uta , Jeff LeFevre , Carlos Maltzahn

Hashing method maps similar data to binary hashcodes with smaller hamming distance, and it has received a broad attention due to its low storage cost and fast retrieval speed. However, the existing limitations make the present algorithms…

计算机视觉与模式识别 · 计算机科学 2016-09-29 Shifeng Zhang , Jianmin Li , Jinma Guo , Bo Zhang

Classification with Costly Features (CwCF) is a classification problem that includes the cost of features in the optimization criteria. Individually for each sample, its features are sequentially acquired to maximize accuracy while…

机器学习 · 计算机科学 2024-07-17 Jaromír Janisch , Tomáš Pevný , Viliam Lisý

Retrieving data from large-scale source code archives is vital for AI training, neural-based software analysis, and information retrieval, to cite a few. This paper studies and experiments with the design of a compressed key-value store for…

数据结构与算法 · 计算机科学 2026-01-21 Paolo Ferragina , Francesco Tosoni

Coded caching techniques have received significant attention lately due to their provable gains in reducing the cost of data delivery in wireless networks. These gains, however, have only been demonstrated under the assumption of a free…

信息论 · 计算机科学 2020-03-26 Yousef AlHassoun , Faisal Alotaibi , Aly El Gamal , Hesham El Gamal

A large-scale content-centric mobile ad hoc network employing subpacketization is studied in which each mobile node having finite-size cache moves according to the reshuffling mobility model and requests a content object from the library…

信息论 · 计算机科学 2018-04-23 Adeel Malik , Sung Hoon Lim , Won-Yong Shin

As datasets grow it becomes infeasible to process them completely with a desired model. For giant datasets, we frame the order in which computation is performed as a decision problem. The order is designed so that partial computations are…

统计计算 · 统计学 2014-03-18 Daniel John Lawson , Niall M Adams

In this paper, we consider heterogeneous distributed storage systems (DSSs) having flexible reconstruction degree, where each node in the system has dynamic repair bandwidth and dynamic storage capacity. In particular, a data collector can…

信息论 · 计算机科学 2015-03-10 Krishna Gopal Benerjee , Manish K. Gupta

Caching at the network edge has emerged as a viable solution for alleviating the severe capacity crunch in modern content centric wireless networks by leveraging network load-balancing in the form of localized content storage and delivery.…

信息论 · 计算机科学 2016-06-15 Avik Sengupta , Ravi Tandon

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

信息论 · 计算机科学 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

Reusing intermediates in databases to speed-up analytical query processing has been studied in the past. Existing solutions typically require intermediate results of individual operators to be materialized into temporary tables to be…

数据库 · 计算机科学 2016-08-22 Kayhan Dursun , Carsten Binnig , Ugur Cetintemel , Tim Kraska

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

机器学习 · 统计学 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Recent increase in energy prices has led researchers to find better ways for capacity provisioning in data centers to reduce energy wastage due to the variation in workload. This paper explores the opportunity for cost saving utilizing the…

网络与互联网体系结构 · 计算机科学 2015-03-19 Muhammad Abdullah Adnan , Ryo Sugihara , Yan Ma , Rajesh Gupta

View materialization, index selection, and plan caching are well-known techniques for optimization of query processing in database systems. The essence of these tasks is to select and save a subset of the most useful candidates…

数据库 · 计算机科学 2025-01-28 Sergey Zinchenko , Denis Ponomaryov