English
Related papers

Related papers: AutoComp: Automated Data Compaction for Log-Struct…

200 papers

Scientific problems that depend on processing large amounts of data require overcoming challenges in multiple areas: managing large-scale data distribution, controlling co-placement and scheduling of data with compute resources, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-11-20 Andre Luckow , Mark Santcroos , Ashley Zebrowski , Shantenu Jha

Log statements have become an integral part of modern software systems. Prior research efforts have focused on supporting the decisions of placing log statements, such as where/what to log. With the increasing adoption of Large Language…

Software Engineering · Computer Science 2025-11-05 Hao Zhang , Dongjun Yu , Lei Zhang , Guoping Rong , Yongda Yu , Haifeng Shen , He Zhang , Dong Shao , Hongyu Kuang

Organizations are collecting increasingly large amounts of data for data driven decision making. These data are often dumped into a centralized repository, e.g., a data lake, consisting of thousands of structured and unstructured datasets.…

Artificial Intelligence · Computer Science 2023-07-18 Mohamed Y. Eltabakh , Mayuresh Kunjir , Ahmed Elmagarmid , Mohammad Shahmeer Ahmad

Modern data lakes have emerged as foundational platforms for large-scale machine learning, enabling flexible storage of heterogeneous data and structured analytics through table-oriented abstractions. Despite their growing importance,…

Machine Learning · Computer Science 2026-02-12 Feiyu Pan , Tianbin Zhang , Aoqian Zhang , Yu Sun , Zheng Wang , Lixing Chen , Li Pan , Jianhua Li

Logs have been widely adopted in software system development and maintenance because of the rich runtime information they record. In recent years, the increase of software size and complexity leads to the rapid growth of the volume of logs.…

Software Engineering · Computer Science 2023-09-14 Jieming Zhu , Shilin He , Pinjia He , Jinyang Liu , Michael R. Lyu

Scan-based operations, such as backstage compaction and value filtering, have emerged as the main bottleneck for LSM-Trees in supporting contemporary data-intensive applications. For slower external storage devices, such as HDD and SATA…

Databases · Computer Science 2025-08-19 Jianfeng Huang , Ziyao Wang , Lin Yuan , Jiajie Wen , Yihao Cao , Dongjing Miao , Yong Wang , Jiahao Zhang

The proliferation of camera-enabled devices and large video repositories has led to a diverse set of video analytics applications. These applications rely on video pipelines, represented as DAGs of operations, to transform videos, process…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-31 Francisco Romero , Mark Zhao , Neeraja J. Yadwadkar , Christos Kozyrakis

Data management can be a complex challenge in fields such as bioinformatics and health sciences, which continuously generate extensive heterogeneous datasets. In the context of collaborative global health initiatives, secure storage and…

Software Engineering · Computer Science 2026-05-20 Danilo Silva , Monika Moir , Cheryl Baxter , Tulio de Oliveira , Joicymara Xavier , Marcel Dunaiski

This paper explores resource allocation in serverless cloud computing platforms and proposes an optimization approach for autoscaling systems. Serverless computing relieves users from resource management tasks, enabling focus on application…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-31 Harold Ship , Evgeny Shindin , Chen Wang , Diana Arroyo , Asser Tantawi

We study, formally and experimentally, the trade-off in temporal and spatial overhead when managing contiguous blocks of memory using the explicit, dynamic and real-time heap management system Compact-fit (CF). The key property of CF is…

Programming Languages · Computer Science 2014-04-08 Silviu S. Craciunas , Christoph M. Kirsch , Hannes Payer , Harald Röck , Ana Sokolova

State-of-the-art optimization is steadily shifting towards massively parallel pipelines with extremely large batch sizes. As a consequence, CPU-bound preprocessing and disk/memory/network operations have emerged as new performance…

Machine Learning · Computer Science 2020-10-27 Naman Agarwal , Rohan Anil , Tomer Koren , Kunal Talwar , Cyril Zhang

Vehicle data is essential for advancing data-driven development throughout the automotive lifecycle, including requirements engineering, design, verification, and validation, and post-deployment optimization. Developers currently collect…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Carl Philipp Hohl , Philipp Reis , Tobias Schürmann , Stefan Otten , Eric Sax

Containers are standalone, self-contained units that package software and its dependencies together. They offer lightweight performance isolation, fast and flexible deployment, and fine-grained resource sharing. They have gained popularity…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-12-04 Maria A. Rodriguez , Rajkumar Buyya

The growing scale of large language models (LLMs) has intensified demands on computation and memory, making efficient inference a key challenge. While sparsity can reduce these costs, existing design space exploration (DSE) frameworks often…

Hardware Architecture · Computer Science 2026-03-13 Junyi Wu , Chao Fang , Zhongfeng Wang

Enterprise LLM deployment faces a critical scalability challenge: organizations must optimize models systematically to scale AI initiatives within constrained compute budgets, yet the specialized expertise required for manual optimization…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-29 Nicholas Santavas , Kareem Eissa , Patrycja Cieplicka , Piotr Florek , Matteo Nulli , Stefan Vasilev , Seyyed Hadi Hashemi , Antonios Gasteratos , Shahram Khadivi

Efficient long-context LLM deployment is stalled by a dichotomy between amortized compression, which struggles with out-of-distribution generalization, and Test-Time Training, which incurs prohibitive synthetic data costs and requires…

Machine Learning · Computer Science 2026-02-26 Zeju Li , Yizhou Zhou , Qiang Xu

This article introduces an approach to facilitate cooperative exploration and mapping of large-scale, near-ground, underground, or indoor spaces via a novel integration framework for locally-dense agent map data. The effort targets limited…

Computer Vision and Pattern Recognition · Computer Science 2024-01-15 Kevin M. Brink , Jincheng Zhang , Andrew R. Willis , Ryan E. Sherrill , Jamie L. Godwin

The smooth heap and the closely related slim heap are recently invented self-adjusting implementations of the heap (priority queue) data structure. We analyze the efficiency of these data structures. We obtain the following amortized bounds…

Data Structures and Algorithms · Computer Science 2021-11-08 Corwin Sinnamon , Robert E. Tarjan

With the establishment of cloud computing as the environment of choice for most modern applications, auto-scaling is an economic matter of great importance. For applications like stream computing that process ever changing amounts of data,…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-18 Andre Abrantes D. P. Souza , Marco A. S. Netto

Automated machine learning (AutoML) frameworks have become important tools in the data scientists' arsenal, as they dramatically reduce the manual work devoted to the construction of ML pipelines. Such frameworks intelligently search among…

Machine Learning · Computer Science 2024-12-31 Teddy Lazebnik , Amit Somech , Abraham Itzhak Weinberg