English

Should I Hide My Duck in the Lake?

Databases 2026-05-06 v2

Abstract

Data lakes spend a significant fraction of query execution time on scanning data from remote, disaggregated storage. Decoding alone accounts for 46% of runtime when running TPC-H directly on Parquet files. To address this bottleneck, we propose a vision for a data processing SmartNIC for the cloud that sits on the network datapath of compute nodes to offload decoding and pushed-down operators, effectively hiding the cost of parsing raw files. Our experimental estimations with DuckDB suggest that by operating directly on pre-filtered data, as delivered by a SmartNIC, we can significantly increase query processing performance and can still match query throughput of traditional setups with smaller, less expensive CPUs.

Keywords

Cite

@article{arxiv.2602.18775,
  title  = {Should I Hide My Duck in the Lake?},
  author = {Jonas Dann and Gustavo Alonso},
  journal= {arXiv preprint arXiv:2602.18775},
  year   = {2026}
}
R2 v1 2026-07-01T10:45:33.799Z