English
Related papers

Related papers: Spatial Parquet: A Column File Format for Geospati…

200 papers

Many services today massively and continuously produce log files of different and varying formats. These logs are important since they contain information about the application activities, which is necessary for improvements by analyzing…

Information Retrieval · Computer Science 2023-04-11 Igor Cherepanov , Jonathan Geraldi Joewono , Arjan Kuijper , Jörn Kohlhammer

This paper focuses on the application of Spatial Data mining Techniques to efficiently manage the challenges faced by peripheral rural areas in analyzing and predicting market scenario and better manage their economy. Spatial data mining is…

Databases · Computer Science 2013-03-05 V. R. Kanagavalli , K. Raja

Random column sampling is not guaranteed to yield data sketches that preserve the underlying structures of the data and may not sample sufficiently from less-populated data clusters. Also, adaptive sampling can often provide accurate low…

Machine Learning · Computer Science 2017-10-11 Mostafa Rahmani , George Atia

We revisit column-oriented storage and query processing techniques in the context of contemporary graph database management systems (GDBMSs). Similar to column-oriented RDBMSs, GDBMSs support read-heavy analytical workloads that however…

Databases · Computer Science 2021-10-29 Pranjal Gupta , Amine Mhedhbi , Semih Salihoglu

In the modern era, large volumes of data are being produced continuously, especially in domain-specific fields such as medical records and clinical files, defence logs and HTML-based web traffic. Data with such volume and complexity needs…

Information Retrieval · Computer Science 2025-08-21 Anurag Kumar Ojha

Data warehouses organize data in a columnar format to enable faster scans and better compression. Modern systems offer a variety of column encodings that can reduce storage footprint and improve query performance. Selecting a good encoding…

Databases · Computer Science 2021-05-20 Lujing Cen , Andreas Kipf , Ryan Marcus , Tim Kraska

Modern RDBMSs support the ability to compress data using methods such as null suppression and dictionary encoding. Data compression offers the promise of significantly reducing storage requirements and improving I/O performance for decision…

Databases · Computer Science 2011-09-06 Hideaki Kimura , Vivek Narasayya , Manoj Syamala

LiDAR devices obtain a 3D representation of a space. Due to the large size of the resulting datasets, there already exist storage methods that use compression and present some properties that resemble those of compact data structures.…

Data Structures and Algorithms · Computer Science 2019-12-30 Susana Ladra , Miguel R. Luaces , José R. Paramá , Fernando Silva-Coira

Modern in-memory databases are typically used for high-performance workloads, therefore they have to be optimized for small memory footprint and high query speed at the same time. Data compression has the potential to reduce memory…

Databases · Computer Science 2022-09-07 Marcell Fehér , Daniel E. Lucani , Ioannis Chatzigeorgiou

Data skipping reduces I/O for SQL queries by skipping over irrelevant data objects (files) based on their metadata. We extend this notion by allowing developers to define their own data skipping metadata types and indexes using a flexible…

Databases · Computer Science 2020-11-17 Paula Ta-Shma , Guy Khazma , Gal Lushi , Oshrit Feder

Storing tabular data to balance storage and query efficiency is a long-standing research question in the database community. In this work, we argue and show that a novel DeepMapping abstraction, which relies on the impressive memorization…

Databases · Computer Science 2024-09-27 Lixi Zhou , K. Selçuk Candan , Jia Zou

Recently, immersive media and autonomous driving applications have significantly advanced through 3D Gaussian Splatting (3DGS), which offers high-fidelity rendering and computational efficiency. Despite these advantages, 3DGS as a…

Graphics · Computer Science 2025-05-27 Kangli Wang , Shihao Li , Qianxi Yi , Wei Gao

With the ever-increasing dataset sizes, several file formats like Parquet, ORC, and Avro have been developed to store data efficiently and to save network and interconnect bandwidth at the price of additional CPU utilization. However, with…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-05-24 Jayjeet Chakraborty , Ivo Jimenez , Sebastiaan Alvarez Rodriguez , Alexandru Uta , Jeff LeFevre , Carlos Maltzahn

3D Gaussian Splatting is a recognized method for 3D scene representation, known for its high rendering quality and speed. However, its substantial data requirements present challenges for practical applications. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Soonbin Lee , Fangwen Shu , Yago Sanchez , Thomas Schierl , Cornelius Hellge

Many scientific applications opt for particles instead of meshes as their basic primitives to model complex systems composed of billions of discrete entities. Such applications span a diverse array of scientific domains, including molecular…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-11-04 Longtao Zhang , Ruoyu Li , Congrong Ren , Sheng Di , Jinyang Liu , Jiajun Huang , Robert Underwood , Pascal Grosset , Dingwen Tao , Xin Liang , Hanqi Guo , Franck Capello , Kai Zhao

The importance of geo-spatial data in critical applications such as emergency response, transportation, agriculture etc., has prompted the adoption of recent GeoSPARQL standard in many RDF processing engines. In addition to large…

Databases · Computer Science 2017-10-23 Jyoti Leeka , Srikanta Bedathur , Debajyoti Bera , Sriram Lakshminarasimhan

Recently, MapReduce based spatial query systems have emerged as a cost effective and scalable solution to large scale spatial data processing and analytics. MapReduce based systems achieve massive scalability by partitioning the data and…

Databases · Computer Science 2015-09-04 Ablimit Aji , Vo Hoang , Fusheng Wang

We introduce a compressed data structure for the storage of free trajectories of moving objects (such as ships and planes) that efficiently supports various spatio-temporal queries. Our structure, dubbed GraCT, stores the absolute positions…

Data Structures and Algorithms · Computer Science 2019-11-12 Nieves R. Brisaboa , Adrián Gómez-Brandón , Gonzalo Navarro , José R. Paramá

In scientific simulations, observations, and experiments, the cost of transferring data to and from disk and across networks has become a significant bottleneck that particularly impacts subsequent data analysis and visualization. To…

Databases · Computer Science 2023-08-24 Victor A. P. Magri , Peter Lindstrom

Computing over compressed data combines the space saving of data compression with efficient support for queries directly on the compressed representation. Such data structures are widely applied in text indexing and have been successfully…

Data Structures and Algorithms · Computer Science 2025-06-27 Ziad Ismaili Alaoui , Namrata , Sebastian Wild