English
Related papers

Related papers: Creating and Querying Data Cubes in Python using p…

200 papers

Data generation is a key issue in big data benchmarking that aims to generate application-specific data sets to meet the 4V requirements of big data. Specifically, big data generators need to generate scalable data (Volume) of different…

Databases · Computer Science 2014-02-28 Zijian Ming , Chunjie Luo , Wanling Gao , Rui Han , Qiang Yang , Lei Wang , Jianfeng Zhan

Python is a particularly appealing language to carry out data analysis, owing in part to its user-friendly character as well as its access to well maintained and powerful libraries like NumPy and SciPy. Still, for the purpose of analyzing…

High Energy Physics - Lattice · Physics 2024-02-01 Luis Altenkort , David Anthony Clarke , Jishnu Goswami , Hauke Sandmeyer

Data users need relevant context and research expertise to effectively search for and identify relevant datasets. Leading data providers, such as the Inter-university Consortium for Political and Social Research (ICPSR), offer standardized…

Information Retrieval · Computer Science 2023-05-31 Lizhou Fan , Sara Lafia , Lingyao Li , Fangyuan Yang , Libby Hemphill

Developing new ideas and algorithms in the fields of graph processing and relational learning requires public datasets. While Wikidata is the largest open source knowledge graph, involving more than fifty million entities, it is larger than…

Machine Learning · Computer Science 2019-10-07 Armand Boschin , Thomas Bonald

Managing the data for Information Retrieval (IR) experiments can be challenging. Dataset documentation is scattered across the Internet and once one obtains a copy of the data, there are numerous different data formats to work with. Even…

Information Retrieval · Computer Science 2021-05-11 Sean MacAvaney , Andrew Yates , Sergey Feldman , Doug Downey , Arman Cohan , Nazli Goharian

Numerical stability is a crucial requirement of reliable scientific computing. However, despite the pervasiveness of Python in data science, analyzing large Python programs remains challenging due to the lack of scalable numerical analysis…

Mathematical Software · Computer Science 2024-10-28 Yohan Chatelain , Nigel Yong , Gregory Kiar , Tristan Glatard

While classical skyline queries identify interesting data within large datasets, flexible skylines introduce preferences through constraints on attribute weights, and further reduce the data returned. However, computing these queries can be…

Databases · Computer Science 2025-01-08 Emilio De Lorenzis , Davide Martinenghi

We find ourselves on the brink of an exciting era in observational astrophysics, driven by groundbreaking facilities like JWST, Euclid, Rubin, Roman, SKA, or ELT. Simultaneously, computational astrophysics has shown significant strides,…

Over the past 40 years, database management systems (DBMSs) have evolved to provide a sophisticated variety of data management capabilities. At the same time, tools for managing queries over the data have remained relatively primitive. One…

Databases · Computer Science 2009-09-15 Nodira Khoussainova , Magda Balazinska , Wolfgang Gatterbauer , YongChul Kwon , Dan Suciu

Process mining, i.e., a sub-field of data science focusing on the analysis of event data generated during the execution of (business) processes, has seen a tremendous change over the past two decades. Starting off in the early 2000's, with…

Software Engineering · Computer Science 2019-05-16 Alessandro Berti , Sebastiaan J. van Zelst , Wil van der Aalst

Laboratory scientists are well equipped with statistical tools for univariate data, yet many phenomena of scientific interest are time-variant or otherwise multidimensional. Functional data analysis is one way of approaching such data: by…

Computation · Statistics 2023-02-28 Julian Lehrer , Mircea Teodorescu , Yohei Rosen

This document serves to complement our website which was developed with the aim of exposing the students to Gaussian Processes (GPs). GPs are non-parametric Bayesian regression models that are largely used by statisticians and geospatial…

Machine Learning · Computer Science 2018-09-07 Kshitij Tiwari

Research ideation requires navigating trade-offs across multiple evaluative dimensions, yet most AI-assisted ideation tools leave this multi-dimensional reasoning unsupported, or reducing evaluation to unipolar scales where "more is…

Human-Computer Interaction · Computer Science 2026-04-14 Zijian Ding , Fenghai Li , Ziyi Wang , Joel Chan

Automated code generation is gaining significant importance in intelligent computer programming and system deployment. However, current approaches often face challenges in computational efficiency and lack robust mechanisms for code parsing…

Software Engineering · Computer Science 2025-06-24 Muntasir Adnan , Zhiwei Xu , Carlos C. N. Kuhn

Development of scientific software involves tradeoffs between ease of use, generality, and performance. We describe the design of a general hyperbolic PDE solver that can be operated with the convenience of MATLAB yet achieves efficiency…

Exploratory visual data analysis tools empower data analysts to efficiently and intuitively explore data insights throughout the entire analysis cycle. However, the gap between common programmatic analysis (e.g., within computational…

Human-Computer Interaction · Computer Science 2025-01-08 Yue Yu , Leixian Shen , Fei Long , Huamin Qu , Hao Chen

Software that processes real-world data or that models a physical system must have some way of managing units. While simple approaches like the understood convention that all data are in a unit system (such as the MKS SI unit system) do…

Instrumentation and Methods for Astrophysics · Physics 2018-10-03 Nathan J. Goldbaum , John A. ZuHone , Matthew J. Turk , Kacper Kowalik , Anna L. Rosen

High-Content Digital Microscopy enhances user comfort, data storage and analysis throughput, paving the way to new researches and medical diagnostics. A digital microscopy platform aims at capturing an image of a cover slip, at storing…

Computational Engineering, Finance, and Science · Computer Science 2014-04-30 Fabrice Salvaire

Synthetic data is essential for assessing clustering techniques, complementing and extending real data, and allowing for more complete coverage of a given problem's space. In turn, synthetic data generators have the potential of creating…

Machine Learning · Computer Science 2024-03-06 Nuno Fachada , Diogo de Andrade

Scientific workflows automate the analysis of large-scale scientific data, fostering the reuse of data processing operators as well as the reproducibility and traceability of analysis results. In exploratory research, however, workflows are…

Other Computer Science · Computer Science 2023-09-26 Sebastian Pohl , Nourhan Elfaramawy , Kedi Cao , Birte Kehr , Matthias Weidlich