English
Related papers

Related papers: Machine Learning-based Cardinality Estimation in D…

200 papers

Neural networks require a large amount of annotated data to learn. Meta-learning algorithms propose a way to decrease the number of training samples to only a few. One of the most prominent optimization-based meta-learning algorithms is…

Machine Learning · Computer Science 2022-06-14 Kostiantyn Khabarlak

Density-based clustering is a commonly used tool in data science. Today many data science works are utilizing high-dimensional neural embeddings. However, traditional density-based clustering techniques like DBSCAN have a degraded…

Information Retrieval · Computer Science 2023-02-08 Yifan Wang , Daisy Zhe Wang

Cost and cardinality estimation is vital to query optimizer, which can guide the plan selection. However traditional empirical cost and cardinality estimation techniques cannot provide high-quality estimation, because they cannot capture…

Databases · Computer Science 2019-06-07 Ji Sun , Guoliang Li

In query optimisation accurate cardinality estimation is essential for finding optimal query plans. It is especially challenging for RDF due to the lack of explicit schema and the excessive occurrence of joins in RDF queries. Existing…

Databases · Computer Science 2018-01-22 Xin Wang , Eugene Siow , Aastha Madaan , Thanassis Tiropanis

High-fidelity physics simulations are powerful tools in the design and optimization of charged particle accelerators. However, the computational burden of these simulations often limits their use in practice for design optimization and…

Accelerator Physics · Physics 2020-04-15 Auralee Edelen , Nicole Neveu , Yannick Huber , Mattias Frey , Christopher Mayes , Andreas Adelmann

Dataset complexity assessment aims to predict classification performance on a dataset with complexity calculation before training a classifier, which can also be used for classifier selection and dataset reduction. The training process of…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Guang Li , Ren Togo , Takahiro Ogawa , Miki Haseyama

Since most machine learning (ML) algorithms are designed for numerical inputs, efficiently encoding categorical variables is a crucial aspect in data analysis. A common problem are high cardinality features, i.e. unordered categorical…

Machine Learning · Statistics 2022-03-07 Florian Pargent , Florian Pfisterer , Janek Thomas , Bernd Bischl

In Continual Learning (CL), a model is required to learn a stream of tasks sequentially without significant performance degradation on previously learned tasks. Current approaches fail for a long sequence of tasks from diverse domains and…

Machine Learning · Computer Science 2023-05-29 Iordanis Fostiropoulos , Jiaye Zhu , Laurent Itti

Machine learning (ML) provides algorithms to create computer programs based on data without explicitly programming them. In business process management (BPM), ML applications are used to analyse and improve processes efficiently. Three…

Machine Learning · Computer Science 2024-05-28 Sven Weinzierl , Sandra Zilker , Sebastian Dunzer , Martin Matzner

Monte Carlo simulation is often used for the reliability assessment of power systems, but it converges slowly when the system is complex. Multilevel Monte Carlo (MLMC) can be applied to speed up computation without compromises on model…

Computation · Statistics 2022-07-12 Ensieh Sharifnia , Simon Tindemans

Selectivity estimation - the problem of estimating the result size of queries - is a fundamental problem in databases. Accurate estimation of query selectivity involving multiple correlated attributes is especially challenging. Poor…

Databases · Computer Science 2019-06-19 Shohedul Hasan , Saravanan Thirumuruganathan , Jees Augustine , Nick Koudas , Gautam Das

Query optimizers rely on accurate cardinality estimates to produce good execution plans. Despite decades of research, existing cardinality estimators are inaccurate for complex queries, due to making lossy modeling assumptions and not…

Databases · Computer Science 2020-11-04 Zongheng Yang , Amog Kamsetty , Sifei Luan , Eric Liang , Yan Duan , Xi Chen , Ion Stoica

Graph pattern cardinality estimation is the problem of estimating the number of embeddings of a query graph in a data graph. This fundamental problem arises, for example, during query planning in subgraph matching algorithms. There are two…

Databases · Computer Science 2021-03-29 Kyoungmin Kim , Hyeonji Kim , George Fletcher , Wook-Shin Han

The machine learning (ML) techniques to predict unitarity (UNI) and bounded from below (BFB) constraints in multi-scalar models is employed. The effectiveness of this approach is demonstrated by applying it to the two and three Higgs…

High Energy Physics - Phenomenology · Physics 2024-01-18 Darius Jurčiukonis

Tables stored in databases and tables which are present in web pages and articles account for a large part of semi-structured data that is available on the internet. It then becomes pertinent to develop a modeling approach with large…

Computation and Language · Computer Science 2023-10-03 Soumajyoti Sarkar , Leonard Lausen

To alleviate the cost of regression testing in continuous integration (CI), a large number of machine learning-based (ML-based) test case prioritization techniques have been proposed. However, it is yet unknown how they perform under the…

Software Engineering · Computer Science 2023-11-23 Yifan Zhao , Dan Hao , Lu Zhang

We apply foundation models to data discovery and exploration tasks. Foundation models include large language models (LLMs) that show promising performance on a range of diverse tasks unrelated to their training. We show that these models…

Databases · Computer Science 2024-04-09 Moe Kayali , Anton Lykov , Ilias Fountalis , Nikolaos Vasiloglou , Dan Olteanu , Dan Suciu

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical…

Machine Learning · Computer Science 2024-11-12 Sepanta Zeighami , Cyrus Shahahbi

Learning from the data stored in a database is an important function increasingly available in relational engines. Methods using lower precision input data are of special interest given their overall higher efficiency but, in databases,…

Data Structures and Algorithms · Computer Science 2019-03-29 Zeke Wang , Kaan Kara , Hantian Zhang , Gustavo Alonso , Onur Mutlu , Ce Zhang

Machine learning enables the extraction of useful information from large, diverse datasets. However, despite many successful applications, machine learning continues to suffer from performance and transparency issues. These challenges can…

Machine Learning · Computer Science 2025-07-08 V. C. Storey , J. Parsons , A. Castellanos , M. Tremblay , R. Lukyanenko , W. Maass , A. Castillo