English
Related papers

Related papers: INGESTBASE: A Declarative Data Ingestion System

200 papers

Data Mining is the process of extracting useful patterns from the huge amount of database and many data mining techniques are used for mining these patterns. Recently, one of the remarkable facts in higher educational institute is the rapid…

Artificial Intelligence · Computer Science 2014-05-16 Priyanka Saini

Index structures are important for efficient data access, which have been widely used to improve the performance in many in-memory systems. Due to high in-memory overheads, traditional index structures become difficult to process the…

Databases · Computer Science 2019-05-16 Pengfei Li , Yu Hua , Pengfei Zuo , Jingnan Jia

Recent years have seen massive time-series data generated in many areas. This different scenario brings new challenges, particularly in terms of data ingestion, where existing technologies struggle to handle such massive time-series data,…

Databases · Computer Science 2024-06-11 Shuhui Wang , Zihan Sun , Chaochen Hu , Chao Li , Yong Zhang , Yandong Yao , Hao Wang , Chunxiao Xing

Pretraining data selection has the potential to improve language model pretraining efficiency by utilizing higher-quality data from massive web data corpora. Current data selection methods, which rely on either hand-crafted rules or larger…

Computation and Language · Computer Science 2024-11-19 Zichun Yu , Spandan Das , Chenyan Xiong

Over the past few decades, the amount of scientific articles and technical literature has increased exponentially in size. Consequently, there is a great need for systems that can ingest these documents at scale and make their content…

Digital Libraries · Computer Science 2018-05-25 Peter W J Staar , Michele Dolfi , Christoph Auer , Costas Bekas

Currently, the construction of large language models in specific domains is done by fine-tuning on a base model. Some models also incorporate knowledge bases without the need for pre-training. This is because the base model already contains…

Computation and Language · Computer Science 2023-08-22 Zhixiao Qi , Yijiong Yu , Meiqi Tu , Junyi Tan , Yongfeng Huang

In the age of big data, information security has become a major issue of debate, especially with the rise of the Internet of Things (IoT), where attackers can effortlessly obtain physical access to edge devices. The hash algorithm is the…

Cryptography and Security · Computer Science 2022-08-17 Jingyao Zhang , Elaheh Sadredini

One of the purposes of Big Data systems is to support analysis of data gathered from heterogeneous data sources. Since data warehouses have been used for several decades to achieve the same goal, they could be leveraged also to provide…

Databases · Computer Science 2018-09-13 Darja Solodovnikova , Laila Niedrite

We are living in the era of Big Data and witnessing the explosion of data. Given that the limitation of CPU and I/O in a single computer, the mainstream approach to scalability is to distribute computations among a large number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-07-27 Bingbing Rao , Liqiang Wang

The popularity of business intelligence (BI) systems to support business analytics has tremendously increased in the last decade. The determination of data items that should be stored in the BI system is vital to ensure the success of an…

General Economics · Economics 2020-12-29 Tom Pape

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

Machine Learning · Computer Science 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

As declarative query processing techniques expand in scope --- to the Web, data streams, network routers, and cloud platforms --- there is an increasing need for adaptive query processing techniques that can re-plan in the presence of…

Databases · Computer Science 2014-09-23 Mengmeng Liu , Zachary G. Ives , Boon Thau Loo

Exploring data requires a fast feedback loop from the analyst to the system, with a latency below about 10 seconds because of human cognitive limitations. When data becomes large or analysis becomes complex, sequential computations can no…

Human-Computer Interaction · Computer Science 2016-07-19 Jean-Daniel Fekete , Romain Primet

Linear constrained optimization techniques have been applied to many real-world settings. In recent years, inferring the unknown parameters and functions inside an optimization model has also gained traction. This inference is often based…

Optimization and Control · Mathematics 2020-10-16 Farzin Ahmadi , Fardin Ganjkhanloo , Kimia Ghobadi

Food instance segmentation is essential to estimate the serving size of dishes in a food image. The recent cutting-edge techniques for instance segmentation are deep learning networks with impressive segmentation quality and fast…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Huu-Thanh Nguyen , Yu Cao , Chong-Wah Ngo , Wing-Kwong Chan

Workloads that comb through vast amounts of data are gaining importance in the sciences. These workloads consist of "needle in a haystack" queries that are long running and data intensive so that query throughput limits performance. To…

Databases · Computer Science 2009-09-15 Xiaodan Wang , Randal Burns , Tanu Malik

The area of declarative data analytics explores the application of the declarative paradigm on data science and machine learning. It proposes declarative languages for expressing data analysis tasks and develops systems which optimize…

Databases · Computer Science 2019-02-05 Nantia Makrynioti , Vasilis Vassalos

Delivering effective data analytics is of crucial importance to the interpretation of the multitude of biological datasets currently generated by an ever increasing number of high throughput techniques. Logic programming has much to offer…

Logic in Computer Science · Computer Science 2019-09-19 Nicos Angelopoulos , Jan Wielemaker

The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage,…

Databases · Computer Science 2020-04-29 Mahdi Bohlouli , Frank Schulz , Lefteris Angelis , David Pahor , Ivona Brandic , David Atlan , Rosemary Tate

We propose a novel framework to facilitate the on-demand design of data-centric systems by exploiting domain knowledge from an existing ontology. Its key ingredient is a process that we call focusing, which allows to obtain a schema for a…

Logic in Computer Science · Computer Science 2019-04-02 Tomasz Gogacz , Víctor Gutiérrez-Basulto , Yazmín A. Ibáñez-García , Filip Murlak , Magdalena Ortiz , Mantas Šimkus