English
Related papers

Related papers: BDGS: A Scalable Big Data Generator Suite in Big D…

200 papers

There are now over 20 commercial vector database management systems (VDBMSs), all produced within the past five years. But embedding-based retrieval has been studied for over ten years, and similarity search a staggering half century and…

Databases · Computer Science 2023-10-24 James Jie Pan , Jianguo Wang , Guoliang Li

We propose Data Swarms, an algorithm to optimize the generation of synthetic evaluation data and advance quantitative desiderata of LLM evaluation. We first train a swarm of initial data generators using existing data, and define various…

Computation and Language · Computer Science 2025-06-09 Shangbin Feng , Yike Wang , Weijia Shi , Yulia Tsvetkov

The last years have seen a steep rise in data generation worldwide, with the development and widespread adoption of several software projects targeting the Big Data paradigm. Many companies currently engage in Big Data analytics as part of…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-05-25 Michele Ciavotta , Eugenio Gianniti , Danilo Ardagna

Autonomous driving progress relies on large-scale annotated datasets. In this work, we explore the potential of generative models to produce vast quantities of freely-labeled data for autonomous driving applications and present…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Binyuan Huang , Yuqing Wen , Yucheng Zhao , Yaosi Hu , Yingfei Liu , Fan Jia , Weixin Mao , Tiancai Wang , Chi Zhang , Chang Wen Chen , Zhenzhong Chen , Xiangyu Zhang

Various tools, softwares and systems are proposed and implemented to tackle the challenges in big data on different emphases, e.g., data analysis, data transaction, data query, data storage, data visualization, data privacy. In this paper,…

Databases · Computer Science 2018-10-23 Yao Wu , Henan Guan

Confidentiality hinders the publication of authentic, labeled datasets of personal and enterprise data, although they could be useful for evaluating knowledge graph construction approaches in industrial scenarios. Therefore, our plan is to…

Databases · Computer Science 2021-08-02 Markus Schröder , Christian Jilek , Andreas Dengel

In Big data era, information integration often requires abundant data extracted from massive data sources. Due to a large number of data sources, data source selection plays a crucial role in information integration, since it is costly and…

Databases · Computer Science 2016-11-01 Yiming Lin , Hongzhi Wang , Jianzhong Li , Hong Gao

Scalable Vector Graphics (SVG) is widely used in front-end development and UI/UX design due to its scalability, editability, and rendering efficiency. However, turning creative ideas into precise vector graphics remains a time-consuming…

Machine Learning · Computer Science 2025-08-14 Feiyu Wang , Zhiyuan Zhao , Yuandong Liu , Da Zhang , Junyu Gao , Hao Sun , Xuelong Li

Continuous dynamical systems, characterized by differential equations, are ubiquitously used to model several important problems: plasma dynamics, flow through porous media, weather forecasting, and epidemic dynamics. Recently, a wide range…

Machine Learning · Computer Science 2023-10-04 Priyanshu Burark , Karn Tiwari , Meer Mehran Rashid , Prathosh A P , N M Anoop Krishnan

The term, Big Data, has been authored to refer to the extensive heave of data that can't be managed by traditional data handling methods or techniques. The field of Big Data plays an indispensable role in various fields, such as…

Computers and Society · Computer Science 2017-10-12 Mashooque Ahmed Memon , Safeeullah Soomro , Awais Khan Jumani , Muneer Ahmed Kartio

The rapid growth of Large Language Models (LLMs) and AI-driven applications has propelled Vector Database Management Systems (VDBMSs) into the spotlight as a critical infrastructure component. VDBMS specializes in storing, indexing, and…

Software Engineering · Computer Science 2025-03-03 Shenao Wang , Yanjie Zhao , Yinglin Xie , Zhao Liu , Xinyi Hou , Quanchen Zou , Haoyu Wang

Distributed ledgers are a new type of database technology that allows open access to data stored across distributed, decentralised, publicly maintained infrastructures. Current implementations of the such ledgers expect competition between…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-04-21 Phani Chitti

In many Big Data applications today, information needs to be actively shared between systems managed by different organizations. To enable sharing Big Data at scale, developers would have to create dedicated server programs and glue…

Databases · Computer Science 2021-01-07 Xikui Wang , Michael J. Carey , Vassilis J. Tsotras

Data is the lifeblood of the modern world, forming a fundamental part of AI, decision-making, and research advances. With increase in interest in data, governments have taken important steps towards a regulated data world, drastically…

Cryptography and Security · Computer Science 2024-06-11 Sikha Pentyala , Mayana Pereira , Martine De Cock

This paper proposes three different data generators, tailored to transactional datasets, based on existing itemset-based generative models. All these generators are intuitive and easy to implement and show satisfactory performance. The…

Databases · Computer Science 2020-07-15 Christian Lezcano , Marta Arias

Today, data is being actively generated by a variety of devices, services, and applications. Such data is important not only for the information that it contains, but also for its relationships to other data and to interested users. Most…

Databases · Computer Science 2020-09-11 Xikui Wang , Michael J. Carey , Vassilis J. Tsotras

While synthetic data hold great promise for privacy protection, their statistical analysis poses significant challenges that necessitate innovative solutions. The use of deep generative models (DGMs) for synthetic data generation is known…

The proliferation of datasets across open data portals and enterprise data lakes presents an opportunity for deriving data-driven insights. Widely-used dataset search systems rely on keyword search over dataset metadata, including…

Databases · Computer Science 2025-12-19 Haoxiang Zhang , Yurong Liu , Aécio Santos , Wei-Lun Hung , Juliana Freire

In open-source software development environments; textual, numerical and relationship-based data generated are of interest to researchers. Various data sets are available for this data, which is frequently used in areas such as software…

Software Engineering · Computer Science 2020-10-01 Abdulkadir Şeker , Banu Diri , Halil Arslan

As storage systems become increasingly heterogeneous and complex, it adds burdens on DBAs, causing suboptimal performance even after a lot of human efforts have been made. In addition, existing monitoring-based storage management by access…

Databases · Computer Science 2012-07-03 Tian Luo , Rubao Lee , Michael Mesnier , Feng Chen , Xiaodong Zhang