English
Related papers

Related papers: Datom: Towards modular data management

200 papers

The advancement of various research sectors such as Internet of Things (IoT), Machine Learning, Data Mining, Big Data, and Communication Technology has shed some light in transforming an urban city integrating the aforementioned techniques…

Signal Processing · Electrical Eng. & Systems 2019-05-29 Billy Pik Lik Lau , Sumudu Hasala Marakkalage , Yuren Zhou , Naveed Ul Hassan , Chau Yuen , Meng Zhang , U-Xuan Tan

The data warehouse (DW) technology was developed to integrate heterogeneous information sources for analysis purposes. Information sources are more and more autonomous and they often change their content due to perpetual transactions (data…

Databases · Computer Science 2010-12-21 wided oueslati , jalel akaichi

Recent and forthcoming advances in instrumentation, and giant new surveys, are creating astronomical data sets that are not amenable to the methods of analysis familiar to astronomers. Traditional methods are often inadequate not merely…

Instrumentation and Methods for Astrophysics · Physics 2024-01-30 Meyer Z. Pesenson , Isaac Z. Pesenson , Bruce McCollum

Informatics and technological advancements have triggered generation of huge volume of data with varied complexity in its management and analysis. Big Data analytics is the practice of revealing hidden aspects of such data and making…

Databases · Computer Science 2018-03-30 Bikram Karmakar , Indranil Mukhopadhyay

The last decade witnessed an explosion in the availability of data for operations research applications. Motivated by this growing availability, we propose a novel schema for utilizing data to design uncertainty sets for robust optimization…

Optimization and Control · Mathematics 2014-11-25 Dimitris Bertsimas , Vishal Gupta , Nathan Kallus

Data mesh is a socio-technical approach to decentralized analytics data management. To manage this decentralization efficiently, data mesh relies on automation provided by a self-service data infrastructure platform. A key aspect of this…

Databases · Computer Science 2023-07-06 Arif Wider , Sumedha Verma , Atif Akhtar

Equipping agents with memory is essential for solving real-world long-horizon problems. However, most existing agent memory mechanisms rely on static and hand-crafted workflows. This limits the performance and generalization ability of…

Artificial Intelligence · Computer Science 2026-03-30 Yupeng Huo , Yaxi Lu , Zhong Zhang , Haotian Chen , Yankai Lin

In this work, we reflect on the data-driven modeling paradigm that is gaining ground in AI-driven automation of patient care. We argue that the repurposing of existing real-world patient datasets for machine learning may not always…

Biology is at the precipice of a new era where AI accelerates and amplifies the ability to study how cells operate, organize, and work as systems, revealing why disease happens and how to correct it. Organizations globally are prioritizing…

Large language models are redefining software engineering by implementing AI-powered techniques throughout the whole software development process, including requirement gathering, software architecture, code generation, testing, and…

Software Engineering · Computer Science 2024-06-11 Malik Abdul Sami , Muhammad Waseem , Zeeshan Rasheed , Mika Saari , Kari Systä , Pekka Abrahamsson

With new emerging technologies, such as satellites and drones, archaeologists collect data over large areas. However, it becomes difficult to process such data in time. Archaeological data also have many different formats (images, texts,…

Databases · Computer Science 2021-07-26 Pengfei Liu , Sabine Loudcher , Jérôme Darmont , Camille Noûs

In 2010, the concept of data lake emerged as an alternative to data warehouses for big data management. Data lakes follow a schema-on-read approach to provide rich and flexible analyses. However, although trendy in both the industry and…

Databases · Computer Science 2021-09-06 Pegdwendé Sawadogo , Jérôme Darmont , Camille Noûs

Research in data warehousing and OLAP has produced important technologies for the design, management and use of information systems for decision support. With the development of Internet, the availability of various types of data has…

The field of urban spatial-temporal prediction is advancing rapidly with the development of deep learning techniques and the availability of large-scale datasets. However, challenges persist in accessing and utilizing diverse urban…

Machine Learning · Computer Science 2024-03-08 Jiawei Jiang , Chengkai Han , Wayne Xin Zhao , Jingyuan Wang

In an era overwhelmed by vast amounts of data, the effective curation of web-crawl datasets is essential for optimizing model performance. This paper tackles the challenges associated with the unstructured and heterogeneous nature of such…

Machine Learning · Computer Science 2025-06-13 Jinda Xu , Yuhao Song , Daming Wang , Weiwei Zhao , Minghua Chen , Kangliang Chen , Qinya Li

Modern scientific data mainly consist of huge datasets gathered by a very large number of techniques and stored in very diversified and often incompatible data repositories. More in general, in the e-science environment, it is considered as…

Instrumentation and Methods for Astrophysics · Physics 2010-10-20 M. Brescia , G. Longo , F. Pasian

The rapid advancement of large language models (LLMs) has spurred the emergence of data agents, autonomous systems designed to orchestrate Data + AI ecosystems for tackling complex data-related tasks. However, the term "data agent"…

The increasing complexity of IoT applications and the continuous growth in data generated by connected devices have led to significant challenges in managing resources and meeting performance requirements in computing continuum…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-01-22 Sergio Laso , Ilir Murturi , Pantelis Frangoudis , Juan Luis Herrera , Juan M. Murillo , Schahram Dustdar

With the advent of the Data Age, organisations are constantly under pressure to pay attention to the diffusion of data skills, data responsibilities, and management of accessibility to data analysis tools for the technical as well as…

Computers and Society · Computer Science 2022-12-07 Sasari Samarasinghe , Sachithra Lokuge

Nowadays, interest in combining mathematical knowledge about phenomena and data from the physical system is growing. Past research was devoted to developing so-called high-fidelity models, intending to make them able to catch most of the…

Numerical Analysis · Mathematics 2025-02-20 Stefano Riva , Carolina Introini , Antonio Cammi