English
Related papers

Related papers: DAME: A Web Oriented Infrastructure for Scientific…

200 papers

We describe the current state and future plans for a set of tools for scientific data management (SDM) designed to support scientific transparency and reproducible research. SDM has been in active use at our MRI Center for more than two…

Quantitative Methods · Quantitative Biology 2015-02-25 B. A. Wandell , A. Rokem , L. M. Perry , G. Schaefer , R. F. Dougherty

Querying and exploring massive collections of data sources, such as data lakes, has been an essential research topic in the database community. Although many efforts have been paid in the field of data discovery and data integration in data…

Databases · Computer Science 2025-04-04 Jin Wang , Yanlin Feng , Chen Shen , Sajjadur Rahman , Eser Kandogan

The amount of data in the world is expanding rapidly. Every day, huge amounts of data are created by scientific experiments, companies, and end users' activities. These large data sets have been labeled as "Big Data", and their storage,…

Databases · Computer Science 2020-04-29 Mahdi Bohlouli , Frank Schulz , Lefteris Angelis , David Pahor , Ivona Brandic , David Atlan , Rosemary Tate

The Collaborative Analysis Versioning Environment System (CAVES) project concentrates on the interactions between users performing data and/or computing intensive analyses on large data sets, as encountered in many contemporary scientific…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Dimitri Bourilkov

With the rapid adoption of machine learning techniques for large-scale applications in science and engineering comes the convergence of two grand challenges in visualization. First, the utilization of black box models (e.g., deep neural…

The era of data-intensive astronomy is being ushered in with the increasing size and complexity of observational data across wavelength and time domains, the development of algorithms to extract information from this complexity, and the…

Instrumentation and Methods for Astrophysics · Physics 2020-05-20 Mubdi Rahman , Dustin Lang , Renée Hložek , Jo Bovy , Laurence Perreault-Levasseur

Astronomical researchers often think of analysis and visualization as separate tasks. In the case of high-dimensional data sets, though, interactive exploratory data visualization can give far more insight than an approach where data…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Alyssa A. Goodman

Scientific data management is at a critical juncture, driven by exponential data growth, increasing cross-domain dependencies, and a severe reproducibility crisis in modern research. Traditional centralized data management approaches are…

Databases · Computer Science 2025-04-30 Sebastian Beyvers , Jannis Hochmuth , Lukas Brehm , Maria Hansen , Alexander Goesmann , Frank Förster

With the increased interest in computational sciences, machine learning (ML), pattern recognition (PR) and big data, governmental agencies, academia and manufacturers are overwhelmed by the constant influx of new algorithms and techniques…

Software Engineering · Computer Science 2017-07-28 André Anjos , Laurent El-Shafey , Sébastien Marcel

The Galactica simulation database is a platform designed to assist computational astrophysicists with their open science approach based on FAIR (Findable, Accessible, Interoperable, Reusable) principles. It offers the means to publish their…

Instrumentation and Methods for Astrophysics · Physics 2024-11-14 Damien Chapon , Patrick Hennebelle

We present DAVE Aquatic Virtual Environment (DAVE), an open source simulation stack for underwater robots, sensors, and environments. Conventional robotics simulators are not designed to address unique challenges that come with the marine…

Today's astronomical projects need computational systems capable to store and analyze large amounts of scientific data, to effectively share data with other research Institutes and to easily implement information services to present data…

Astrophysics · Physics 2007-05-23 G. Calderone , L. Nicastro

The outcome of the explorative data analysis (EDA) phase is vital for successful data analysis. EDA is more effective when the user interacts with the system used to carry out the exploration. In the recently proposed paradigm of iterative…

Machine Learning · Statistics 2018-04-11 Andreas Henelius , Emilia Oikarinen , Kai Puolamäki

In the last few years, the field of data science has been growing rapidly as various businesses have adopted statistical and machine learning techniques to empower their decision making and applications. Scaling data analysis, possibly…

Databases · Computer Science 2021-02-11 Phanwadee Sinthong , Michael J. Carey

An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…

Instrumentation and Methods for Astrophysics · Physics 2023-05-26 Kana Moriwaki , Takahiro Nishimichi , Naoki Yoshida

Relational databases (DBs) are ideal tools to manage bulky and structured data archives. In particular for Astronomy they can be used to fulfill all the requirements of a complex project, i.e. the management of: documents, software (s/w)…

Astrophysics · Physics 2007-05-23 L. Nicastro , G. Calderone

Conversion of raw data into insights and knowledge requires substantial amounts of effort from data scientists. Despite breathtaking advances in Machine Learning (ML) and Artificial Intelligence (AI), data scientists still spend the…

Artificial Intelligence · Computer Science 2019-09-13 Huseyin Uzunalioglu , Jin Cao , Chitra Phadke , Gerald Lehmann , Ahmet Akyamac , Ran He , Jeongran Lee , Maria Able

Nowadays, scientific databases have become the bread-and-butter of particle physicists. These databases must be maintained and checked repeatedly to insure the accuracy of their content. The COMPETE collaboration aims at motivating data…

The advent of data-driven science in the 21st century brought about the need for well-organized structured data and associated infrastructure able to facilitate the applications of Artificial Intelligence and Machine Learning. We present an…

Databases · Computer Science 2022-03-03 Alexander Zech , Timur Bazhirov

Publicly available data from open sources (e.g., United States Census Bureau (Census), World Health Organization (WHO), Intergovernmental Panel on Climate Change (IPCC)) are vital resources for policy makers, students and researchers across…