English
Related papers

Related papers: On the need for synthetic data and robust data sim…

200 papers

With the increasing penetration of high-frequency sensors across a number of biological and physical systems, the abundance of the resulting observations offers opportunities for higher statistical accuracy of down-stream estimates, but…

Optimization and Control · Mathematics 2020-11-06 Shushu Zhang , Vivak Patel

Measuring inter-dataset similarity is an important task in machine learning and data mining with various use cases and applications. Existing methods for measuring inter-dataset similarity are computationally expensive, limited, or…

Machine Learning · Computer Science 2025-05-06 Muhammad Rajabinasab , Anton D. Lautrup , Arthur Zimek

We describe a new software package for simulating channelised, high-time resolution data streams from radio telescopes. The software simulates data from the telescope and observing system taking into account the observation strategy,…

Instrumentation and Methods for Astrophysics · Physics 2022-05-09 Rui Luo , George Hobbs , Suk Yee Yong , Andrew Zic , Lawrence Toomey , Shi Dai , Alex Dunning , Di Li , Tommy Marshman , Chen Wang , Pei Wang , Shuangqiang Wang , Songbo Zhang

Nowadays simulations can produce petabytes of data to be stored in parallel filesystems or large-scale databases. This data is accessed over the course of decades often by thousands of analysts and scientists. However, storing these volumes…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-11 Salvatore Di Girolamo , Pirmin Schmid , Thomas Schulthess , Torsten Hoefler

Modern studies of societal phenomena rely on the availability of large datasets capturing attributes and activities of synthetic, city-level, populations. For instance, in epidemiology, synthetic population datasets are necessary to study…

Databases · Computer Science 2016-02-26 Hao Wu , Yue Ning , Prithwish Chakraborty , Jilles Vreeken , Nikolaj Tatti , Naren Ramakrishnan

We consider a problem of data integration. Consider determining which genes affect a disease. The genes, which we call predictor objects, can be measured in different experiments on the same individual. We address the question of finding…

Machine Learning · Statistics 2016-10-04 Xin Gao , Raymond J. Carroll

Automating quality inspection with computer vision techniques is often a very data-demanding task. Specifically, supervised deep learning requires a large amount of annotated images for training. In practice, collecting and annotating such…

Computer Vision and Pattern Recognition · Computer Science 2022-02-28 Antoine Cordier , Pierre Gutierrez , Victoire Plessis

In the real world, experimental data are rarely, if ever, distributed as a normal (Gaussian) distribution. As an example, a large set of data--such as the cross sections for particle scattering as a function of energy contained in the…

Data Analysis, Statistics and Probability · Physics 2009-11-11 Martin M. Block

Simulating physical systems is a core component of scientific computing, encompassing a wide range of physical domains and applications. Recently, there has been a surge in data-driven methods to complement traditional numerical simulations…

Machine Learning · Computer Science 2021-08-19 Karl Otness , Arvi Gjoka , Joan Bruna , Daniele Panozzo , Benjamin Peherstorfer , Teseo Schneider , Denis Zorin

In the Earth's magnetosphere, there are fewer than a dozen dedicated probes beyond low-Earth orbit making in-situ observations at any given time. As a result, we poorly understand its global structure and evolution, the mechanisms of its…

Instrumentation and Methods for Astrophysics · Physics 2022-12-29 M. I. Sitnov , G. K. Stephens , V. G. Merkin , C. -P. Wang , D. Turner , K. Genestreti , M. Argall , T. Y. Chen , A. Y. Ukhorskiy , S. Wing , Y. -H. Liu

Simulations play important and diverse roles in statistical workflows, for example, in model specification, checking, validation, and even directly in model inference. Over the past decades, the application areas and overall potential of…

Computation · Statistics 2025-08-27 Paul-Christian Bürkner , Marvin Schmitt , Stefan T. Radev

We consider the problem of combining data from observational and experimental sources to make causal conclusions. This problem is increasingly relevant, as the modern era has yielded passive collection of massive observational datasets in…

Methodology · Statistics 2020-05-19 Evan Rosenman , Guillaume Basse , Art Owen , Michael Baiocchi

Emergence of smartphone and the participatory sensing (PS) paradigm have paved the way for a new variant of pervasive computing. In PS, human user performs sensing tasks and generates notifications, typically in lieu of incentives. These…

Networking and Internet Architecture · Computer Science 2018-08-30 Rajesh P Barnwal , Nirnay Ghosh , Soumya K Ghosh , Sajal K Das

In cosmology, the analysis of observational evidence is very important to test theoretical models of the Universe. Artificial neural networks are powerful and versatile computational tools for data modelling and are recently being…

Cosmology and Nongalactic Astrophysics · Physics 2022-02-15 Juan de Dios Rojas Olvera , Isidro Gómez-Vargas , J. Alberto Vázquez

Estimation of time delays from a noisy and gapped data is one of the simplest data analysis problems in astronomy by its formulation. But as history of real experiments show, the work with observed data sets can be quite complex and…

Instrumentation and Methods for Astrophysics · Physics 2011-05-31 A. Hirv , N. Olspert , J. Pelt

Although simulation represents a major advance in the understanding of problems in complex systems, the field currently does not has standards in place that would guide the reporting of the data underlying each model, the process for model…

Chaotic Dynamics · Physics 2011-12-26 Elias Carvalho , Luciano Andrade , Ricardo Chaim , Ricardo Pietrobon

Sky surveys represent a fundamental data basis for astronomy. We use them to map in a systematic way the universe and its constituents, and to discover new types of objects or phenomena. We review the subject, with an emphasis on the…

Instrumentation and Methods for Astrophysics · Physics 2015-05-20 S. G. Djorgovski , A. A. Mahabal , A. J. Drake , M. J. Graham , C. Donalek

Data analysis is a powerful tool in all experimental sciences. Statistical methods, such as sampling theory, computer technologies necessary for handling large amounts of data, skill in analysing information contained in different types of…

Physics Education · Physics 2012-06-20 Vera Montalbano

Causal inference is essential for developing and evaluating medical interventions, yet real-world medical datasets are often difficult to access due to regulatory barriers. This makes synthetic data a potentially valuable asset that enables…

Machine Learning · Computer Science 2025-10-22 Harry Amad , Zhaozhi Qian , Dennis Frauen , Julianna Piskorz , Stefan Feuerriegel , Mihaela van der Schaar