English
Related papers

Related papers: Statistical Challenges with Massive Data Sets in P…

200 papers

The continuous increase of data generated provides enormous possibilities of both public and private companies. The management of this mass of data or big data will play a crucial role in the society of the future, as it finds applications…

Computers and Society · Computer Science 2015-01-15 Fatima El Jamiy , Abderrahmane Daif , Mohamed Azouazi , Abdelaziz Marzak

Modern astronomy has been rapidly increasing our ability to see deeper into the universe, acquiring enormous samples of cosmic populations. Gaining astrophysical insights from these datasets requires a wide range of sophisticated…

Instrumentation and Methods for Astrophysics · Physics 2020-12-11 Eric D. Feigelson , Rafael S. de Souza , Emille E. O. Ishida , Gutti Jogesh Babu

This proceeding covers tools and technologies at our disposal for scientific data preservation and shows that this extends the scientific reach of our experiments. It is cost-efficient to warehouse data from completed experiments on the…

Data Analysis, Statistics and Probability · Physics 2017-12-06 Frank Berghaus

Recent advances in data collection and computational statistics coupled with increases in computer processing power, along with the plunging costs of storage are making technologies to effectively analyze large sets of heterogeneous data…

Cryptography and Security · Computer Science 2015-02-04 Hervais Simo Fhom

Numerical simulations have become an important tool to understand and predict non-perturbative phenomena in particle physics. In this article we attempt to present a general overview over the field. First, the basic concepts of lattice…

High Energy Physics - Lattice · Physics 2010-12-17 F. Karsch , E. Laermann

Nowadays, scientific databases have become the bread-and-butter of particle physicists. These databases must be maintained and checked repeatedly to insure the accuracy of their content. The COMPETE collaboration aims at motivating data…

During the past decades, quantum mechanical methods have undergone an amazing transition from pioneering investigations of experts into a wide range of practical applications, made by a vast community of researchers. First principles…

Chemical Physics · Physics 2016-11-09 Laura E. Ratcliff , Stephan Mohr , Georg Huhs , Thierry Deutsch , Michel Masella , Luigi Genovese

Recently, increasingly large amounts of data are generated from a variety of sources. Existing data processing technologies are not suitable to cope with the huge amounts of generated data. Yet, many research works focus on Big Data, a…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-06-07 Wissem Inoubli , Sabeur Aridhi , Haithem Mezni , Mondher Maddouri , Engelbert Mephu Nguifo

The molecular biology revolution of the last seventy five years has transformed our view of living systems. Scientific explanations of biological phenomena are now synonymous with the identification of the genes, proteins, and signaling…

Biological Physics · Physics 2024-10-29 Pankaj Mehta

Technological innovations have revolutionized the process of scientific research and knowledge discovery. The availability of massive data and challenges from frontiers of research and development have reshaped statistical thinking, data…

Statistics Theory · Mathematics 2007-06-13 Jianqing Fan , Runze Li

In almost every scientific field, an experiment involves collecting data and then analysing it. The analysis stage will often consist in trying to extract some physical parameter and estimating its uncertainty; this is known as Parameter…

Data Analysis, Statistics and Probability · Physics 2015-06-12 Louis Lyons

Over the last 20+ years, experimentalists have presented tantalizing hints of physics beyond the standard model, but nothing definitive. With the wealth of data from experiments, in particular the collider experiments, it is imperative that…

High Energy Physics - Phenomenology · Physics 2022-08-18 Matt Bellis , Brian Shuve , Anna Barth , Andres Cook

Technology is generating a huge and growing availability of observa tions of diverse nature. This big data is placing data learning as a central scientific discipline. It includes collection, storage, preprocessing, visualization and,…

Other Statistics · Statistics 2018-06-12 José L. Torrecilla , Juan Romo

In this paper we consider some of the issues of working with big data and big spatial data and highlight the need for an open and critical framework. We focus on a set of challenges underlying the collection and analysis of big data. In…

Computers and Society · Computer Science 2020-08-12 Chris Brunsdon , Alexis Comber

Uncertainty is an important and fundamental concept in physics education. Students are often first exposed to uncertainty in introductory labs, expand their knowledge across lab courses, and then are introduced to quantum mechanical…

Physics Education · Physics 2023-06-30 Andy Schang , Matthew Dew , Emily M. Stump , N. G. Holmes , Gina Passante

When very small particles are suspended in a fluid in motion, they tend to follow the flow. How such tracer particles are mixed, transported, and dispersed by turbulent flow has been successfully described by statistical models. Heavy…

Fluid Dynamics · Physics 2023-12-21 J. Bec , K. Gustavsson , B. Mehlig

In High Energy Physics (HEP), analysis metadata comes in many forms -- from theoretical cross-sections, to calibration corrections, to details about file processing. Correctly applying metadata is a crucial and often time-consuming step in…

The analysis of multiparticle quantum states is a central problem in quantum information processing. This task poses several challenges for experimenters and theoreticians. We give an overview over current problems and possible solutions…

Quantum Physics · Physics 2016-11-28 Otfried Gühne , Matthias Kleinmann , Tobias Moroder

As observational datasets become larger and more complex, so too are the questions being asked of these data. Data simulations, i.e., synthetic data with properties (pixelization, noise, PSF, artifacts, etc.) akin to real data, are…

Instrumentation and Methods for Astrophysics · Physics 2019-10-25 Molly S. Peeples , Bjorn Emonts , Mark Kyprianou , Matthew T. Penny , Gregory F. Snyder , Christopher C. Stark , Michael Troxel , Neil T. Zimmerman , John ZuHone

Recent experimental advances in neuroscience have opened new vistas into the immense complexity of neuronal networks. This proliferation of data challenges us on two parallel fronts. First, how can we form adequate theoretical frameworks…

Neurons and Cognition · Quantitative Biology 2015-06-12 Madhu Advani , Subhaneil Lahiri , Surya Ganguli