English
Related papers

Related papers: Statistical Challenges with Massive Data Sets in P…

200 papers

Quantum mechanics---the theory describing the fundamental workings of nature---is famously counterintuitive: it predicts that a particle can be in two places at the same time, and that two remote particles can be inextricably and…

Theoretical particle physicists continue to push the envelope in both high performance computing and in managing and analyzing large data sets. For example, the goals of sub-percent accuracy in predictions of quantum chromodynamics (QCD)…

High Energy Physics - Lattice · Physics 2022-05-13 Rajan Gupta , Tanmoy Bhattacharya , Boram Yoon

Our predictions for particle physics processes are realized in a chain of complex simulators. They allow us to generate high-fidelity simulated data, but they are not well-suited for inference on the theory parameters with observed data. We…

High Energy Physics - Phenomenology · Physics 2020-11-03 Johann Brehmer , Kyle Cranmer

We analyze the notion that physical theories are quantitative and testable by observations in experiments. This leads us to propose a new, Bayesian, interpretation of probabilities in physics that unifies their current use in classical…

Quantum Physics · Physics 2007-05-23 Francis G. Perey

The recent explosion of recorded digital data and its processed derivatives threatens to overwhelm researchers when analysing their experimental data or when looking up data items in archives and file systems. While current hardware…

A varying number of particles is one of the most relevant characteristics of systems of interest in nature and technology, ranging from the exchange of energy and matter with the surrounding environment to the change of particle number…

Mathematical Physics · Physics 2025-10-15 Mauricio J. del Razo , Luigi Delle Site

With increased access to data and the advent of computers, the use of statistical tools and numerical simulations is becoming commonplace for ecologists. These approaches help improve our understanding of ecological phenomena and their…

Other Quantitative Biology · Quantitative Biology 2025-04-08 Maxime Clenet , Maxime Dion , F. Guillaume Blanchet

Numerous challenges persist in High Energy Physics (HEP), the addressing of which requires advancements in detection technology, computational methods, data analysis frameworks, and phenomenological designs. We provide a concise yet…

High Energy Physics - Phenomenology · Physics 2025-03-11 Yaquan Fang , Christina Gao , Ying-Ying Li , Jing Shu , Yusheng Wu , Hongxi Xing , Bin Xu , Lailin Xu , Chen Zhou

This article provides an overview on the statistical modeling of complex data as increasingly encountered in modern data analysis. It is argued that such data can often be described as elements of a metric space that satisfies certain…

Methodology · Statistics 2024-02-28 Paromita Dubey , Yaqing Chen , Hans-Georg Müller

The age of big data has fueled expectations for accelerating learning. The availability of large data sets enables researchers to achieve more powerful statistical analyses and enhances the reliability of conclusions, which can be based on…

Methodology · Statistics 2023-08-22 Ori Becher , Mira Marcus-Kalish , David M. Steinberg

The probabilistic interpretation of quantum mechanics has been a point of discussion since the earliest days of the theory. The development of quantum technologies transfer these discussions from philosophical interest to practical…

Quantum Physics · Physics 2021-01-18 Dale R Hodgson , Vladimir V Kisil

Although not as wide, and popular, as that of quantum mechanics, the investigation of fundamental aspects of statistical mechanics constitutes an important research field in the building of modern physics. Besides the interest for itself,…

Statistical Mechanics · Physics 2025-05-23 Marco Baldovin , Giacomo Gradenigo , Angelo Vulpiani , Nino Zanghì

As experiments advance to record from tens of thousands of neurons, statistical physics provides a framework for understanding how collective activity emerges from networks of fine-scale correlations. While modeling these populations is…

Biological Physics · Physics 2024-12-25 David P. Carcamo , Christopher W. Lynn

Physicists routinely need probabilistic models for a number of tasks such as parameter inference or the generation of new realizations of a field. Establishing such models for highly non-Gaussian fields is a challenge, especially when the…

Data Analysis, Statistics and Probability · Physics 2024-10-07 Sihao Cheng , Rudy Morel , Erwan Allys , Brice Ménard , Stéphane Mallat

This document is a pedagogical introduction to statistics for particle physics. Emphasis is placed on the terminology, concepts, and methods being used at the Large Hadron Collider. The document addresses both the statistical tests applied…

Data Analysis, Statistics and Probability · Physics 2015-03-27 Kyle Cranmer

Sphere packings are essential to the development of physical models for powders, composite materials, and the atomic structure of the liquid state. There is a strong scientific need to be able to assess the fit of packing models to data,…

Methodology · Statistics 2009-10-31 Jeffrey Picka

The success of high energy physics programs relies heavily on accurate detector simulations and beam interaction modeling. The increasingly complex detector geometries and beam dynamics require sophisticated techniques in order to meet the…

We review some aspects of the current state of data-intensive astronomy, its methods, and some outstanding data analysis challenges. Astronomy is at the forefront of "big data" science, with exponentially growing data volumes and data…

Instrumentation and Methods for Astrophysics · Physics 2014-11-04 G. Longo , M. Brescia , S. G. Djorgovski , S. Cavuoti , C. Donalek

Superstatistics is a widely employed tool of non-equilibrium statistical physics which plays an important role in analysis of hierarchical complex dynamical systems. Yet, its "canonical" formulation in terms of a single nuisance parameter…

Statistical Finance · Quantitative Finance 2017-11-10 Petr Jizba , Jan Korbel , Hynek Lavička , Martin Prokš , Václav Svoboda , Christian Beck

Multivariate Analysis is an increasingly common tool in experimental high energy physics; however, many of the common approaches were borrowed from other fields. We clarify what the goal of a multivariate algorithm should be for the search…

Data Analysis, Statistics and Probability · Physics 2014-11-18 Kyle S. Cranmer