Related papers: New Directions in Data Analysis
The past few years have seen several breakthroughs in particle astrophysics and cosmology. In several cases, new observations can only be explained with the introduction of new fundamental physics. In this talk I summarize some of these…
We present two methods for reducing multidimensional information to one dimension for ease of understand or analysis while maintaining statistical power. While not new, dimensional reduction is not greatly used in high-energy physics and…
The purpose of this paper is to contribute to the challenge of transferring know-how, theories and methods from design research to the design processes in information science and technologies. More specifically, we shall consider a domain,…
The application of machine learning to physics problems is widely found in the scientific literature. Both regression and classification problems are addressed by a large array of techniques that involve learning algorithms. Unfortunately,…
Cosmological measurements of the radiation density in the early universe can be used as a sensitive probe of physics beyond the standard model. Observations of primordial light element abundances have long been used to place non-trivial…
Modern large-scale physics experiments create datasets with sizes and streaming rates that can exceed those from industry leaders such as Google Cloud and Netflix. Fully processing these datasets requires both sufficient compute power and…
The past few years have seen dramatic breakthroughs and spectacular and puzzling discoveries in astrophysics and cosmology. In many cases, the new observations can only be explained with the introduction of new fundamental physics. Here we…
The complexity of collider data analyses has dramatically increased from early colliders to the CERN LHC. Reconstruction of the collision products in the particle detectors has reached a point that requires dedicated publications…
We propose a method to estimate the probability of new physics discovery in future high energy physics experiments. Physics simulation gives both the average numbers <Nb> of background and <Ns> of signal events. We find that the proper…
The accelerating expansion of the universe presents an exciting, fundamental challenge to the standard models of particle physics and cosmology. I highlight some of the outstanding challenges in both developing theoretical models and…
In this new era of large data, it is important to make sure we do not miss any signs of new physics. Using the publicly-available open data collected by the arXiv.org experiment in the \texttt{hep-ph} channel, corresponding to a raw total…
The motion-and-time analysis has been a popular research topic in operations research, especially for analyzing work performances in manufacturing and service operations. It is regaining attention as continuous improvement tools for lean…
In traditional thermodynamical and statistical-mechanical approaches one has (some) detailed knowledge of the principles governing the microdynamics of a system. However in many instances we may not have a Hamiltonian or good information…
Experimental sciences have come to depend heavily on our ability to organize and interpret high-dimensional datasets. Natural laws, conservation principles, and inter-dependencies among observed variables yield geometric structure, with…
In a physical system, changing parameters such as temperature can induce a phase transition: an abrupt change from one state of matter to another. Analogous phenomena have recently been observed in large language models. Typically, the task…
We review the status of, and prospects for, real-time data processing for collider experiments in experimental High Energy Physics. We discuss the historical evolution of data rates and volumes in the field and place them in the context of…
Topological Data Analysis is a recent and fast growing field providing a set of new topological and geometric tools to infer relevant features for possibly complex data. This paper is a brief introduction, through a few selected topics, to…
One of the most striking astrophysical phenomena today is the existence of cosmic ray particles with energies in excess of 10^20 eV. While their presence has been confirmed by a number of experiments, it is not clear where and how these…
This is a personal perspective on data sharing in the context of public data releases suitable for generic analysis. These open data can be a powerful tool for expanding the science of high energy physics, but care must be taken in when,…
Modern astronomy has been rapidly increasing our ability to see deeper into the universe, acquiring enormous samples of cosmic populations. Gaining astrophysical insights from these datasets requires a wide range of sophisticated…