English
Related papers

Related papers: Data-Driven High-Dimensional Statistical Inference…

200 papers

A key step in any resonant anomaly detection search is accurate modeling of the background distribution in each signal region. Data-driven methods like CATHODE accomplish this by training separate generative models on the complement of each…

High Energy Physics - Phenomenology · Physics 2025-04-08 Ranit Das , David Shih

Diffusion generative models have excelled at diverse image generation and reconstruction tasks across fields. A less explored avenue is their application to discriminative tasks involving regression or classification problems. The…

Cosmology and Nongalactic Astrophysics · Physics 2025-02-26 Nayantara Mudur , Carolina Cuesta-Lazaro , Douglas P. Finkbeiner

Spatial profiling technologies in biology, such as imaging mass cytometry (IMC) and spatial transcriptomics (ST), generate high-dimensional, multi-channel data with strong spatial alignment and complex inter-channel relationships.…

Machine Learning · Computer Science 2025-07-08 Haoran Zhang , Mingyuan Zhou , Wesley Tansey

Generative diffusion models show promise for data augmentation. However, applying them to fine-grained tasks presents a significant challenge: ensuring synthetic images accurately capture the subtle, category-defining features critical for…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Zhiguang Lu , Qianqian Xu , Peisong Wen , Siran Dai , Qingming Huang

This paper presents a novel method for statistical inference in high-dimensional binary models with unspecified structure, where we leverage a (potentially misspecified) sparsity-constrained working generalized linear model (GLM) to…

Methodology · Statistics 2025-10-03 Xiaotian Hou , Peng Wang , Minge Xie , Linjun Zhang

Statistical inference is the science of drawing conclusions about some system from data. In modern signal processing and machine learning, inference is done in very high dimension: very many unknown characteristics about the system have to…

Disordered Systems and Neural Networks · Physics 2020-10-29 Jean Barbier

Statistical inference in physics is often based on samples from a generator (sometimes referred to as a ``forward model") that emulate experimental data and depend on parameters of the underlying theory. Modern machine learning has…

High Energy Physics - Phenomenology · Physics 2025-06-03 Chi Lung Cheng , Ranit Das , Runze Li , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , David Shih , Gup Singh

Linear mixed models (LMMs) are a popular class of methods for analyzing longitudinal and clustered data. However, such models can be sensitive to outliers, and this can lead to biased inference on model parameters and inaccurate prediction…

Methodology · Statistics 2025-03-28 Shonosuke Sugasawa , Francis K. C. Hui , Alan H. Welsh

Recent research has proven neural networks to be a powerful tool for performing hyperspectral imaging (HSI) target identification. However, many deep learning frameworks deliver a single material class prediction and operate on a per-pixel…

Machine Learning · Computer Science 2025-08-14 Joshua R. Tempelman , Kevin Mitchell , Adam J. Wachtor , Eric B. Flynn

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the…

High Energy Physics - Phenomenology · Physics 2022-11-10 Ernesto Arganda , Xabier Marcano , Víctor Martín Lozano , Anibal D. Medina , Andres D. Perez , Manuel Szewc , Alejandro Szynkman

This paper presents a selective survey of recent developments in statistical inference and multiple testing for high-dimensional regression models, including linear and logistic regression. We examine the construction of confidence…

Methodology · Statistics 2023-01-26 T. Tony Cai , Zijian Guo , Yin Xia

In recent years fully-parametric fast simulation methods based on generative models have been proposed for a variety of high-energy physics detectors. By their nature, the quality of data-driven models degrades in the regions of the phase…

Machine Learning · Computer Science 2023-03-03 Lucio Anderlini , Constantine Chimpoesh , Nikita Kazeev , Agata Shishigina

Our predictions for particle physics processes are realized in a chain of complex simulators. They allow us to generate high-fidelity simulated data, but they are not well-suited for inference on the theory parameters with observed data. We…

High Energy Physics - Phenomenology · Physics 2020-11-03 Johann Brehmer , Kyle Cranmer

Efficiently analyzing maps from upcoming large-scale surveys requires gaining direct access to a high-dimensional likelihood and generating large-scale fields with high fidelity, which both represent major challenges. Using CAMELS…

Cosmology and Nongalactic Astrophysics · Physics 2023-11-03 Sultan Hassan , Sambatra Andrianomena

Hyperspectral Image (HSI) classification is an important issue in remote sensing field with extensive applications in earth science. In recent years, a large number of deep learning-based HSI classification methods have been proposed.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Ning Chen , Jun Yue , Leyuan Fang , Shaobo Xia

The rapid growth of high-dimensional datasets across various scientific domains has created a pressing need for new statistical methods to compare distributions supported on their underlying structures. Assessing similarity between datasets…

Statistics Theory · Mathematics 2025-11-27 Hongrui Chen , Rong Ma

Classifying hyperspectral images is a difficult task in remote sensing, due to their complex high-dimensional data. To address this challenge, we propose HSIMamba, a novel framework that uses bidirectional reversed convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Judy X Yang , Jun Zhou , Jing Wang , Hui Tian , Alan Wee Chung Liew

Interpretable classification of time series presents significant challenges in high dimensions. Traditional feature selection methods in the frequency domain often assume sparsity in spectral density matrices (SDMs) or their inverses, which…

Machine Learning · Statistics 2024-08-19 Sarbojit Roy , Malik Shahid Sultan , Hernando Ombao

The rapid adoption of synthetic data for training Large Language Models (LLMs) has introduced the technical challenge of "model collapse"-a degenerative process where recursive training on model-generated content leads to a contraction of…

Machine Learning · Computer Science 2026-03-24 Yi Gu , Lingyou Pang , Xiangkun Ye , Tianyu Wang , Jianyu Lin , Carey E. Priebe , Alexander Aue

Most of the fundamental, emergent, and phenomenological parameters of particle and nuclear physics are determined through parametric template fits. Simulations are used to populate histograms which are then matched to data. This approach is…

High Energy Physics - Phenomenology · Physics 2025-03-12 Benjamin Sluijter , Sascha Diefenbacher , Wahid Bhimji , Benjamin Nachman
‹ Prev 1 2 3 10 Next ›