English
Related papers

Related papers: Dealing with Nuisance Parameters using Machine Lea…

200 papers

Machine learning models may inadvertently memorize sensitive, unauthorized, or malicious data, posing risks of privacy breaches, security vulnerabilities, and performance degradation. To address these issues, machine unlearning has emerged…

Machine Learning · Computer Science 2024-04-08 Jie Xu , Zihan Wu , Cong Wang , Xiaohua Jia

Machine unlearning, an emerging research topic focusing on compliance with data privacy regulations, enables trained models to remove the information learned from specific data. While many existing methods indirectly address this issue by…

Machine Learning · Computer Science 2024-12-24 Seonguk Seo , Dongwan Kim , Bohyung Han

The effect of correlations between model parameters and nuisance parameters is discussed, in the context of fitting model parameters to data. Modifications to the usual $\chi^2$ method are required. Fake data studies, as used at present,…

Data Analysis, Statistics and Probability · Physics 2013-09-25 Byron Roe

Noise is source of ambiguity for fuzzy systems. Although being an important aspect, the effects of noise in fuzzy modeling have been little investigated. This paper presents a set of tests using three well-known fuzzy modeling algorithms.…

Neural and Evolutionary Computing · Computer Science 2007-05-23 P. J. Costa Branco , J. A. Dente

We show how to deal with uncertainties on the Standard Model predictions in an agnostic new physics search strategy that exploits artificial neural networks. Our approach builds directly on the specific Maximum Likelihood ratio treatment of…

High Energy Physics - Phenomenology · Physics 2021-11-29 Raffaele Tito d'Agnolo , Gaia Grosso , Maurizio Pierini , Andrea Wulzer , Marco Zanetti

Deep learning techniques play an increasingly important role in industrial and research environments due to their outstanding results. However, the large number of hyper-parameters to be set may lead to errors if they are set manually. The…

Machine Learning · Computer Science 2020-06-04 Michele Fraccaroli , Evelina Lamma , Fabrizio Riguzzi

The rise of foundation models -- large, pretrained machine learning models that can be finetuned to a variety of tasks -- has revolutionized the fields of natural language processing and computer vision. In high-energy physics, the question…

High Energy Physics - Phenomenology · Physics 2026-01-12 Anna Hallin

The paper is concerned with inference for a parameter of interest in models that share a common interpretation for that parameter but that may differ appreciably in other respects. We study the general structure of models under which the…

Statistics Theory · Mathematics 2024-08-06 Heather Battey , Nancy Reid

The application of machine learning to physics problems is widely found in the scientific literature. Both regression and classification problems are addressed by a large array of techniques that involve learning algorithms. Unfortunately,…

Machine Learning · Computer Science 2022-10-03 Umberto Michelucci , Francesca Venturini

Depending on the point of view, modern machine learning is either providing an unprecedented boost to the numerical methods of particle physics, or it is transforming the way we do science with vast amounts of complex data. In any case, it…

High Energy Physics - Phenomenology · Physics 2025-04-25 Tilman Plehn , Anja Butter , Barry Dillon , Theo Heimel , Claudius Krause , Ramon Winterhalder

Machine-learning techniques have become fundamental in high-energy physics and, for new physics searches, it is crucial to know their performance in terms of experimental sensitivity, understood as the statistical significance of the…

High Energy Physics - Phenomenology · Physics 2022-11-10 Ernesto Arganda , Xabier Marcano , Víctor Martín Lozano , Anibal D. Medina , Andres D. Perez , Manuel Szewc , Alejandro Szynkman

Changes in parameters of a physical device can eventually lead to catastrophic failure. This paper discusses a parameter estimation method based on synchronization between a model and time series data. In particular, we examine the…

chao-dyn · Physics 2007-05-23 Justin Goodwin , Reggie Brown , Lutz Junge

Hyper-parameters (HPs) are an important part of machine learning (ML) model development and can greatly influence performance. This paper studies their behavior for three algorithms: Extreme Gradient Boosting (XGB), Random Forest (RF), and…

Machine Learning · Computer Science 2022-11-17 Anwesha Bhattacharyya , Joel Vaughan , Vijayan N. Nair

Hyperparameters play a critical role in machine learning. Hyperparameter tuning can make the difference between state-of-the-art and poor prediction performance for any algorithm, but it is particularly challenging for structure learning…

Machine Learning · Computer Science 2024-02-21 Damian Machlanski , Spyridon Samothrakis , Paul Clarke

Approximate solutions of partial differential equations (PDEs) obtained by neural networks are highly affected by hyper parameter settings. For instance, the model training strongly depends on loss function design, including the choice of…

Numerical Analysis · Mathematics 2025-03-13 Hee Jun Yang , Alexander Heinlein , Hyea Hyun Kim

It is typical for a machine learning system to have numerous hyperparameters that affect its learning rate and prediction quality. Finding a good combination of the hyperparameters is, however, a challenging job. This is mainly because…

Machine Learning · Computer Science 2019-08-08 Dobromir Marinov , Daniel Karapetyan

We study the robustness of machine learning approaches to adversarial perturbations, with a focus on supervised learning scenarios. We find that typical phase classifiers based on deep neural networks are extremely vulnerable to adversarial…

Disordered Systems and Neural Networks · Physics 2024-01-26 Si Jiang , Sirui Lu , Dong-Ling Deng

Deep learning models are yielding increasingly better performances thanks to multiple factors. To be successful, model may have large number of parameters or complex architectures and be trained on large dataset. This leads to large…

Machine Learning · Computer Science 2022-12-20 Jean-Roch Vlimant , Junqi Yin

Current research on deep machine unlearning primarily focuses on improving or evaluating the overall effectiveness of unlearning methods while overlooking the varying difficulty of unlearning individual training samples. As a result, the…

Machine Learning · Computer Science 2025-02-24 Hammad Rizwan , Mahtab Sarvmaili , Hassan Sajjad , Ga Wu

Quantum machine learning (QML) is an emerging field with significant potential, yet it remains highly susceptible to noise, which poses a major challenge to its practical implementation. While various noise mitigation strategies have been…

Quantum Physics · Physics 2025-04-01 María Laura Olivera-Atencio , Lucas Lamata , Jesús Casado-Pascual