English
Related papers

Related papers: Unveiling Scaling Laws of Parameter Identifiabilit…

200 papers

Low-precision training is critical for optimizing the trade-off between model quality and training costs, necessitating the joint allocation of model size, dataset size, and numerical precision. While empirical scaling laws suggest that…

Machine Learning · Statistics 2026-02-27 Dechen Zhang , Xuan Tang , Yingyu Liang , Difan Zou

How to make a dynamic system unidentifiable is an important but still open issue. It not only requires that the parameters of the systems but also the equivalent systems cannot be identified by any identification approaches. Thus, it is a…

Systems and Control · Electrical Eng. & Systems 2023-08-31 Xiangyu Mao , Jianping He

We study Heisenberg scaling of quantum metrology in the viewpoint of population coding. Although Fisher information has been used for a figure of merit to characterize Heisenberg scaling in quantum metrology, several studies pointed out it…

Quantum Physics · Physics 2025-03-05 Masahito Hayashi

Mathematical models are invaluable for understanding and predicting how biological systems behave, although their construction requires specifying mechanisms and relationships that are often not perfectly known. In the presence of multiple…

Quantifying the uncertainty in predictive models is critical for establishing trust and enabling risk-informed decision making for personalized medicine. In contrast to one-size-fits-all approaches that seek to mitigate risk at the…

Computational Engineering, Finance, and Science · Computer Science 2025-05-15 Graham Pash , Umberto Villa , David A. Hormuth , Thomas E. Yankeelov , Karen Willcox

In recent years, disease mapping studies have become a routine application within geographical epidemiology and are typically analysed within a Bayesian hierarchical model formulation. A variety of model formulations for the latent level…

Methodology · Statistics 2016-01-07 Andrea Riebler , Sigrunn H. Sørbye , Daniel Simpson , Håvard Rue

Non-Hermitian quantum metrology, an emerging field at the intersection of quantum estimation and non-Hermitian physics, holds promise for revolutionizing precision measurement. Here, we present a comprehensive investigation of non-Hermitian…

Quantum Physics · Physics 2025-09-17 Xinglei Yu , Xinzhi Zhao , Liangsheng Li , Xiao-Min Hu , Xiangmei Duan , Haidong Yuan , Chengjie Zhang

Many deep architectures and self-supervised pre-training techniques have been proposed for human activity recognition (HAR) from wearable multimodal sensors. Scaling laws have the potential to help move towards more principled design by…

Machine Learning · Computer Science 2025-05-22 Tom Hoddes , Alex Bijamov , Saket Joshi , Daniel Roggen , Ali Etemad , Robert Harle , David Racz

This paper studies the problems of identifiability and estimation in high-dimensional nonparametric latent structure models. We introduce an identifiability theorem that generalizes existing conditions, establishing a unified framework…

Statistics Theory · Mathematics 2025-08-06 Yichen Lyu , Pengkun Yang

Physics-informed neural networks have emerged as a powerful tool in the scientific machine learning community, with applications to both forward and inverse problems. While they have shown considerable empirical success, significant…

Optimization and Control · Mathematics 2025-12-11 Federica Caforio , Martin Holler , Matthias Höfler

Identifiability is a necessary condition for successful parameter estimation of dynamic system models. A major component of identifiability analysis is determining the identifiable parameter combinations, the functional forms for the…

Quantitative Methods · Quantitative Biology 2013-10-07 Marisa C. Eisenberg , Michael A. L. Hayashi

Identifiability of parameters is an essential property for a statistical model to be useful in most settings. However, establishing parameter identifiability for Bayesian networks with hidden variables remains challenging. In the context of…

Statistics Theory · Mathematics 2014-06-04 Elizabeth S. Allman , John A. Rhodes , Elena Stanghellini , Marco Valtorta

Recent technological advances have expanded the availability of high-throughput biological datasets, enabling the reliable design of digital twins of biomedical systems or patients. Such computational tools represent key reaction networks…

Quantitative Methods · Quantitative Biology 2025-09-03 Clémence Métayer , Annabelle Ballesta , Julien Martinelli

Neural scaling laws establish a predictable relationship between model performance and data or compute, offering crucial guidance for resource allocation in new domains and tasks. Yet such laws are most needed precisely where they are…

Machine Learning · Computer Science 2026-05-11 Xing Han , Ziyin Liu , Suchi Saria , Paul Pu Liang

The estimation of uncertainties associated with predictions from quantitative structure-activity relationship (QSAR) models can accelerate the drug discovery process by identifying promising experiments and allowing an efficient allocation…

Machine Learning · Computer Science 2025-02-07 Hannah Rosa Friesacher , Emma Svensson , Susanne Winiwarter , Lewis Mervin , Adam Arany , Ola Engkvist

Dynamic models have been successfully used in producing estimates of HIV epidemics at the national level due to their epidemiological nature and their ability to estimate prevalence, incidence, and mortality rates simultaneously. Recently,…

Methodology · Statistics 2024-01-11 Le Bao , Xiaoyue Niu , Tim Brown , Jeffrey W. Imai-Eaton

A number of ill-posed inverse problems in signal processing, like blind deconvolution, matrix factorization, dictionary learning and blind source separation share the common characteristic of being bilinear inverse problems (BIPs), i.e. the…

Information Theory · Computer Science 2014-11-11 Sunav Choudhary , Urbashi Mitra

Researchers develop models to explain the unknowns. These models typically involve parameters that capture tangible quantities, the estimation of which is desired. Parameter identifiability investigates the recoverability of the unknown…

Optimization and Control · Mathematics 2024-07-01 Anuththara Sarathchandra , Azadeh Aghaeeyan , Pouria Ramazi

In many problems of data-driven modeling for dynamical systems, the governing equations are not known a priori and must be selected phenomenologically from a large set of candidate interactions and basis functions. In such situations, point…

Applications · Statistics 2026-04-14 Shuhei Kashiwamura , Yusuke Kato , Hiroshi Kori , Masato Okada

To model modern large-scale datasets, we need efficient algorithms to infer a set of $P$ unknown model parameters from $N$ noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise…

Machine Learning · Statistics 2016-09-07 Madhu Advani , Surya Ganguli