English
Related papers

Related papers: Unveiling Scaling Laws of Parameter Identifiabilit…

200 papers

The classification of random objects within metric spaces without a vector structure has attracted increasing attention. However, the complexity inherent in such non-Euclidean data often restricts existing models to handle only a limited…

Methodology · Statistics 2024-03-20 Shuaida He , Jiaqi Li , Xin Chen

Predicting material properties is crucial for designing better batteries, semiconductors, and medical devices. Deep learning helps scientists quickly find promising materials by predicting their energy, forces, and stresses. Companies scale…

Machine Learning · Computer Science 2025-09-29 Akshay Trikha , Kyle Chu , Advait Gosai , Parker Szachta , Eric Weiner

High-dimensional limit theorems have been shown useful to derive tuning rules for finding the optimal scaling in random-walk Metropolis algorithms. The assumptions under which weak convergence results are proved are however restrictive: the…

Methodology · Statistics 2022-02-16 Sebastian M Schmon , Philippe Gagnon

Discrete Markov random fields are undirected graphical models that capture complex conditional dependencies between discrete variables. Conducting exact posterior inference in these models is often computationally challenging because…

Methodology · Statistics 2026-03-10 Giuseppe Arena , Maarten Marsman

Identifiability is a structural property of any ODE model characterized by a set of unknown parameters. It describes the possibility of determining the values of these parameters from fusing the observations of the system inputs and…

Systems and Control · Electrical Eng. & Systems 2024-09-12 Agostino Martinelli

Identifying relationships between molecular variations and their clinical presentations has been challenged by the heterogeneous causes of a disease. It is imperative to unveil the relationship between the high dimensional molecular…

Methodology · Statistics 2021-09-02 Wennan Chang , Changlin Wan , Yong Zang , Chi Zhang , Sha Cao

Learning arguably involves the discovery and memorization of abstract rules. The aim of this paper is to study associative memory mechanisms. Our model is based on high-dimensional matrices consisting of outer products of embeddings, which…

Machine Learning · Statistics 2024-02-22 Vivien Cabannes , Elvis Dohmatob , Alberto Bietti

Shifts in data distribution can substantially harm the performance of clinical AI models and lead to misdiagnosis. Hence, various methods have been developed to detect the presence of such shifts at deployment time. However, the root causes…

Artificial Intelligence · Computer Science 2025-06-23 Mélanie Roschewitz , Raghav Mehta , Charles Jones , Ben Glocker

Mental and cognitive representations are believed to reside on low-dimensional, non-linear manifolds embedded within high-dimensional brain activity. Uncovering these manifolds is key to understanding individual differences in brain…

Machine Learning · Computer Science 2025-05-02 Eloy Geenjaar , Vince Calhoun

We demonstrate that the algorithmic information content of a system is deeply connected to its potential dynamics, thus affording an avenue for moving systems in the information-theoretic space and controlling them in the phase space. To…

Other Quantitative Biology · Quantitative Biology 2018-04-06 Hector Zenil , Narsis A. Kiani , Francesco Marabita , Yue Deng , Szabolcs Elias , Angelika Schmidt , Gordon Ball , Jesper Tegnér

Inductive bias refers to restrictions on the hypothesis class that enable a learning method to generalize effectively from limited data. A canonical example in control is linearity, which underpins low sample-complexity guarantees for…

Optimization and Control · Mathematics 2026-04-21 Zhuo Ouyang , Jixian Liu , Enrique Mallada

Inverse Uncertainty Quantification (UQ), or Bayesian calibration, is the process to quantify the uncertainties of random input parameters based on experimental data. The introduction of model discrepancy term is significant because…

Applications · Statistics 2019-07-24 Xu Wu , Koroush Shirvan , Tomasz Kozlowski

Existing methods for anomaly detection often fall short due to their inability to handle the complexity, heterogeneity, and high dimensionality inherent in real-world mobility data. In this paper, we propose DeepBayesic, a novel framework…

Machine Learning · Computer Science 2024-10-07 Minxuan Duan , Yinlong Qian , Lingyi Zhao , Zihao Zhou , Zeeshan Rasheed , Rose Yu , Khurram Shafique

Data-driven model identification strategies can be used to obtain phenomenological models that capture the temporal evolution of observable data. While it is usually straightforward to obtain such a model from time series data, for instance…

Dynamical Systems · Mathematics 2026-03-25 Mohamed Akrout , Dan Wilson

Building on recent work in statistical science, the paper presents a theory for modelling natural phenomena that unifies physical and statistical paradigms based on the underlying principle that a model must be nondimensionalizable. After…

Statistics Theory · Mathematics 2021-09-07 Tae Yoon Lee , James V. Zidek , Nancy Heckman

When training deep neural networks, a model's generalization error is often observed to follow a power scaling law dependent both on the model size and the data size. Perhaps the best known example of such scaling laws are for…

Machine Learning · Computer Science 2024-11-12 Alex Havrilla , Wenjing Liao

Classification in the dissimilarity space has become a very active research area since it provides a possibility to learn from data given in the form of pairwise non-metric dissimilarities, which otherwise would be difficult to cope with.…

This work develops a measurement-driven and model-based formal verification approach, applicable to systems with partly unknown dynamics. We provide a principled method, grounded on reachability analysis and on Bayesian inference, to…

Systems and Control · Computer Science 2015-09-14 Sofie Haesaert , Paul M. J. Van den Hof , Alessandro Abate

Uncertainty quantification has been a core of the statistical machine learning, but its computational bottleneck has been a serious challenge for both Bayesians and frequentists. We propose a model-based framework in quantifying…

Machine Learning · Computer Science 2019-06-04 Minsuk Shin , Young Lee , Jun S. Liu

Experience in the physical sciences suggests that the only realistic means of understanding complex systems is through the use of mathematical models. Typically, this has come to mean the identification of quantitative models expressed as…

Artificial Intelligence · Computer Science 2011-11-02 George M. Coghill , Ross D. King , Ashwin Srinivasan