English
Related papers

Related papers: Parameter Space Compression Underlies Emergent The…

200 papers

Empirical scaling laws describe how test loss and other performance metrics depend on model size, dataset size, and compute. While such laws are consistent within specific regimes, apparently distinct scaling behaviors have been reported…

Machine Learning · Computer Science 2025-11-18 Yizhou Zhang

Gaussian process regression has proven very powerful in statistics, machine learning and inverse problems. A crucial aspect of the success of this methodology, in a wide range of applications to complex and real-world problems, is…

Statistics Theory · Mathematics 2021-03-18 Yifan Chen , Houman Owhadi , Andrew M. Stuart

This research investigates a novel class of one-dimensional theories characterised by a distinctly defined infinite interaction range. We propose that such theories emerge naturally through a mesoscopic feedback mechanism. In this…

High Energy Physics - Theory · Physics 2026-02-13 Kurt Langfeld , Amanda Turner

We derive an equilibrium statistical theory for the macroscopic description of a ferromagnetic material at positive finite temperatures. Our formulation describes the most-probable equilibrium macrostates that yield a coherent deterministic…

Materials Science · Physics 2007-05-23 Markos A. Katsoulakis , Petr Plechac

Models with dimension more than the available sample size are now commonly used in various applications. A sensible inference is possible using a lower-dimensional structure. In regression problems with a large number of predictors, the…

Statistics Theory · Mathematics 2025-11-25 Sayantan Banerjee , Ismaël Castillo , Subhashis Ghosal

Many current applications in data science need rich model classes to adequately represent the statistics that may be driving the observations. But rich model classes may be too complex to admit estimators that converge to the truth with…

Information Theory · Computer Science 2022-05-04 N. Santhanam , V. Anantharam , W. Szpankowski

While hard-sphere models form the foundation of theoretical condensed matter physics, real systems often exhibit some degree of softness. We present a theoretical and numerical study of a class of nearly hard-sphere systems, generalized…

Soft Condensed Matter · Physics 2025-07-22 Ulf R. Pedersen

A basic issue in both teaching of and practice of statistics is the interplay between modelling assumptions and inference performance. The general message conveyed is that stronger assumptions lead to better statistical performance of the…

Statistics Theory · Mathematics 2026-03-20 Morten Byholt , Nils Lid Hjort

Researchers develop models to explain the unknowns. These models typically involve parameters that capture tangible quantities, the estimation of which is desired. Parameter identifiability investigates the recoverability of the unknown…

Optimization and Control · Mathematics 2024-07-01 Anuththara Sarathchandra , Azadeh Aghaeeyan , Pouria Ramazi

The use of emergent constraints to quantify uncertainty for key policy relevant quantities such as Equilibrium Climate Sensitivity (ECS) has become increasingly widespread in recent years. Many researchers, however, claim that emergent…

Applications · Statistics 2020-02-19 Daniel B. Williamson , Philip G. Sansom

The structure of the equation of state $\omega$ could be very complicate in nature while a few linear models have been successful in cosmological predictions. Linear models are treated as leading approximation of a complete Taylor series in…

General Relativity and Quantum Cosmology · Physics 2007-05-23 W. F. Kao

While supersymmetric extensions of the Standard Model can be fully described in terms of explicitly broken global supersymmetry, this description is only effective. Once related to spontaneous breaking in a more fundamental theory, the…

High Energy Physics - Phenomenology · Physics 2008-11-26 Nir Polonsky

There is an emerging interest in generating robust counterfactual explanations that would remain valid if the model is updated or changed even slightly. Towards finding robust counterfactuals, existing literature often assumes that the…

Machine Learning · Statistics 2024-03-19 Faisal Hamman , Erfaun Noorani , Saumitra Mishra , Daniele Magazzeni , Sanghamitra Dutta

Singular statistical models arise whenever different parameter values induce the same distribution, leading to non-identifiability and a breakdown of classical asymptotic theory. While existing approaches analyze these phenomena in…

Statistics Theory · Mathematics 2026-04-03 Sean Plummer

Many collective systems exist in nature far from equilibrium, ranging from cellular sheets up to flocks of birds. These systems reflect a form of active matter, whereby individual material components have internal energy. Under specific…

Soft Condensed Matter · Physics 2023-04-17 Namid R. Stillman , Silke Henkes , Roberto Mayor , Gilles Louppe

We present models in which the indeterministic feature of Quantum Mechanics is represented in the form of definite physical mechanisms. Our way is completely different from so-called hidden parameter models, namely, we start from a certain…

Quantum Physics · Physics 2007-05-23 Jiri Soucek

We work out an effective theory of accelerated expansion to describe general phenomena of inflation and acceleration (dark energy) in the Universe. Our aim is to determine from theoretical grounds, in a physically-motivated and model…

Cosmology and Nongalactic Astrophysics · Physics 2015-05-28 Raul Jimenez , P. Talavera , Licia Verde

In this essay we explore analogies between macroscopic patterns, which result from a sequence of phase transitions/instabilities starting from a homogeneous state, and similar phenomena in cosmology, where a sequence of phase transitions in…

Pattern Formation and Solitons · Physics 2019-05-22 Alan C. Newell , Shankar C. Venkataramani

The physics of matter in the condensed state is concerned with problems in which the number of constituent particles is vastly greater than can be easily comprehended. The inherent physical limitations of the human mind are fundamental and…

History and Philosophy of Physics · Physics 2016-04-26 S. J. Blundell

Ordinary differential equation models have become a standard tool for the mechanistic description of biochemical processes. If parameters are inferred from experimental data, such mechanistic models can provide accurate predictions about…

Quantitative Methods · Quantitative Biology 2018-10-12 Fabian Fröhlich , Carolin Loos , Jan Hasenauer