Related papers: The ideas behind the Self Consistent Expansion
Complex change is often described as "evolutionary" in economics, policy, and technology, yet most system dynamics models remain constrained to fixed state spaces and equilibrium-seeking behavior. This paper argues that evolutionary…
While powerful methods have been developed for high-dimensional hypothesis testing assuming orthogonal parameters, current approaches struggle to generalize to the more common non-orthogonal case. We propose Stable Distillation (SD), a…
In this paper, we study the statistical evolution of the large-scale structure (LSS), focusing on the joint probability distribution function (PDF) of the coarse-grained cosmic field and its role in constructing effective dynamics. As the…
In this paper, we study dimension reduction techniques for large-scale controlled stochastic differential equations (SDEs). The drift of the considered SDEs contains a polynomial term satisfying a one-sided growth condition. Such…
Assessing small-signal stability of power systems composed of thousands of interacting generators is a computationally challenging task. To reduce the computational burden, this paper introduces a novel condition to assess and certify…
Non-uniform sampling arises when an experimenter does not have full control over the sampling characteristics of the process under investigation. Moreover, it is introduced intentionally in algorithms such as Bayesian optimization and…
Sparse additive modeling is a class of effective methods for performing high-dimensional nonparametric regression. In this work we show how shape constraints such as convexity/concavity and their extensions, can be integrated into additive…
It is well-known that real-world changes constituting distribution shift adversely affect model performance. How to characterize those changes in an interpretable manner is poorly understood. Existing techniques to address this problem take…
We present a review of recent work on the statistical mechanics of non equilibrium processes based on the analysis of large deviations properties of microscopic systems. Stochastic lattice gases are non trivial models of such phenomena and…
Models of how things spread often assume that transmission mechanisms are fixed over time. However, social contagions--the spread of ideas, beliefs, innovations--can lose or gain in momentum as they spread: ideas can get reinforced, beliefs…
This paper considers a high dimensional linear regression model with corrected variables. A variety of methods have been developed in recent years, yet it is still challenging to keep accurate estimation when there are complex correlation…
To analyze high-dimensional systems, many fields in science and engineering rely on high-level descriptions, sometimes called "macrostates," "coarse-grainings," or "effective theories". Examples of such descriptions include the…
We prove that a system of locally interacting diffusions carrying discrete masses, subject to an environmental noise and undergoing mass coagulation, converges to a system of Stochastic Partial Differential Equations (SPDEs) with…
Theory of nonlinear resonance, including stochastic one, is developed on the basis of the statistical field theory and using variables action-angle. Explicit expressions of action, proper frequency and nonlinearity parameter as functions of…
Stochastic compositional optimization generalizes classic (non-compositional) stochastic optimization to the minimization of compositions of functions. Each composition may introduce an additional expectation. The series of expectations may…
Reliability analysis typically relies on deterministic simulators, which yield repeatable outputs for identical inputs. However, many real-world systems display intrinsic randomness, requiring stochastic simulators whose outputs are random…
In a recent work we have discussed how kinetic theory, the statistics of classical particles obeying Newtonian dynamics, can be formulated as a field theory. The field theory can be organized to produce a self-consistent perturbation theory…
Machine learning has made tremendous progress in recent years, with models matching or even surpassing humans on a series of specialized tasks. One key element behind the progress of machine learning in recent years has been the ability to…
We establish a correspondence between two very general paradigms for systems that persist away from thermal equilibrium. In the first paradigm, a nonequilibrium steady state (NESS) is maintained by applying fixed thermodynamic forces that…
Inspired by the ubiquitous use of differential equations to model continuous dynamics across diverse scientific and engineering domains, we propose a novel and intuitive approach to continuous sequence modeling. Our method interprets…