English
Related papers

Related papers: On the Mathematical Impossibility of Safe Universa…

200 papers

We investigate the approximation capabilities of dense neural networks. While universal approximation theorems establish that sufficiently large architectures can approximate arbitrary continuous functions if there are no restrictions on…

Machine Learning · Computer Science 2026-05-19 Levi Rauchwerger , Stefanie Jegelka , Ron Levie

This work applies universal adaptive control to control barrier functions to achieve forward invariance of a safe set despite the presence of unmatched parametric uncertainties. The approach combines two ideas. The first is to construct a…

Systems and Control · Electrical Eng. & Systems 2022-08-17 Brett T. Lopez , Jean-Jacques Slotine

We establish universal approximation theorems for infinite-dimensional geometric rough paths, i.e., we show that continuous functions on the space of infinite-dimensional weakly geometric H\"older continuous rough paths can be approximated…

Probability · Mathematics 2026-03-04 Sonja Cox , Asma Khedher , Thijs Maessen

One of the theoretical pillars that sustain certain machine learning models are universal approximation theorems, which prove that they can approximate all functions from a function class to arbitrary precision. Independently, classical…

Disordered Systems and Neural Networks · Physics 2026-04-28 Tobias Reinhart , Gemma De les Coves

We prove two universal approximation theorems for a range of dropout neural networks. These are feed-forward neural networks in which each edge is given a random $\{0,1\}$-valued filter, that have two modes of operation: in the first each…

Machine Learning · Computer Science 2020-12-21 Oxana A. Manita , Mark A. Peletier , Jacobus W. Portegies , Jaron Sanders , Albert Senen-Cerda

The Universal Approximation Theorem posits that neural networks can theoretically possess unlimited approximation capacity with a suitable activation function and a freely chosen or trained set of parameters. However, a more practical…

Machine Learning · Computer Science 2024-09-26 Li Liu , Tengchao Yu , Heng Yong

Universal approximation theorems are the foundations of classical neural networks, providing theoretical guarantees that the latter are able to approximate maps of interest. Recent results have shown that this can also be achieved in a…

Quantum Physics · Physics 2025-04-14 Lukas Gonon , Antoine Jacquier

The unreduced, universally nonperturbative analysis of arbitrary interaction process, described by a quite general equation, provides the truly complete, "dynamically multivalued" general solution that leads to dynamically derived,…

General Physics · Physics 2007-05-23 Andrei P. Kirilyuk

We consider models of quantum computation that involve operations performed on some fixed resourceful quantum state. Examples that fit this paradigm include magic state injection and measurement-based approaches. We introduce a framework…

Quantum Physics · Physics 2025-08-18 Benjamin D. M. Jones , Noah Linden , Paul Skrzypczyk

By universal formulas we understand parameterized analytic expressions that have a fixed complexity, but nevertheless can approximate any continuous function on a compact set. There exist various examples of such formulas, including some in…

Machine Learning · Computer Science 2023-11-08 Dmitry Yarotsky

The study of universal approximation of arbitrary functions $f: \mathcal{X} \to \mathcal{Y}$ by neural networks has a rich and thorough history dating back to Kolmogorov (1957). In the case of learning finite dimensional maps, many authors…

Machine Learning · Computer Science 2019-10-04 William H. Guss , Ruslan Salakhutdinov

In this paper we introduce the concept of universal stabilizability: the condition that every solution of a nonlinear system can be globally stabilized. We give sufficient conditions in terms of the existence of a control contraction…

Optimization and Control · Mathematics 2013-11-21 Ian R. Manchester , Jean-Jacques E. Slotine

Universal approximation theorems provide a mathematical explanation for the expressive power of neural networks. They assert that, under mild conditions on the activation function, feedforward neural networks are dense in broad function…

Machine Learning · Computer Science 2026-05-21 Soumendu Sundar Mukherjee , Himasish Talukdar

In this paper, we study the robustness of safety properties of a linear dynamical system with respect to model uncertainties. Our paper involves three parts. In the first part, we provide symbolic (analytical) and numerical (representation…

Systems and Control · Electrical Eng. & Systems 2021-09-17 Bineet Ghosh , Parasara Sridhar Duggirala

Propositional satisfiability (SAT) is one of the most fundamental problems in computer science. Its worst-case hardness lies at the core of computational complexity theory, for example in the form of NP-hardness and the (Strong) Exponential…

Discrete Mathematics · Computer Science 2022-09-02 Tobias Friedrich , Ralf Rothenberger

Symmetry adaptation, universality, and gate efficiency are central but often competing requirements in quantum algorithms for electronic structure and many-body physics. For example, fully symmetry-adapted universal operator pools typically…

Quantum Physics · Physics 2025-12-16 Ilias Magoulas , Muhan Zhang , Francesco A. Evangelista

The capability of recurrent neural networks to approximate trajectories of a random dynamical system, with random inputs, on non-compact domains, and over an indefinite or infinite time horizon is considered. The main result states that…

Neural and Evolutionary Computing · Computer Science 2022-11-16 Adrian N. Bishop

The universal approximation property (UAP) holds a fundamental position in deep learning, as it provides a theoretical foundation for the expressive power of neural networks. It is widely recognized that a composition of linear and…

Systems and Control · Electrical Eng. & Systems 2025-04-01 Yifei Duan , Yongqiang Cai

We establish a universal approximation theorem for signatures of rough paths that are not necessarily weakly geometric. By extending the path with time and its rough path bracket terms, we prove that linear functionals of the signature of…

Probability · Mathematics 2026-02-06 Mihriban Ceylan , Anna P. Kwossek , David J. Prömel

As demonstrated in many areas of real-life applications, neural networks have the capability of dealing with high dimensional data. In the fields of optimal control and dynamical systems, the same capability was studied and verified in many…

Machine Learning · Computer Science 2020-12-04 Wei Kang , Qi Gong