English
Related papers

Related papers: Notes on stable learning with piecewise-linear bas…

200 papers

We develop a general framework for estimating function-valued parameters under equality or inequality constraints in infinite-dimensional statistical models. Such constrained learning problems are common across many areas of statistics and…

Machine Learning · Statistics 2025-07-22 Razieh Nabi , Nima S. Hejazi , Mark J. van der Laan , David Benkeser

In order to bring contraction analysis into the very fruitful and topical fields of stochastic and Bayesian systems, we extend here the theory describes in \cite{Lohmiller98} to random differential equations. We propose new definitions of…

Optimization and Control · Mathematics 2013-09-27 Nicolas Tabareau , Jean-Jacques Slotine

Lattice Boltzmann methods are numerical schemes derived as a kinetic approximation of an underlying lattice gas. A numerical convergence theory for nonlinear convective-diffusive lattice Boltzmann methods is established. Convergence,…

comp-gas · Physics 2008-02-03 Bracy H. Elton , Garry H. Rodrigue , C. David Levermore

While it is well known that nonlinear methods of approximation can often perform dramatically better than linear methods, there are still questions on how to measure the optimal performance possible for such methods. This paper studies…

Numerical Analysis · Mathematics 2020-09-22 Albert Cohen , Ronald DeVore , Guergana Petrova , Przemyslaw Wojtaszczyk

We describe the application of tools from statistical mechanics to analyse the dynamics of various classes of supervised learning rules in perceptrons. The character of this paper is mostly that of a cross between a biased non-encyclopedic…

Disordered Systems and Neural Networks · Physics 2008-02-03 C. W. H. Mace , A. C. C. Coolen

We study mixed-integer programming formulations for the piecewise linear lower and upper bounds (in other words, piecewise linear relaxations) of nonlinear functions that can be modeled by a new class of combinatorial disjunctive…

Optimization and Control · Mathematics 2023-05-01 Bochuan Lyu , Illya V. Hicks , Joey Huchette

In this paper we present two different results in the context of nonlinear analysis. The first one is essentially a nonlinear technique that, in view of its strong generality, may be useful in different practical problems. The second…

Functional Analysis · Mathematics 2015-10-02 Daniel Pellegrino , Joedson Santos , Juan B. Seoane-Sepúlveda

While stability analysis is a mainstay for control science, especially computing regions of attraction of equilibrium points, until recently most stability analysis tools always required explicit knowledge of the model or a high-fidelity…

Optimization and Control · Mathematics 2024-09-12 Matteo Tacchi , Yingzhao Lian , Colin Jones

Energy-based learning algorithms are alternatives to backpropagation and are well-suited to distributed implementations in analog electronic devices. However, a rigorous theory of convergence is lacking. We make a first step in this…

Optimization and Control · Mathematics 2026-01-28 Anne-Men Huijzer , Thomas Chaffey , Bart Besselink , Henk J. van Waarde

We present a novel approach for learning nonlinear dynamic models, which leads to a new set of tools capable of solving problems that are otherwise difficult. We provide theory showing this new approach is consistent for models with long…

Artificial Intelligence · Computer Science 2009-06-03 John Langford , Ruslan Salakhutdinov , Tong Zhang

We consider the problems of \emph{learning} and \emph{testing} real-valued convex functions over Gaussian space. Despite the extensive study of function convexity across mathematics, statistics, and computer science, its learnability and…

Data Structures and Algorithms · Computer Science 2025-11-17 Renato Ferreira Pinto , Cassandra Marcussen , Elchanan Mossel , Shivam Nadimpalli

There has been a recent interest in imitation learning methods that are guaranteed to produce a stabilizing control law with respect to a known system. Work in this area has generally considered linear systems and controllers, for which…

Optimization and Control · Mathematics 2021-09-23 Sebastian East

We prove that if a continuous piecewise-smooth map on $\mathbb{R}^n$ is comprised of two linear functions, has a bounded orbit, and satisfies a certain non-degeneracy condition, then it has a fixed point. The result has important…

Dynamical Systems · Mathematics 2024-12-17 David J. W. Simpson

In this work, a convergence lemma for function $f$ being finite compositions of analytic mappings and the maximum operator is proved. The lemma shows that the set of $\delta$-stationary points near an isolated local minimum point $x^*$ is…

Computer Science and Game Theory · Computer Science 2022-08-12 Xiaotie Deng , Hanyu Li , Ningyuan Li

The content of this contribution is based on the course on numerical analysis techniques for non-linear dynamics. After introducing basic concepts as the visual analysis of trajectories in phase space and the importance of the nature of…

Accelerator Physics · Physics 2020-12-22 Yannis Papaphilippou

Railway tracks rest on a foundation known for exhibiting nonlinear viscoelastic behavior. Railway track deflections are modeled by a semilinear partial differential equation. This paper studies the stability of solutions to this equation in…

Analysis of PDEs · Mathematics 2018-07-04 M. Sajjad Edalatzadeh , Kirsten A. Morris

Lower and upper bounds for a given function are important in many mathematical and engineering contexts, where they often serve as a base for both analysis and application. In this short paper, we derive piecewise linear and quadratic…

Optimization and Control · Mathematics 2014-06-17 Gene A. Bunin , Grégory François , Dominique Bonvin

This paper is concerned with the convergence rate of the solutions of nonlinear switched systems. We first consider a switched system which is asymptotically stable for a class of inputs but not for all inputs. We show that solutions…

Optimization and Control · Mathematics 2015-11-06 Philippe Jouan , Saïd Naciri

In the first part, we discuss the stability of the strong slope and of the subdifferential of a lower semicontinuous function with respect to Wijsman perturbations of the function, i.e. perturbations described via Wijsman convergence. In…

Optimization and Control · Mathematics 2019-01-01 Marc Lassonde

This is a survey paper concerning some theorems on stochastic convex ordering and their applications to functional inequalities for convex functions. We present the recent results on those subjects

Classical Analysis and ODEs · Mathematics 2017-02-01 Teresa Rajba