English
Related papers

Related papers: Notes on stable learning with piecewise-linear bas…

200 papers

Contraction theory is an analytical tool to study differential dynamics of a non-autonomous (i.e., time-varying) nonlinear system under a contraction metric defined with a uniformly positive definite matrix, the existence of which results…

Machine Learning · Computer Science 2026-03-18 Hiroyasu Tsukamoto , Soon-Jo Chung , Jean-Jacques E. Slotine

We analyze the stability properties of Lur'e systems with piecewise continuous nonlinearities by exploiting the notion of set-valued Lie derivative for Lur'e-Postnikov Lyapunov functions. We first extend an existing result of the literature…

Systems and Control · Electrical Eng. & Systems 2023-02-03 Simone Mariano , Romain Postoyan , Luca Zaccarian

This paper studies the approximation property of ReLU neural networks (NNs) to piecewise constant functions with unknown interfaces in bounded regions in $\mathbb{R}^d$. Under the assumption that the discontinuity interface $\Gamma$ may be…

Functional Analysis · Mathematics 2024-10-23 Zhiqiang Cai , Junpyo Choi , Min Liu

We present a new piecewise linear regression methodology that utilizes fitting a difference of convex functions (DC functions) to the data. These are functions $f$ that may be represented as the difference $\phi_1 - \phi_2$ for a choice of…

Machine Learning · Statistics 2020-11-17 Ali Siahkamari , Aditya Gangrade , Brian Kulis , Venkatesh Saligrama

This paper is concerned with the study of the fractional finite sums theory. We present the classes of functions for which it is possible to characterize the constant related to the derivative of fractional sums (denominated by essence of a…

Number Theory · Mathematics 2023-03-03 Leonardo F. Bielinski , Giuliano G. La Guardia , Jocemar Q. Chagas

We study incremental stability and convergence of switched (bimodal) Filippov systems via contraction analysis. In particular, by using results on regularization of switched dynamical systems, we derive sufficient conditions for convergence…

Systems and Control · Computer Science 2020-03-18 Mario di Bernardo , Davide Fiore , S. John Hogan

We review the construction and analysis of numerical methods for strongly nonlinear PDEs, with an emphasis on convex and nonconvex fully nonlinear equations and the convergence to viscosity solutions. We begin by describing a fundamental…

Numerical Analysis · Mathematics 2016-10-26 Michael Neilan , Abner J. Salgado , Wujun Zhang

We consider the rate of piecewise constant approximation to a locally stationary process $X(t),t\in [0,1]$, having a variable smoothness index $\alpha(t)$. Assuming that $\alpha(\cdot)$ attains its unique minimum at zero and satisfies the…

Probability · Mathematics 2015-11-19 Enkelejd Hashorva , Mikhail Lifshits , Oleg Seleznjev

Motivated by a growing list of nontraditional statistical estimation problems of the piecewise kind, this paper provides a survey of known results supplemented with new results for the class of piecewise linear-quadratic programs. These are…

Optimization and Control · Mathematics 2018-08-16 Ying Cui , Tsung-Hui Chang , Mingyi Hong , Jong-Shi Pang

Approximating functions by a linear span of truncated basis sets is a standard procedure for the numerical solution of differential and integral equations. Commonly used concepts of approximation methods are well-posed and convergent, by…

Numerical Analysis · Mathematics 2022-12-14 Yahya Saleh , Armin Iske , Andrey Yachmenev , Jochen Küpper

We consider a linear partial integro-differential equation that arises in the modeling of various physical and biological processes. We study the problem in a spatial periodic domain. We analyze numerical stability and numerical convergence…

Numerical Analysis · Mathematics 2010-05-31 Samir Kumar Bhowmik

We present a rigorous convergence analysis for cylindrical approximations of nonlinear functionals, functional derivatives, and functional differential equations (FDEs). The purpose of this analysis is twofold: first, we prove that…

Numerical Analysis · Mathematics 2021-03-17 Daniele Venturi , Alec Dektor

We propose an alternative to $k$-nearest neighbors for functional data whereby the approximating neighboring curves are piecewise functions built from a functional sample. Using a locally defined distance function that satisfies…

Methodology · Statistics 2021-06-02 Antonio Elías , Raúl Jiménez , Joe Yukich

In this paper, we present a novel algorithm for piecewise linear regression which can learn continuous as well as discontinuous piecewise linear functions. The main idea is to repeatedly partition the data and learn a liner model in in each…

Machine Learning · Computer Science 2014-09-10 Naresh Manwani , P. S. Sastry

Replication of experimental results has been a challenge faced by many scientific disciplines, including the field of machine learning. Recent work on the theory of machine learning has formalized replicability as the demand that an…

Machine Learning · Computer Science 2026-04-15 Eric Eaton , Marcel Hussing , Michael Kearns , Aaron Roth , Sikata Bela Sengupta , Jessica Sorrell

We consider stationary autoregressive processes with coefficients restricted to an ellipsoid, which includes autoregressive processes with absolutely summable coefficients. We provide consistency results under different norms for the…

Machine Learning · Statistics 2017-06-09 Alessio Sancetta

In this paper, we consider the problem of piecewise affine abstraction of nonlinear systems, i.e., the overapproximation of its nonlinear dynamics by a pair of piecewise affine functions that "includes" the dynamical characteristics of the…

Optimization and Control · Mathematics 2018-11-07 Kanishka Raj Singh , Qiang Shen , Sze Zheng Yong

We consider minimization of stochastic functionals that are compositions of a (potentially) non-smooth convex function $h$ and smooth function $c$ and, more generally, stochastic weakly-convex functionals. We develop a family of stochastic…

Optimization and Control · Mathematics 2018-09-25 John Duchi , Feng Ruan

We present a general variational framework for the training of freeform nonlinearities in layered computational architectures subject to some slope constraints. The regularization that we add to the traditional training loss penalizes the…

Machine Learning · Statistics 2025-03-31 Michael Unser , Alexis Goujon , Stanislas Ducotterd

In this paper we consider approximations of Neumann problems for the integral fractional Laplacian by continuous, piecewise linear finite elements. We analyze the weak formulation of such problems, including their well-posedness and…

Numerical Analysis · Mathematics 2022-12-29 Francisco M. Bersetche , Juan Pablo Borthagaray