English
Related papers

Related papers: Lipschitz Continuity in Model-based Reinforcement …

200 papers

The Lipschitz constant of a network plays an important role in many applications of deep learning, such as robustness certification and Wasserstein Generative Adversarial Network. We introduce a semidefinite programming hierarchy to…

Optimization and Control · Mathematics 2020-10-29 Tong Chen , Jean-Bernard Lasserre , Victor Magron , Edouard Pauwels

The quintessential model-based reinforcement-learning agent iteratively refines its estimates or prior beliefs about the true underlying model of the environment. Recent empirical successes in model-based reinforcement learning with…

Machine Learning · Computer Science 2022-11-02 Dilip Arumugam , Benjamin Van Roy

This paper studies the differentiability of the value function of switched linear systems under arbitrary switching and controlled switching, referred to as worst-case and optimal value functions respectively. First, we show that the value…

Optimization and Control · Mathematics 2025-11-26 Guillaume O. Berger

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Diffusion models have become the most popular approach to deep generative modeling of images, largely due to their empirical performance and reliability. From a theoretical standpoint, a number of recent works have studied the iteration…

Machine Learning · Computer Science 2025-11-19 Shivam Gupta , Aditya Parulekar , Eric Price , Zhiyang Xun

This note establishes a theoretical framework for finding (potentially overparameterized) approximations of a function on a compact set with a-priori bounds for the generalization error. The approximation method considered is to choose,…

Systems and Control · Electrical Eng. & Systems 2026-03-23 Arthur C. B. de Oliveira , Ruigang Wang , Ian R. Manchester , Eduardo D. Sontag

Calibration error is commonly adopted for evaluating the quality of uncertainty estimators in deep neural networks. In this paper, we argue that such a metric is highly beneficial for training predictive models, even when we do not…

Machine Learning · Statistics 2019-11-01 Jayaraman J. Thiagarajan , Bindya Venkatesh , Deepta Rajan

Operator learning based on neural operators has emerged as a promising paradigm for the data-driven approximation of operators, mapping between infinite-dimensional Banach spaces. Despite significant empirical progress, our theoretical…

Machine Learning · Computer Science 2024-07-04 Samuel Lanthaler

In these notes, we present a general result concerning the Lipschitz regularity of a certain type of set-valued maps often found in constrained optimization and control problems. The class of multifunctions examined in this paper is…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

Machine learning models are often used at test-time subject to constraints and trade-offs not present at training-time. For example, a computer vision model operating on an embedded device may need to perform real-time inference, or a…

Machine Learning · Statistics 2017-02-28 Augustus Odena , Dieterich Lawson , Christopher Olah

The Lipschitz constant of neural networks plays an important role in several contexts of deep learning ranging from robustness certification and regularization to stability analysis of systems with neural network controllers. Obtaining…

Machine Learning · Computer Science 2021-07-07 Aritra Bhowmick , Meenakshi D'Souza , G. Srinivasa Raghavan

The success of reinforcement learning (RL) crucially depends on effective function approximation when dealing with complex ground-truth models. Existing sample-efficient RL algorithms primarily employ three approaches to function…

Machine Learning · Computer Science 2024-01-09 Yunfan Li , Lin Yang

In this work, we propose a framework to learn feedback control policies with guarantees on closed-loop generalization and adversarial robustness. These policies are learned directly from expert demonstrations, contained in a dataset of…

Machine Learning · Computer Science 2022-11-03 Abed AlRahman Al Makdah , Vishaal Krishnan , Fabio Pasqualetti

Configurable Markov Decision Processes (Conf-MDPs) have recently been introduced as an extension of the traditional Markov Decision Processes (MDPs) to model the real-world scenarios in which there is the possibility to intervene in the…

Machine Learning · Computer Science 2024-02-22 Alberto Maria Metelli

The generalization performance of deep neural networks with regard to the optimization algorithm is one of the major concerns in machine learning. This performance can be affected by various factors. In this paper, we theoretically prove…

Machine Learning · Computer Science 2023-08-23 Mohammad Lashkari , Amin Gheibi

We aim to design adaptive online learning algorithms that take advantage of any special structure that might be present in the learning task at hand, with as little manual tuning by the user as possible. A fundamental obstacle that comes up…

Machine Learning · Computer Science 2019-05-31 Zakaria Mhammedi , Wouter M. Koolen , Tim van Erven

This paper presents a novel learning economic model predictive control scheme for uncertain nonlinear systems subject to input and state constraints and unknown dynamics. We design a fast and accurate Lipschitz regression method using input…

Systems and Control · Electrical Eng. & Systems 2025-05-09 Weiliang Xiong , Defeng He , Haiping Du

In this work we propose lifted regression/reconstruction networks (LRRNs), which combine lifted neural networks with a guaranteed Lipschitz continuity property for the output layer. Lifted neural networks explicitly optimize an energy model…

Machine Learning · Computer Science 2020-05-08 Rasmus Kjær Høier , Christopher Zach

We study expected generalization bounds for the Hierarchical Federated Learning (HFL) setup using Wasserstein distance. We introduce a generalized framework in which data is sampled hierarchically, and we model it with a multi-layered tree…

Machine Learning · Computer Science 2026-05-06 Dario Filatrella , Ragnar Thobaben , Mikael Skoglund

We study online optimization of smoothed piecewise constant functions over the domain [0, 1). This is motivated by the problem of adaptively picking parameters of learning algorithms as in the recently introduced framework by Gupta and…

Machine Learning · Computer Science 2016-05-23 Vincent Cohen-Addad , Varun Kanade