English
Related papers

Related papers: Provable Lipschitz Certification for Generative Mo…

200 papers

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

Statistics Theory · Mathematics 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

Developing inherently interpretable models for prediction has gained prominence in recent years. A subclass of these models, wherein the interpretable network relies on learning high-level concepts, are valued because of closeness of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Jayneel Parekh , Quentin Bouniot , Pavlo Mozharovskyi , Alasdair Newson , Florence d'Alché-Buc

This paper presents a framework for bounding the approximation error in imitation model predictive controllers utilizing neural networks. Leveraging the Lipschitz properties of these neural networks, we derive a bound that guides dataset…

Systems and Control · Electrical Eng. & Systems 2026-03-27 Hendrik Alsmeier , Lukas Theiner , Anton Savchenko , Ali Mesbah , Rolf Findeisen

Dramatic advances in generative models have resulted in near photographic quality for artificially rendered faces, animals and other objects in the natural world. In spite of such advances, a higher level understanding of vision and imagery…

Computer Vision and Pattern Recognition · Computer Science 2019-04-05 Raphael Gontijo Lopes , David Ha , Douglas Eck , Jonathon Shlens

This work proposes a novel distributed framework for verifying the incremental stability of large-scale systems with unknown dynamics and known interconnection structures using graph neural networks. Our proposed approach relies on the…

Systems and Control · Electrical Eng. & Systems 2025-12-09 Ahan Basu , Mahathi Anand , Pushpak Jagtap

Abstracting neural networks with constraints they impose on their inputs and outputs can be very useful in the analysis of neural network classifiers and to derive optimization-based algorithms for certification of stability and robustness…

Machine Learning · Computer Science 2021-05-04 Navid Hashemi , Justin Ruths , Mahyar Fazlyab

Generative network models are extremely useful for understanding the mechanisms that operate in network formation and are widely used across several areas of knowledge. However, when it comes to bipartite networks -- a class of network…

Physics and Society · Physics 2019-10-29 Demival Vasques Filho , Dion R. J. O'Neale

Deep generative models are effective methods of modeling data. However, it is not easy for a single generative model to faithfully capture the distributions of complex data such as images. In this paper, we propose an approach for boosting…

Machine Learning · Computer Science 2019-05-14 Fan Bao , Hang Su , Jun Zhu

This paper proposes a novel approach to adaptive step sizes in stochastic gradient descent (SGD) by utilizing quantities that we have identified as numerically traceable -- the Lipschitz constant for gradients and a concept of the local…

Optimization and Control · Mathematics 2024-09-19 Frederik Köhne , Leonie Kreis , Anton Schiela , Roland Herzog

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32x32), and…

Machine Learning · Computer Science 2020-10-27 Yang Song , Stefano Ermon

Robustness certification against bounded input noise or adversarial perturbations is increasingly important for deployment recurrent neural networks (RNNs) in safety-critical control applications. To address this challenge, we present…

Systems and Control · Electrical Eng. & Systems 2025-09-23 Paul Hamelbeck , Johannes Schiffer

We introduce a new approach to learning in hierarchical latent-variable generative models called the "distributed distributional code Helmholtz machine", which emphasises flexibility and accuracy in the inferential process. In common with…

Machine Learning · Statistics 2018-05-29 Eszter Vertes , Maneesh Sahani

We develop an approach to training generative models based on unrolling a variational auto-encoder into a Markov chain, and shaping the chain's trajectories using a technique inspired by recent work in Approximate Bayesian computation. We…

Machine Learning · Computer Science 2017-08-03 Philip Bachman , Doina Precup

We consider a reconstruction problem of a reduced stable positive network system with the preservation of the original interconnection structure based on an $H^2$ optimal model reduction problem with constraints. To this end, we define an…

Optimization and Control · Mathematics 2022-10-24 Kazuhiro Sato

Efficient unsupervised training and inference in deep generative models remains a challenging problem. One basic approach, called Helmholtz machine, involves training a top-down directed generative model together with a bottom-up auxiliary…

Machine Learning · Computer Science 2016-05-26 Jorg Bornschein , Samira Shabanian , Asja Fischer , Yoshua Bengio

We apply a generative AI pattern-recognition technique called PatternBoost to study bootstrap percolation on hypercubes. With this, we slightly improve the best existing upper bound for the size of percolating subsets of the hypercube.

Machine Learning · Computer Science 2024-12-02 Gergely Bérczi , Adam Zsolt Wagner

Robustness of deep neural networks against adversarial perturbations is a pressing concern motivated by recent findings showing the pervasive nature of such vulnerabilities. One method of characterizing the robustness of a neural network…

Machine Learning · Statistics 2021-03-15 Hisham Husain , Borja Balle

Verifying correctness of deep neural networks (DNNs) is challenging. We study a generic reachability problem for feed-forward DNNs which, for a given set of inputs to the network and a Lipschitz-continuous function over its outputs,…

Machine Learning · Computer Science 2018-05-08 Wenjie Ruan , Xiaowei Huang , Marta Kwiatkowska

Certified robustness is a critical property for deploying neural networks (NN) in safety-critical applications. A principle approach to achieving such guarantees is to constrain the global Lipschitz constant of the network. However,…

Machine Learning · Computer Science 2025-07-01 Zain ul Abdeen , Vassilis Kekatos , Ming Jin

We present a generative predictive control (GPC) framework that amortizes sampling-based Model Predictive Control (SPC) by bootstrapping it with conditional flow-matching models trained on SPC control sequences collected in simulation.…