中文
相关论文

相关论文: Provable Lipschitz Certification for Generative Mo…

200 篇论文

This paper explores the problem of generative modeling, aiming to simulate diverse examples from an unknown distribution based on observed examples. While recent studies have focused on quantifying the statistical precision of popular…

统计理论 · 数学 2024-06-07 Elen Vardanyan , Sona Hunanyan , Tigran Galstyan , Arshak Minasyan , Arnak Dalalyan

Developing inherently interpretable models for prediction has gained prominence in recent years. A subclass of these models, wherein the interpretable network relies on learning high-level concepts, are valued because of closeness of…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Jayneel Parekh , Quentin Bouniot , Pavlo Mozharovskyi , Alasdair Newson , Florence d'Alché-Buc

This paper presents a framework for bounding the approximation error in imitation model predictive controllers utilizing neural networks. Leveraging the Lipschitz properties of these neural networks, we derive a bound that guides dataset…

系统与控制 · 电气工程与系统科学 2026-03-27 Hendrik Alsmeier , Lukas Theiner , Anton Savchenko , Ali Mesbah , Rolf Findeisen

Dramatic advances in generative models have resulted in near photographic quality for artificially rendered faces, animals and other objects in the natural world. In spite of such advances, a higher level understanding of vision and imagery…

计算机视觉与模式识别 · 计算机科学 2019-04-05 Raphael Gontijo Lopes , David Ha , Douglas Eck , Jonathon Shlens

This work proposes a novel distributed framework for verifying the incremental stability of large-scale systems with unknown dynamics and known interconnection structures using graph neural networks. Our proposed approach relies on the…

系统与控制 · 电气工程与系统科学 2025-12-09 Ahan Basu , Mahathi Anand , Pushpak Jagtap

Abstracting neural networks with constraints they impose on their inputs and outputs can be very useful in the analysis of neural network classifiers and to derive optimization-based algorithms for certification of stability and robustness…

机器学习 · 计算机科学 2021-05-04 Navid Hashemi , Justin Ruths , Mahyar Fazlyab

Generative network models are extremely useful for understanding the mechanisms that operate in network formation and are widely used across several areas of knowledge. However, when it comes to bipartite networks -- a class of network…

物理与社会 · 物理学 2019-10-29 Demival Vasques Filho , Dion R. J. O'Neale

Deep generative models are effective methods of modeling data. However, it is not easy for a single generative model to faithfully capture the distributions of complex data such as images. In this paper, we propose an approach for boosting…

机器学习 · 计算机科学 2019-05-14 Fan Bao , Hang Su , Jun Zhu

This paper proposes a novel approach to adaptive step sizes in stochastic gradient descent (SGD) by utilizing quantities that we have identified as numerically traceable -- the Lipschitz constant for gradients and a concept of the local…

最优化与控制 · 数学 2024-09-19 Frederik Köhne , Leonie Kreis , Anton Schiela , Roland Herzog

Score-based generative models can produce high quality image samples comparable to GANs, without requiring adversarial optimization. However, existing training procedures are limited to images of low resolution (typically below 32x32), and…

机器学习 · 计算机科学 2020-10-27 Yang Song , Stefano Ermon

Robustness certification against bounded input noise or adversarial perturbations is increasingly important for deployment recurrent neural networks (RNNs) in safety-critical control applications. To address this challenge, we present…

系统与控制 · 电气工程与系统科学 2025-09-23 Paul Hamelbeck , Johannes Schiffer

We introduce a new approach to learning in hierarchical latent-variable generative models called the "distributed distributional code Helmholtz machine", which emphasises flexibility and accuracy in the inferential process. In common with…

机器学习 · 统计学 2018-05-29 Eszter Vertes , Maneesh Sahani

We develop an approach to training generative models based on unrolling a variational auto-encoder into a Markov chain, and shaping the chain's trajectories using a technique inspired by recent work in Approximate Bayesian computation. We…

机器学习 · 计算机科学 2017-08-03 Philip Bachman , Doina Precup

We consider a reconstruction problem of a reduced stable positive network system with the preservation of the original interconnection structure based on an $H^2$ optimal model reduction problem with constraints. To this end, we define an…

最优化与控制 · 数学 2022-10-24 Kazuhiro Sato

Efficient unsupervised training and inference in deep generative models remains a challenging problem. One basic approach, called Helmholtz machine, involves training a top-down directed generative model together with a bottom-up auxiliary…

机器学习 · 计算机科学 2016-05-26 Jorg Bornschein , Samira Shabanian , Asja Fischer , Yoshua Bengio

We apply a generative AI pattern-recognition technique called PatternBoost to study bootstrap percolation on hypercubes. With this, we slightly improve the best existing upper bound for the size of percolating subsets of the hypercube.

机器学习 · 计算机科学 2024-12-02 Gergely Bérczi , Adam Zsolt Wagner

Robustness of deep neural networks against adversarial perturbations is a pressing concern motivated by recent findings showing the pervasive nature of such vulnerabilities. One method of characterizing the robustness of a neural network…

机器学习 · 统计学 2021-03-15 Hisham Husain , Borja Balle

Verifying correctness of deep neural networks (DNNs) is challenging. We study a generic reachability problem for feed-forward DNNs which, for a given set of inputs to the network and a Lipschitz-continuous function over its outputs,…

机器学习 · 计算机科学 2018-05-08 Wenjie Ruan , Xiaowei Huang , Marta Kwiatkowska

Certified robustness is a critical property for deploying neural networks (NN) in safety-critical applications. A principle approach to achieving such guarantees is to constrain the global Lipschitz constant of the network. However,…

机器学习 · 计算机科学 2025-07-01 Zain ul Abdeen , Vassilis Kekatos , Ming Jin

We present a generative predictive control (GPC) framework that amortizes sampling-based Model Predictive Control (SPC) by bootstrapping it with conditional flow-matching models trained on SPC control sequences collected in simulation.…