English
Related papers

Related papers: Optimistic Verifiable Training by Controlling Hard…

200 papers

Trustworthy AI is a critical issue in machine learning where, in addition to training a model that is accurate, one must consider both fair and robust training in the presence of data bias and poisoning. However, the existing model fairness…

Machine Learning · Computer Science 2020-07-06 Yuji Roh , Kangwook Lee , Steven Euijong Whang , Changho Suh

As machine learning models, specifically neural networks, are becoming increasingly popular, there are concerns regarding their trustworthiness, specially in safety-critical applications, e.g. actions of an autonomous vehicle must be safe.…

Machine Learning · Computer Science 2023-12-15 Kshitij Goyal , Sebastijan Dumancic , Hendrik Blockeel

While trade-offs between modeling effort and model accuracy remain a major concern with system identification, resorting to data-driven methods often leads to a complete disregard for physical plausibility. To address this issue, we propose…

Systems and Control · Electrical Eng. & Systems 2022-08-23 Oliver Schön , Ricarda-Samantha Götte , Julia Timmermann

Despite decades of research and recent progress in adaptive control and reinforcement learning, there remains a fundamental lack of understanding in designing controllers that provide robustness to inherent non-asymptotic uncertainties…

Machine Learning · Computer Science 2021-08-13 Benjamin Gravell , Tyler Summers

Robust control is a core approach for controlling systems with performance guarantees that are robust to modeling error, and is widely used in real-world systems. However, current robust control approaches can only handle small system…

Optimization and Control · Mathematics 2021-06-08 Dimitar Ho , Hoang M. Le , John C. Doyle , Yisong Yue

We consider numerical approaches for deterministic, finite-dimensional optimal control problems whose dynamics depend on unknown or uncertain parameters. We seek to amortize the solution over a set of relevant parameters in an offline stage…

Optimization and Control · Mathematics 2024-02-16 Deepanshu Verma , Nick Winovich , Lars Ruthotto , Bart van Bloemen Waanders

Decentralized training of deep neural networks has attracted significant attention for its theoretically superior scalability over synchronous data-parallel methods like All-Reduce. However, realizing this potential in multi-node training…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-10-17 Zesen Wang , Jiaojiao Zhang , Xuyang Wu , Mikael Johansson

In this work we release our extensible and easily configurable neural network training software. It provides a rich set of functional layers with a particular focus on efficient training of recurrent neural network topologies on multiple…

Machine Learning · Computer Science 2017-01-11 Patrick Doetsch , Albert Zeyer , Paul Voigtlaender , Ilya Kulikov , Ralf Schlüter , Hermann Ney

The desire to use reinforcement learning in safety-critical settings has inspired a recent interest in formal methods for learning algorithms. Existing formal methods for learning and optimization primarily consider the problem of…

Artificial Intelligence · Computer Science 2019-06-05 Nathan Fulton , Andre Platzer

When designing controllers for safety-critical systems, practitioners often face a challenging tradeoff between robustness and performance. While robust control methods provide rigorous guarantees on system stability under certain…

Machine Learning · Computer Science 2021-04-27 Priya L. Donti , Melrose Roderick , Mahyar Fazlyab , J. Zico Kolter

This work studies the robustness certification problem of neural network models, which aims to find certified adversary-free regions as large as possible around data points. In contrast to the existing approaches that seek regions bounded…

Machine Learning · Computer Science 2019-07-15 Chen Liu , Ryota Tomioka , Volkan Cevher

To achieve reliable, robust, and safe AI systems, it is vital to implement fallback strategies when AI predictions cannot be trusted. Certifiers for neural networks are a reliable way to check the robustness of these predictions. They…

Machine Learning · Computer Science 2023-10-04 Tobias Lorenz , Marta Kwiatkowska , Mario Fritz

Driven by the flexible manufacturing trend in the process control industry and the uncertain nature of chemical process models, this article aims to achieve offset-free tracking for a family of uncertain nonlinear systems (e.g., using…

Systems and Control · Electrical Eng. & Systems 2022-05-10 Lai Wei , Ryan McCloy , Jie Bao

Verification of deep neural networks has witnessed a recent surge of interest, fueled by success stories in diverse domains and by abreast concerns about safety and security in envisaged applications. Complexity and sheer size of such…

Machine Learning · Computer Science 2020-03-18 Dario Guidotti , Francesco Leofante , Luca Pulina , Armando Tacchella

The highly non-linear nature of deep neural networks causes them to be susceptible to adversarial examples and have unstable gradients which hinders interpretability. However, existing methods to solve these issues, such as adversarial…

Machine Learning · Computer Science 2023-01-11 Suraj Srinivas , Kyle Matoba , Himabindu Lakkaraju , Francois Fleuret

We consider a nonlinear control system modeled as an ordinary differential equation subject to disturbance, with a state feedback controller parameterized as a feedforward neural network. We propose a framework for training controllers with…

Machine Learning · Computer Science 2025-11-12 Akash Harapanahalli , Samuel Coogan

As robustness verification methods are becoming more precise, training certifiably robust neural networks is becoming ever more relevant. To this end, certified training methods compute and then optimize an upper bound on the worst-case…

Machine Learning · Computer Science 2024-02-29 Yuhao Mao , Mark Niklas Müller , Marc Fischer , Martin Vechev

In the last decades, extreme classification has become an essential topic for deep learning. It has achieved great success in many areas, especially in computer vision and natural language processing (NLP). However, it is very challenging…

Machine Learning · Computer Science 2021-02-12 Liuyihan Song , Pan Pan , Kang Zhao , Hao Yang , Yiming Chen , Yingya Zhang , Yinghui Xu , Rong Jin

It has been witnessed that learned image compression has outperformed conventional image coding techniques and tends to be practical in industrial applications. One of the most critical issues that need to be considered is the…

Image and Video Processing · Electrical Eng. & Systems 2022-12-01 Dailan He , Ziming Yang , Yuan Chen , Qi Zhang , Hongwei Qin , Yan Wang

We study online learning settings in which experts act strategically to maximize their influence on the learning algorithm's predictions by potentially misreporting their beliefs about a sequence of binary events. Our goal is twofold.…

Machine Learning · Computer Science 2020-07-02 Rupert Freeman , David M. Pennock , Chara Podimata , Jennifer Wortman Vaughan