English
Related papers

Related papers: Formal Verification of Robustness and Resilience o…

200 papers

Learning-based methods could provide solutions to many of the long-standing challenges in control. However, the neural networks (NNs) commonly used in modern learning approaches present substantial challenges for analyzing the resulting…

Machine Learning · Computer Science 2022-02-03 Michael Everett

We review state-of-the-art formal methods applied to the emerging field of the verification of machine learning systems. Formal methods can provide rigorous correctness guarantees on hardware and software systems. Thanks to the availability…

Programming Languages · Computer Science 2021-04-22 Caterina Urban , Antoine Miné

As hardware and software systems have grown in complexity, formal methods have been indispensable tools for rigorously specifying acceptable behaviors, synthesizing programs to meet these specifications, and validating the correctness of…

Robotics · Computer Science 2026-02-10 Anastasios Manganaris , Vittorio Giammarino , Ahmed H. Qureshi , Suresh Jagannathan

The certification of autonomous systems is an important concern in science and industry. The KI-LOK project explores new methods for certifying and safely integrating AI components into autonomous trains. We pursued a two-layered approach:…

Logic in Computer Science · Computer Science 2024-11-22 Jan Gruteser , Jan Roßbach , Fabian Vu , Michael Leuschel

Robustness verification that aims to formally certify the prediction behavior of neural networks has become an important tool for understanding model behavior and obtaining safety guarantees. However, previous methods can usually only…

Machine Learning · Computer Science 2020-12-24 Zhouxing Shi , Huan Zhang , Kai-Wei Chang , Minlie Huang , Cho-Jui Hsieh

The paper presents a robust parameter learning methodology for identification of nonlinear dynamical system from data while satisfying safety and stability constraints in the context of learning from demonstration (LfD) methods. Extreme…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Iman Salehi , Ghananeel Rotithor , Ashwin P. Dani

The robustness of neural networks is crucial in safety-critical applications, where identifying a reliable input space is essential for effective model selection, robustness evaluation, and the development of reliable control strategies.…

Machine Learning · Computer Science 2025-06-04 Mohamad Fares El Hajj Chehade , Wenting Li , Brian W. Bell , Russell Bent , Saif R. Kazi , Hao Zhu

The tracking method based on the extreme learning machine (ELM) is efficient and effective. ELM randomly generates input weights and biases in the hidden layer, and then calculates and computes the output weights by reducing the iterative…

Machine Learning · Computer Science 2018-07-27 Jing Zhang , Huibing Wang , Yonggong Ren

The increasing use of Machine Learning (ML) components embedded in autonomous systems -- so-called Learning-Enabled Systems (LESs) -- has resulted in the pressing need to assure their functional safety. As for traditional functional safety,…

Software Engineering · Computer Science 2023-01-16 Yi Dong , Wei Huang , Vibhav Bharti , Victoria Cox , Alec Banks , Sen Wang , Xingyu Zhao , Sven Schewe , Xiaowei Huang

To provide safety guarantees for learning-based control systems, recent work has developed formal verification methods to apply after training ends. However, if the trained policy does not meet the specifications, or there is conservatism…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Puja Chaudhury , Alexander Estornell , Michael Everett

Legged locomotion has recently achieved remarkable success with the progress of machine learning techniques, especially deep reinforcement learning (RL). Controllers employing neural networks have demonstrated empirical and qualitative…

Robotics · Computer Science 2024-06-03 Fan Shi , Chong Zhang , Takahiro Miki , Joonho Lee , Marco Hutter , Stelian Coros

Structural identification and damage detection can be generalized as the simultaneous estimation of input forces, physical parameters, and dynamical states. Although Kalman-type filters are efficient tools to address this problem, the…

Applications · Statistics 2022-10-04 Daniz Teymouri , Omid Sedehi , Lambros S. Katafygiotis , Costas Papadimitriou

Learning enabled autonomous systems provide increased capabilities compared to traditional systems. However, the complexity of and probabilistic nature in the underlying methods enabling such capabilities present challenges for current…

Software Engineering · Computer Science 2023-01-03 Christian Ellis , Maggie Wigness , Lance Fiondella

Planning safe motions for legged robots requires sophisticated safety verification tools. However, designing such tools for such complex systems is challenging due to the nonlinear and high-dimensional nature of these systems' dynamics. In…

Robotics · Computer Science 2022-02-28 Junhyeok Ahn , Seung Hyeon Bang , Carlos Gonzalez , Yuanchen Yuan , Luis Sentis

Contemporary AI systems achieve extraordinary performance yet remain opaque and non-verifiable, creating a crisis of trust for safety-critical deployment. We introduce MathLedger, a substrate for verifiable machine cognition that integrates…

Artificial Intelligence · Computer Science 2026-01-06 Ismail Ahmad Abdullah

Cyber-Physical Systems (CPS) in domains such as manufacturing and energy distribution generate complex time series data crucial for Prognostics and Health Management (PHM). While Deep Learning (DL) methods have demonstrated strong…

Machine Learning · Computer Science 2025-12-16 Alexander Windmann , Henrik Steude , Daniel Boschmann , Oliver Niggemann

The topic of provable deep neural network robustness has raised considerable interest in recent years. Most research has focused on adversarial robustness, which studies the robustness of perceptive models in the neighbourhood of particular…

Machine Learning · Computer Science 2019-11-26 Julien Girard-Satabin , Guillaume Charpiat , Zakaria Chihani , Marc Schoenauer

Despite the tremendous advances that have been made in the last decade on developing useful machine-learning applications, their wider adoption has been hindered by the lack of strong assurance guarantees that can be made about their…

Machine Learning · Computer Science 2019-07-18 He Zhu , Zikang Xiong , Stephen Magill , Suresh Jagannathan

Evaluating large language models (LLMs) has become increasingly challenging as model capabilities advance rapidly. While recent models often achieve higher scores on standard benchmarks, these improvements do not consistently reflect…

Computation and Language · Computer Science 2025-08-21 Haiquan Hu , Jiazhi Jiang , Shiyou Xu , Ruhan Zeng , Tian Wang

A safety verification task involves verifying a system against a desired safety property under certain assumptions about the environment. However, these environmental assumptions may occasionally be violated due to modeling errors or…

Systems and Control · Electrical Eng. & Systems 2023-06-05 Rômulo Meira-Góes , Ian Dardik , Eunsuk Kang , Stéphane Lafortune , Stavros Tripakis