English
Related papers

Related papers: Relating System Safety and Machine Learnt Model Pe…

200 papers

Machine learning (ML) has recently created many new success stories. Hence, there is a strong motivation to use ML technology in software-intensive systems, including safety-critical systems. This raises the issue of safety verification of…

Software Engineering · Computer Science 2020-07-01 Hermann Kaindl , Stefan Kramer

Evaluating tracking model performance is a complicated task, particularly for non-contiguous, multi-object trackers that are crucial in defense applications. While there are various excellent tracking benchmarks available, this work expands…

Computer Vision and Pattern Recognition · Computer Science 2022-06-16 Kenneth Rapko , Wanlin Xie , Andrew Walsh

Performance monitoring of object detection is crucial for safety-critical applications such as autonomous vehicles that operate under varying and complex environmental conditions. Currently, object detectors are evaluated using summary…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Quazi Marufur Rahman , Niko Sünderhauf , Feras Dayoub

Most safety testing efforts for large language models (LLMs) today focus on evaluating foundation models. However, there is a growing need to evaluate safety at the application level, as components such as system prompts, retrieval…

Software Engineering · Computer Science 2025-07-15 Jia Yi Goh , Shaun Khoo , Nyx Iskandar , Gabriel Chua , Leanne Tan , Jessica Foo

In the realm of control systems, model predictive control (MPC) has exhibited remarkable potential; however, its reliance on accurate models and substantial computational resources has hindered its broader application, especially within…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Amin Vahidi-Moghaddam , Kaian Chen , Kaixiang Zhang , Zhaojian Li , Yan Wang , Kai Wu

Advances in machine learning (ML) in recent years have enabled a dizzying array of applications such as data analytics, autonomous systems, and security diagnostics. ML is now pervasive---new systems and models are being deployed in every…

Cryptography and Security · Computer Science 2016-11-14 Nicolas Papernot , Patrick McDaniel , Arunesh Sinha , Michael Wellman

Autonomous drone racing presents a challenging control problem, requiring real-time decision-making and robust handling of nonlinear system dynamics. While iterative learning model predictive control (LMPC) offers a promising framework for…

Robotics · Computer Science 2025-09-23 Haocheng Zhao , Niklas Schlüter , Lukas Brunke , Angela P. Schoellig

Human motion prediction is non-trivial in modern industrial settings. Accurate prediction of human motion can not only improve efficiency in human robot collaboration, but also enhance human safety in close proximity to robots. Among…

Robotics · Computer Science 2020-01-28 Weiye Zhao , Liting Sun , Changliu Liu , Masayoshi Tomizuka

Reinforcement Learning (RL) applications in real-world scenarios must prioritize safety and reliability, which impose strict constraints on agent behavior. Model-based RL leverages predictive world models for action planning and policy…

Artificial Intelligence · Computer Science 2025-06-06 Artem Latyshev , Gregory Gorbov , Aleksandr I. Panov

This paper is about a real-time model predictive control (MPC) algorithm for a particular class of model based controllers, whose objective consists of a nominal tracking objective and an additional learning objective. Here, the…

Optimization and Control · Mathematics 2016-11-09 Xuhui Feng , Boris Houska

Model Predictive Control (MPC) is an optimal control algorithm with strong stability and robustness guarantees. Despite its popularity in robotics and industrial applications, the main challenge in deploying MPC is its high computation…

Systems and Control · Electrical Eng. & Systems 2024-12-31 Camilo Gonzalez , Houshyar Asadi , Lars Kooijman , Chee Peng Lim

In model-predictive control (MPC), achieving the best closed-loop performance under a given computational resource is the underlying design consideration. This paper analyzes the MPC design problem with control performance and required…

Optimization and Control · Mathematics 2016-04-25 Vincent Bachtiar , Chris Manzie , William H. Moase , Eric C. Kerrigan

Accurate and robust trajectory predictions of road users are needed to enable safe automated driving. To do this, machine learning models are often used, which can show erratic behavior when presented with previously unseen inputs. In this…

Artificial Intelligence · Computer Science 2023-04-05 Manuel Muñoz Sánchez , Emilia Silvas , Jos Elfring , René van de Molengraft

This paper demonstrates the applicability of the safe model predictive control (SMPC) framework to autonomous driving scenarios, focusing on the design of adaptive cruise control (ACC) and automated lane-change systems. Building on the SMPC…

Systems and Control · Electrical Eng. & Systems 2025-05-12 Francesco Prignoli , Ying Shuai Quan , Mohammad Jeddi , Jonas Sjöberg , Paolo Falcone

Todays industrial control systems consist of tightly coupled components allowing adversaries to exploit security attack surfaces from the information technology side, and, thus, also get access to automation devices residing at the…

Software Engineering · Computer Science 2023-06-26 Mukund Bhole , Wolfgang Kastner , Thilo Sauter

This work is dedicated to the study of how uncertainty estimation of the human motion prediction can be embedded into constrained optimization techniques, such as Model Predictive Control (MPC) for the social robot navigation. We propose…

Robotics · Computer Science 2023-07-19 Timur Akhtyamov , Aleksandr Kashirin , Aleksey Postnikov , Gonzalo Ferrer

We propose a method for deploying a safety-critical machine-learning component into continuously evolving environments where an increased degree of automation in the engineering process is desired. We associate semantic tags with the safety…

The predictive capabilities of machine learning (ML) models used in materials discovery are typically measured using simple statistics such as the root-mean-square error (RMSE) or the coefficient of determination ($r^2$) between…

Object detection is increasingly used onboard Unmanned Aerial Vehicles (UAV) for various applications; however, the machine learning (ML) models for UAV-based detection are often validated using data curated for tasks unrelated to the UAV…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Eung-Joo Lee , Damon M. Conover , Shuvra S. Bhattacharyyaa , Heesung Kwon , Jason Hill , Kenneth Evensen

A variety of different performance metrics are commonly used in the machine learning literature for the evaluation of classification systems. Some of the most common ones for measuring quality of hard decisions are standard and balanced…

Machine Learning · Computer Science 2023-09-22 Luciana Ferrer