English
Related papers

Related papers: CBF-LLM: Safe Control for LLM Alignment

200 papers

A predictive control barrier function (PCBF) based safety filter is a modular framework to verify safety of a control input by predicting a future trajectory. The approach relies on the solution of two optimization problems, first computing…

Systems and Control · Electrical Eng. & Systems 2023-07-25 Alexandre Didier , Robin C. Jacobs , Jerome Sieber , Kim P. Wabersich , Melanie N. Zeilinger

This contribution introduces a centralized input constrained optimal control framework based on multiple control barrier functions (CBFs) to coordinate connected and automated agents at intersections. For collision avoidance, we propose a…

Optimization and Control · Mathematics 2022-07-12 Alexander Katriniok

Generative large language models (LLMs) have achieved state-of-the-art results on a wide range of tasks, yet they remain susceptible to backdoor attacks: carefully crafted triggers in the input can manipulate the model to produce…

Artificial Intelligence · Computer Science 2025-05-20 Yige Li , Hanxun Huang , Yunhan Zhao , Xingjun Ma , Jun Sun

Large Language Models (LLMs) have shown remarkable capabilities in code generation tasks, yet they face significant limitations in handling complex, long-context programming challenges and demonstrating complex compositional reasoning…

Artificial Intelligence · Computer Science 2025-01-14 Amr Almorsi , Mohanned Ahmed , Walid Gomaa

This paper develops a model-based reinforcement learning (MBRL) framework for learning online the value function of an infinite-horizon optimal control problem while obeying safety constraints expressed as control barrier functions (CBFs).…

Machine Learning · Computer Science 2022-11-10 Max H. Cohen , Calin Belta

Because of the scalability issues associated with the symbolic controller synthesis approach, employing it in a multi-agent system (MAS) framework becomes difficult. In this paper, we present a novel approach for synthesizing distributed…

Systems and Control · Electrical Eng. & Systems 2023-12-14 David Smith Sundarsingh , Ratnangshu Das , Adnane Saoud , Pushpak Jagtap

Learning-based control with safety guarantees usually requires real-time safety certification and modifications of possibly unsafe learning-based policies. The control barrier function (CBF) method uses a safety filter containing a…

Systems and Control · Electrical Eng. & Systems 2024-10-25 Kanghui He , Shengling Shi , Ton van den Boom , Bart De Schutter

Large Language Models (LLMs) show remarkable capabilities in understanding natural language and generating complex code. However, as practitioners adopt CodeLLMs for increasingly critical development tasks, research reveals that these…

Cryptography and Security · Computer Science 2026-03-13 Maximilian Wendlinger , Daniel Kowatsch , Konstantin Böttinger , Philip Sperl

Iterative code generation with Large Language Models (LLMs) can be viewed as an optimization process guided by textual feedback. However, existing LLM self-correction methods predominantly operate in a stateless, trial-and-error manner akin…

Machine Learning · Computer Science 2026-03-31 Zizheng Zhang , Yuyang Liao , Chen Chen , Jian He , Dun Wu , Qianjin Yu , Yanqin Gao , Jin Yang , Kailai Zhang , Eng Siong Chng , Xionghu Zhong

This paper presents a framework for designing provably safe feedback controllers for sampled-data control affine systems with measurement and actuation uncertainties. Based on the interval Taylor model of nonlinear functions, a sampled-data…

Optimization and Control · Mathematics 2022-10-13 Yuhao Zhang , Sequoyah Walters , Xiangru Xu

This paper considers the safety-critical navigation problem with Signal Temporal Logic (STL) tasks. We developed an explicit reference governor-guided control barrier function (ERG-guided CBF) method that enables the application of…

Systems and Control · Electrical Eng. & Systems 2024-07-10 Kaier Liang , Mingyu Cai , Cristian-Ioan Vasile

Inspired by the success of imitation and inverse reinforcement learning in replicating expert behavior through optimal control, we propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs). We…

Systems and Control · Electrical Eng. & Systems 2020-11-10 Alexander Robey , Haimin Hu , Lars Lindemann , Hanwen Zhang , Dimos V. Dimarogonas , Stephen Tu , Nikolai Matni

Robots operating in dynamic, unstructured environments must balance safety and efficiency under potentially limited sensing. While control barrier functions (CBFs) provide principled collision avoidance via safety filtering, their behavior…

Robotics · Computer Science 2026-03-24 Jeffrey Chen , Rohan Chandra

The safety of training task policies and their subsequent application using reinforcement learning (RL) methods has become a focal point in the field of safe RL. A central challenge in this area remains the establishment of theoretical…

Robotics · Computer Science 2025-05-02 Chenggang Wang , Xinyi Wang , Yutong Dong , Lei Song , Xinping Guan

Although Large Language Models (LLMs) have established pre-dominance in automated code generation, they are not devoid of shortcomings. The pertinent issues primarily relate to the absence of execution guarantees for generated code, a lack…

Large Language Models (LLMs) have advanced rapidly in recent years, demonstrating strong capabilities in problem comprehension and reasoning. Inspired by these developments, researchers have begun exploring the use of LLMs as decentralized…

Robotics · Computer Science 2025-05-13 Peihan Li , Lifeng Zhou

Multi-task learning (MTL) benefits the fine-tuning of large language models (LLMs) by providing a single model with improved performance and generalization ability across tasks, presenting a resource-efficient alternative to developing…

Computation and Language · Computer Science 2024-10-29 Zi Gong , Hang Yu , Cong Liao , Bingchang Liu , Chaoyu Chen , Jianguo Li

Optimal control strategies are often combined with safety certificates to ensure both performance and safety in safety-critical systems. A prominent example is combining Model Predictive Control (MPC) with Control Barrier Functions (CBF).…

Systems and Control · Electrical Eng. & Systems 2025-12-05 Kerim Dzhumageldyev , Filippo Airaldi , Azita Dabiri

Control barrier functions (CBF) have become popular as a safety filter to guarantee the safety of nonlinear dynamical systems for arbitrary inputs. However, it is difficult to construct functions that satisfy the CBF constraints for high…

Optimization and Control · Mathematics 2023-12-06 Oswin So , Zachary Serlin , Makai Mann , Jake Gonzales , Kwesi Rutledge , Nicholas Roy , Chuchu Fan

Balancing safety and performance is one of the predominant challenges in modern control system design. Moreover, it is crucial to robustly ensure safety without inducing unnecessary conservativeness that degrades performance. In this work…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Anil Alan , Andrew J. Taylor , Chaozhe R. He , Aaron D. Ames , Gabor Orosz