English
Related papers

Related papers: Fine-Grained Complexity of Safety Verification

200 papers

Large Language Models (LLMs) face severe safety risks from jailbreak attacks, yet current safety testing largely relies on static datasets and lacks systematic criteria to evaluate test suite quality and adequacy. While coverage criteria…

Software Engineering · Computer Science 2026-05-13 Zeming Wei , Zhixin Zhang , Chengcan Wu , Yihao Zhang , Xiaokun Luan , Meng Sun

Neural networks have recently become popular for a wide variety of uses, but have seen limited application in safety-critical domains such as robotics near and around humans. This is because it remains an open challenge to train a neural…

Machine Learning · Computer Science 2021-07-19 Long Kiu Chung , Adam Dai , Derek Knowles , Shreyas Kousik , Grace X. Gao

Vulnerabilities severely threaten software systems, making the timely application of security patches crucial for mitigating attacks. However, software vendors often silently patch vulnerabilities with limited disclosure, where Security…

Software Engineering · Computer Science 2026-01-12 Qingyuan Li , Chenchen Yu , Chuanyi Li , Xin-Cheng Wen , Cheryl Lee , Cuiyun Gao , Bin Luo

There has been significant recent interest in devising verification techniques for learning-enabled controllers (LECs) that manage safety-critical systems. Given the opacity and lack of interpretability of the neural policies that govern…

Systems and Control · Electrical Eng. & Systems 2022-10-12 Zikang Xiong , Suresh Jagannathan

Optimizing noisy functions online, when evaluating the objective requires experiments on a deployed system, is a crucial task arising in manufacturing, robotics and many others. Often, constraints on safe inputs are unknown ahead of time,…

Optimization and Control · Mathematics 2023-06-06 Ilnura Usmanova , Yarden As , Maryam Kamgarpour , Andreas Krause

Ensuring the safety of neural networks under input uncertainty is a fundamental challenge in safety-critical applications. This paper builds on and expands Fazlyab's quadratic-constraint (QC) and semidefinite-programming (SDP) framework for…

Machine Learning · Computer Science 2025-09-23 Masako Kishida

We examine verification of concurrent programs under the total store ordering (TSO) semantics used by the x86 architecture. In our model, threads manipulate variables over infinite domains and they can check whether variables are related…

Formal Languages and Automata Theory · Computer Science 2024-01-22 Parosh Aziz Abdulla , Mohamed Faouzi Atig , Florian Furbach , Shashwat Garg

In this work, we study verification and synthesis problems for safety specifications over unknown discrete-time stochastic systems. When a model of the system is available, barrier certificates have been successfully applied for ensuring…

Systems and Control · Electrical Eng. & Systems 2023-09-12 Ali Salamati , Abolfazl Lavaei , Sadegh Soudjani , Majid Zamani

As large language models (LLMs) are increasingly deployed in risk-sensitive applications such as real-world open-ended question answering (QA), ensuring the trustworthiness of their outputs has become critical. Existing selective conformal…

Artificial Intelligence · Computer Science 2026-02-17 Qingni Wang , Yue Fan , Xin Eric Wang

Proving the linearizability of highly concurrent data structures, such as those using optimistic concurrency control, is a challenging task. The main difficulty is in reasoning about the view of the memory obtained by the threads, because…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-08-07 Yotam M. Y. Feldman , Constantin Enea , Adam Morrison , Noam Rinetzky , Sharon Shoham

In reconfiguration problems, we are given two feasible solutions to a graph problem and asked whether one can be transformed into the other via a sequence of feasible intermediate solutions under a given reconfiguration rule. While earlier…

Computational Complexity · Computer Science 2025-10-29 Shuichi Hirahara , Naoto Ohsaka , Tatsuhiro Suga , Akira Suzuki , Yuma Tamura , Xiao Zhou

The safety alignment of Large Language Models (LLMs) remains vulnerable to Harmful Fine-tuning (HFT). While existing defenses impose constraints on parameters, gradients, or internal representations, we observe that they can be effectively…

Cryptography and Security · Computer Science 2026-05-11 Guoxin Lu , Letian Sha , Qing Wang , Peijie Sun , Hao Zhou , Hua Dai , Fu Xiao

Weak-memory models are standard formal specifications of concurrency across hardware, programming languages, and distributed systems. A fundamental computational problem is consistency testing: is the observed execution of a concurrent…

Programming Languages · Computer Science 2023-11-16 Soham Chakraborty , Shankaranarayanan Krishna , Umang Mathur , Andreas Pavlogiannis

We propose a signal temporal logic (STL)-based framework that rigorously verifies the feasibility of a mission described in STL and synthesizes control to safely execute it. The proposed framework ensures safe and reliable operation through…

Systems and Control · Electrical Eng. & Systems 2026-02-27 Joonwon Choi , Kartik Anand Pant , Youngim Nam , Henry Hellmann , Karthik Nune , Inseok Hwang

We study safety verification for multithreaded programs with recursive parallelism (i.e. unbounded thread creation and recursion) as well as unbounded integer variables. Since the threads in each program configuration are structured in a…

Logic in Computer Science · Computer Science 2016-05-24 Matthew Hague , Anthony Widjaja Lin

Reasoning about hyperproperties of concurrent implementations, such as the guarantees these implementations provide to randomized client programs, has been a long-standing challenge. Standard linearizability enables the use of atomic…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-08-21 Yoav Ben Shimon , Ori Lahav , Sharon Shoham

Deep Reinforcement Learning (DRL) has achieved impressive performance in robotics and autonomous systems (RAS). A key challenge to its deployment in real-life operations is the presence of spuriously unsafe DRL policies. Unexplored states…

Robotics · Computer Science 2024-01-31 Yi Dong , Xingyu Zhao , Sen Wang , Xiaowei Huang

We study the complexity of the model-checking problem for parameterized discrete-timed systems with arbitrarily many anonymous and identical processes, with and without a distinguished "controller", and communicating via synchronous…

Logic in Computer Science · Computer Science 2025-07-02 Benjamin Aminof , Sasha Rubin , Francesco Spegni , Florian Zuleger

Verification of neural networks enables us to gauge their robustness against adversarial attacks. Verification algorithms fall into two categories: exact verifiers that run in exponential time and relaxed verifiers that are efficient but…

Machine Learning · Computer Science 2020-01-13 Hadi Salman , Greg Yang , Huan Zhang , Cho-Jui Hsieh , Pengchuan Zhang

Despite the improved accuracy of deep neural networks, the discovery of adversarial examples has raised serious safety concerns. In this paper, we study two variants of pointwise robustness, the maximum safe radius problem, which for a…

Machine Learning · Computer Science 2020-04-07 Min Wu , Matthew Wicker , Wenjie Ruan , Xiaowei Huang , Marta Kwiatkowska