English
Related papers

Related papers: Probabilistic Black-Box Checking via Active MDP Le…

200 papers

Requirements driven search-based testing (also known as falsification) has proven to be a practical and effective method for discovering erroneous behaviors in Cyber-Physical Systems. Despite the constant improvements on the performance and…

Modern processor advancements have introduced security risks, particularly in the form of microarchitectural timing attacks. High-profile attacks such as Meltdown and Spectre have revealed critical flaws, compromising the entire system's…

Cryptography and Security · Computer Science 2024-10-23 Congcong Chen , Jinhua Cui , Jiliang Zhang

Markov chains and Markov decision processes (MDPs) are well-established probabilistic models. While finite Markov models are well-understood, analysing their infinite counterparts remains a significant challenge. Decisiveness has proven to…

Logic in Computer Science · Computer Science 2025-04-23 Nathalie Bertrand , Patricia Bouyer , Thomas Brihaye , Paulin Fournier , Pierre Vandenhove

We consider the problem of measuring how much a system reveals about its secret inputs. We work under the black-box setting: we assume no prior knowledge of the system's internals, and we run the system for choices of secrets and measure…

Cryptography and Security · Computer Science 2020-10-28 Giovanni Cherubin , Konstantinos Chatzikokolakis , Catuscia Palamidessi

We consider a class of partially observable Markov decision processes (POMDPs) with uncertain transition and/or observation probabilities. The uncertainty takes the form of probability intervals. Such uncertain POMDPs can be used, for…

Systems and Control · Computer Science 2018-07-12 Mohamadreza Ahmadi , Murat Cubuktepe , Nils Jansen , Ufuk Topcu

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

The problem of achieving a good trade-off in Stochastic Model Predictive Control between the competing goals of improving the average performance and reducing conservativeness, while still guaranteeing recursive feasibility and low…

Optimization and Control · Mathematics 2016-06-21 Matthias Lorenzen , Frank Allgöwer , Fabrizio Dabbene , Roberto Tempo

Barrier certificates provide functional overapproximations for the reachable set of dynamical systems and provide inductive guarantees on the safe evolution of the system. In automata-theoretic verification, a key query is to determine…

Formal Languages and Automata Theory · Computer Science 2026-01-22 Vishnu Murali , Ashutosh Trivedi , Majid Zamani

Black-box adversarial attacks have demonstrated strong potential to compromise machine learning models by iteratively querying the target model or leveraging transferability from a local surrogate model. Recently, such attacks can be…

Machine Learning · Computer Science 2024-09-09 Hanbin Hong , Xinyu Zhang , Binghui Wang , Zhongjie Ba , Yuan Hong

Industrial embedded systems are typically used to execute simple control algorithms due to their low computational resources. Despite these limitations, the implementation of advanced control techniques such as Model Predictive Control…

Systems and Control · Electrical Eng. & Systems 2025-11-06 Victor Gracia , Pablo Krupa , Filiberto Fele , Teodoro Alamo

We study the offline data-driven sequential decision making problem in the framework of Markov decision process (MDP). In order to enhance the generalizability and adaptivity of the learned policy, we propose to evaluate each policy by a…

Statistics Theory · Mathematics 2021-11-11 Zhengling Qi , Peng Liao

Information theory has been very successful in obtaining performance limits for various problems such as communication, compression and hypothesis testing. Likewise, stochastic control theory provides a characterization of optimal policies…

Information Theory · Computer Science 2018-10-15 Dhruva Kartik , Ekraam Sabir , Urbashi Mitra , Prem Natarajan

We consider a class of optimization problems over stochastic variables where the algorithm can learn information about the value of any variable through a series of costly steps; we model this information acquisition process as a Markov…

Data Structures and Algorithms · Computer Science 2025-07-25 Shuchi Chawla , Dimitris Christou , Amit Harlev , Ziv Scully

To be responsive to dynamically changing real-world environments, an intelligent agent needs to perform complex sequential decision-making tasks that are often guided by commonsense knowledge. The previous work on this line of research led…

Artificial Intelligence · Computer Science 2019-08-01 Yi Wang , Shiqi Zhang , Joohyung Lee

Large language models play a crucial role in modern natural language processing technologies. However, their extensive use also introduces potential security risks, such as the possibility of black-box attacks. These attacks can embed…

Computation and Language · Computer Science 2025-02-25 Daniil Khomsky , Narek Maloyan , Bulat Nutfullin

The deployment of autonomous systems in safety-critical environments requires control policies that guarantee satisfaction of complex control specifications. These systems are commonly modeled as nonlinear discrete-time stochastic systems.…

Systems and Control · Electrical Eng. & Systems 2026-04-07 Alessandro Riccardi , Thom Badings , Luca Laurenti , Alessandro Abate , Bart De Schutter

The use of sophisticated machine learning models for critical decision making is faced with a challenge that these models are often applied as a "black-box". This has led to an increased interest in interpretable machine learning, where…

Artificial Intelligence · Computer Science 2020-07-22 Catarina Moreira , Yu-Liang Chou , Mythreyi Velmurugan , Chun Ouyang , Renuka Sindhgatta , Peter Bruza

This article applies Machine Learning techniques to solve Intrusion Detection problems within computer networks. Due to complex and dynamic nature of computer networks and hacking techniques, detecting malicious activities remains a…

Neural and Evolutionary Computing · Computer Science 2009-11-04 Tich Phuoc Tran , Longbing Cao , Dat Tran , Cuong Duc Nguyen

We present a meta-algorithm for learning a posterior-inference algorithm for restricted probabilistic programs. Our meta-algorithm takes a training set of probabilistic programs that describe models with observations, and attempts to learn…

Machine Learning · Computer Science 2021-12-28 Gwonsoo Che , Hongseok Yang

The closed-loop performance of model predictive controllers (MPCs) is sensitive to the choice of prediction models, controller formulation, and tuning parameters. However, prediction models are typically optimized for prediction accuracy…

Systems and Control · Electrical Eng. & Systems 2020-11-25 Farshud Sorourifar , Georgios Makrygirgos , Ali Mesbah , Joel A. Paulson