English
Related papers

Related papers: PrIC3: Property Directed Reachability for MDPs

200 papers

The text generated by large language models is commonly controlled by prompting, where a prompt prepended to a user's query guides the model's output. The prompts used by companies to guide their models are often treated as secrets, to be…

Computation and Language · Computer Science 2024-08-09 Yiming Zhang , Nicholas Carlini , Daphne Ippolito

Model checking undiscounted reachability and expected-reward properties on Markov decision processes (MDPs) is key for the verification of systems that act under uncertainty. Popular algorithms are policy iteration and variants of value…

Logic in Computer Science · Computer Science 2023-01-25 Arnd Hartmanns , Sebastian Junges , Tim Quatmann , Maximilian Weininger

We propose a demonstration-efficient strategy to compress a computationally expensive Model Predictive Controller (MPC) into a more computationally efficient representation based on a deep neural network and Imitation Learning (IL). By…

Robotics · Computer Science 2021-09-27 Andrea Tagliabue , Dong-Ki Kim , Michael Everett , Jonathan P. How

We introduce a sound and complete coinductive proof system for reachability properties in transition systems generated by logically constrained term rewriting rules over an order-sorted signature modulo builtins. A key feature of the…

Logic in Computer Science · Computer Science 2018-04-24 Ştefan Ciobâcă , Dorel Lucanu

We give an incremental, inductive (IC3) procedure to check coverability of well-structured transition systems. Our procedure generalizes the IC3 procedure for safety verification that has been successfully applied in finite-state hardware…

Logic in Computer Science · Computer Science 2013-02-25 Johannes Kloos , Rupak Majumdar , Filip Niksic , Ruzica Piskac

Property-directed reachability (PDR) is a SAT/SMT-based reachability algorithm that incrementally constructs inductive invariants. After it was successfully applied to hardware model checking, several adaptations to software model checking…

Software Engineering · Computer Science 2020-02-25 Dirk Beyer , Matthias Dangl

Property elicitation studies which attributes of a probability distribution can be determined by minimizing a risk. We investigate a generalization of property elicitation to imprecise probabilities (IP). This investigation is motivated by…

Machine Learning · Statistics 2025-12-01 James Bailie , Rabanus Derr

Recommending items to potentially interested users has been an important commercial task that faces two main challenges: accuracy and explainability. While most collaborative filtering models rely on statistical computations on a large…

Information Retrieval · Computer Science 2024-05-07 Lei Pan , Von-Wun Soo

Binary decision diagrams can compactly represent vast sets of states, mitigating the state space explosion problem in model checking. Probabilistic systems, however, require multi-terminal diagrams storing rational numbers. They are…

Logic in Computer Science · Computer Science 2020-01-14 Ernst Moritz Hahn , Arnd Hartmanns

Probabilistic modeling is cyclical: we specify a model, infer its posterior, and evaluate its performance. Evaluation drives the cycle, as we revise our model based on how it performs. This requires a metric. Traditionally, predictive…

Machine Learning · Statistics 2016-05-25 Alp Kucukelbir , David M. Blei

A preference system $\mathcal{I}$ is an undirected graph where vertices have preferences over their neighbors, and $\mathcal{I}$ admits a master list if all preferences can be derived from a single ordering over all vertices. We study the…

Computational Complexity · Computer Science 2022-12-13 Ildikó Schlotter

Provenance metadata can be valuable in data sharing settings, where it can be used to help data consumers form judgements regarding the reliability of the data produced by third parties. However, some parts of provenance may be sensitive,…

Databases · Computer Science 2014-06-10 Paolo Missier , Jeremy Bryans , Carl Gamble , Vasa Curcin , Roxana Danger

Large-scale pre-trained models are increasingly adapted to downstream tasks through a new paradigm called prompt learning. In contrast to fine-tuning, prompt learning does not update the pre-trained model's parameters. Instead, it only…

Cryptography and Security · Computer Science 2023-10-19 Yixin Wu , Rui Wen , Michael Backes , Pascal Berrang , Mathias Humbert , Yun Shen , Yang Zhang

In this work we describe preferential Description Logics of typicality, a nonmonotonic extension of standard Description Logics by means of a typicality operator T allowing to extend a knowledge base with inclusions of the form T(C) v D,…

Artificial Intelligence · Computer Science 2020-04-24 Laura Giordano , Valentina Gliozzi , Antonio Lieto , Nicola Olivetti , Gian Luca Pozzato

The Pairwise Markov Chain (PMC) is a probabilistic graphical model extending the well-known Hidden Markov Model. This model, although highly effective for many tasks, has been scarcely utilized for continuous value prediction. This is…

Machine Learning · Statistics 2025-08-12 Elie Azeraf

This paper studies parametric Markov decision processes (pMDPs), an extension to Markov decision processes (MDPs) where transitions probabilities are described by polynomials over a finite set of parameters. Fixing values for all parameters…

Logic in Computer Science · Computer Science 2019-04-03 Tobias Winkler , Sebastian Junges , Guillermo A. Pérez , Joost-Pieter Katoen

Item Response Theory (IRT) aims to assess latent abilities of respondents based on the correctness of their answers in aptitude test items with different difficulty levels. In this paper, we propose the $\beta^3$-IRT model, which models…

Machine Learning · Statistics 2019-06-04 Yu Chen , Telmo Silva Filho , Ricardo B. C. Prudêncio , Tom Diethe , Peter Flach

The main benefit of model predictive control (MPC) is its ability to steer the system to a given reference without violating the constraints while minimizing some objective. Furthermore, a suitably designed MPC controller guarantees…

Systems and Control · Electrical Eng. & Systems 2024-06-25 Pablo Krupa , Daniel Limon , Teodoro Alamo

Multi-dimensional classification (MDC) can be employed in a range of applications where one needs to predict multiple class variables for each given instance. Many existing MDC methods suffer from at least one of inaccuracy, scalability,…

Machine Learning · Computer Science 2023-11-28 Vu-Linh Nguyen , Yang Yang , Cassio de Campos

SMT-based model checkers, especially IC3-style ones, are currently the most effective techniques for verification of infinite state systems. They infer global inductive invariants via local reasoning about a single step of the transition…

Logic in Computer Science · Computer Science 2020-05-28 Hari Govind V K , YuTing Chen , Sharon Shoham , Arie Gurfinkel