English
Related papers

Related papers: Learning Robust Markov Models for Safe Runtime Mon…

200 papers

In this paper, we explore the class of the Hidden Semi-Markov Model (HSMM), a flexible extension of the popular Hidden Markov Model (HMM) that allows the underlying stochastic process to be a semi-Markov chain. HSMMs are typically used less…

Applications · Statistics 2023-01-26 Patrick Aschermayr , Konstantinos Kalogeropoulos

The Hidden Markov Model (HMM) can predict the future value of a time series based on its current and previous values, making it a powerful algorithm for handling various types of time series. Numerous studies have explored the improvement…

Machine Learning · Computer Science 2024-02-28 YeXin Huang

In order to operate safely on the road, autonomous vehicles need not only to be able to identify objects in front of them, but also to be able to estimate the risk level of the object in front of the vehicle automatically. It is obvious…

Robotics · Computer Science 2019-04-24 Songlin Xu , Jiacheng Zhu

In this article, we use the theory of quantum channels and open quantum systems to provide an efficient unitary characterization of a class of stochastic generators known as quantum hidden Markov models (QHMMs). By utilizing the unitary…

Quantum Physics · Physics 2025-02-27 Vanio Markov , Vladimir Rastunkov , Amol Deshmukh , Daniel Fry , Charlee Stefanski

Industrial processes generate a massive amount of monitoring data that can be exploited to uncover hidden time losses in the system. This can be used to enhance the accuracy of maintenance policies and increase the effectiveness of the…

Applications · Statistics 2025-08-27 Fernando Miguelez , Josu Doncel , Maria Dolores Ugarte

We introduce the Reduced-Rank Hidden Markov Model (RR-HMM), a generalization of HMMs that can model smooth state evolution as in Linear Dynamical Systems (LDSs) as well as non-log-concave predictive distributions as in…

Machine Learning · Computer Science 2009-12-23 Sajid M. Siddiqi , Byron Boots , Geoffrey J. Gordon

With the increasing use of neural networks in critical systems, runtime monitoring becomes essential to reject unsafe predictions during inference. Various techniques have emerged to establish rejection scores that maximize the separability…

Machine Learning · Computer Science 2024-05-22 Khoi Tran Dang , Kevin Delmas , Jérémie Guiochet , Joris Guérin

Hidden Markov Models (HMMs) are one of the most fundamental and widely used statistical tools for modeling discrete time series. In general, learning HMMs from data is computationally hard (under cryptographic assumptions), and…

Machine Learning · Computer Science 2012-07-10 Daniel Hsu , Sham M. Kakade , Tong Zhang

With the increased popularity of smart phones, there is a greater need to have a robust authentication mechanism that handles various security threats and privacy leakages effectively. This paper studies continuous authentication for touch…

Cryptography and Security · Computer Science 2017-12-25 Aditi Roy , Tzipora Halevi , Nasir Memon

As deep neural networks continue to revolutionize various application domains, there is increasing interest in making these powerful models more understandable and interpretable, and narrowing down the causes of good and bad predictions. We…

Machine Learning · Statistics 2016-10-04 Viktoriya Krakovna , Finale Doshi-Velez

The paper presents a robust parameter learning methodology for identification of nonlinear dynamical system from data while satisfying safety and stability constraints in the context of learning from demonstration (LfD) methods. Extreme…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Iman Salehi , Ghananeel Rotithor , Ashwin P. Dani

We consider the task of learning mappings from sequential data to real-valued responses. We present and evaluate an approach to learning a type of hidden Markov model (HMM) for regression. The learning process involves inferring the…

Machine Learning · Computer Science 2012-06-18 Keith Noto , Mark Craven

Runtime verification or runtime monitoring equips safety-critical cyber-physical systems to augment design assurance measures and ensure operational safety and security. Cyber-physical systems have interaction failures, attack surfaces, and…

Software Engineering · Computer Science 2022-06-23 Smitha Gautham , Georgios Bakirtzis , Alexander Will , Athira V. Jayakumar , Carl R. Elks

The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state…

Applications · Statistics 2014-01-16 Vasanthan Raghavan , Aram Galstyan , Alexander G. Tartakovsky

We present Learned Risk Metric Maps (LRMM) for real-time estimation of coherent risk metrics of high dimensional dynamical systems operating in unstructured, partially observed environments. LRMM models are simple to design and train --…

Robotics · Computer Science 2023-03-01 Ross Allen , Wei Xiao , Daniela Rus

Stochastic dynamical systems have emerged as fundamental models across numerous application domains, providing powerful mathematical representations for capturing uncertain system behavior. In this paper, we address the problem of runtime…

Systems and Control · Electrical Eng. & Systems 2025-11-13 Shenghua Feng , Jie An , Fanjiang Xu

In learning-enabled autonomous systems, safety monitoring of learned components is crucial to ensure their outputs do not lead to system safety violations, given the operational context of the system. However, developing a safety monitor…

Machine Learning · Computer Science 2024-12-23 Sepehr Sharifi , Andrea Stocco , Lionel C. Briand

Wearable devices including accelerometers are increasingly being used to collect high-frequency human activity data in situ. There is tremendous potential to use such data to inform medical decision making and public health policies.…

Computation · Statistics 2020-06-12 Zekun Xu , Eric B. Laber , Ana-Maria Staicu

1. Electronic telemetry is frequently used to document animal movement through time. Methods that can identify underlying behaviors driving specific movement patterns can help us understand how and why animals use available space, thereby…

This paper presents a novel approach that combines the advantages of both model-based and learning-based frameworks to achieve robust locomotion. The residual modules are integrated with each corresponding part of the model-based framework,…

Robotics · Computer Science 2025-07-25 Min-Gyu Kim , Dongyun Kang , Hajun Kim , Hae-Won Park