English
Related papers

Related papers: Vision-Based Runtime Monitoring under Varying Spec…

200 papers

Runtime monitoring is one of the central tasks to provide operational decision support to running business processes, and check on-the-fly whether they comply with constraints and rules. We study runtime monitoring of properties expressed…

Artificial Intelligence · Computer Science 2014-05-02 Giuseppe De Giacomo , Riccardo De Masellis , Marco Grasso , Fabrizio Maggi , Marco Montali

Recent years have seen an increasing use of Signal Temporal Logic (STL) as a formal specification language for symbolic control, due to its expressiveness and closeness to natural language. Furthermore, STL specifications can be encoded as…

Systems and Control · Electrical Eng. & Systems 2020-06-11 Yann Gilpin , Vince Kurtz , Hai Lin

Spatio-temporal reasoning is essential in understanding real-world environments in various fields, eg, autonomous driving and sports analytics. Recent advances have improved the spatial reasoning ability of Vision-Language Models (VLMs) by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Dohwan Ko , Sihyeon Kim , Yumin Suh , Vijay Kumar B. G , Minseo Yoon , Manmohan Chandraker , Hyunwoo J. Kim

Safety verification for autonomous vehicles (AVs) and ground robots is crucial for ensuring reliable operation given their uncertain environments. Formal language tools provide a robust and sound method to verify safety rules for such…

Robotics · Computer Science 2025-01-24 Aditya Parameshwaran , Yue Wang

Visual object tracking is essential to intelligent robots. Most existing approaches have ignored the online latency that can cause severe performance degradation during real-world processing. Especially for unmanned aerial vehicles (UAVs),…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Bowen Li , Ziyuan Huang , Junjie Ye , Yiming Li , Sebastian Scherer , Hang Zhao , Changhong Fu

We define a fragment of metric first-order temporal logic formulas that guarantees the finiteness of their table representations. We extend our fragment's definition to cover the temporal dual operators trigger and release and show that our…

Logic in Computer Science · Computer Science 2022-06-20 Jonathan Julian Huerta y Munive

Spatio-temporal predictive learning is a learning paradigm that enables models to learn spatial and temporal patterns by predicting future frames from given past frames in an unsupervised manner. Despite remarkable progress in recent years,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Cheng Tan , Siyuan Li , Zhangyang Gao , Wenfei Guan , Zedong Wang , Zicheng Liu , Lirong Wu , Stan Z. Li

Recurrent Neural Networks (RNNs) can learn to predict Signal Temporal Logic (STL) verdicts online from partial trajectories, but deploying them as runtime monitors in safety-critical systems demands more than predictive accuracy. Standard…

Machine Learning · Computer Science 2026-05-26 Sai Sandeep Damera , Ryan Matheu , Aniruddh G. Puranic , John S. Baras , Calin Belta

Robotics foundation models have demonstrated strong capabilities in executing natural language instructions across diverse tasks and environments. However, they remain largely data-driven and lack formal guarantees on safety and…

Robotics · Computer Science 2026-03-19 Sadık Bera Yüksel , Derya Aksaray

Verification of temporal logic properties plays a crucial role in proving the desired behaviors of continuous systems. In this paper, we propose an interval method that verifies the properties described by a bounded signal temporal logic.…

Logic in Computer Science · Computer Science 2016-02-09 Daisuke Ishii , Naoki Yonezaki , Alexandre Goldsztejn

Hyperproperties, such as non-interference and observational determinism, relate multiple system executions to each other. They are not expressible in standard temporal logics, like LTL, CTL, and CTL*, and thus cannot be monitored with…

Logic in Computer Science · Computer Science 2018-07-03 Bernd Finkbeiner , Christopher Hahn , Marvin Stenger , Leander Tentrup

In this paper, we present a simple, flexible and effective vision-language (VL) tracking pipeline, termed \textbf{MMTrack}, which casts VL tracking as a token generation task. Traditional paradigms address VL tracking task indirectly with…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Yaozong Zheng , Bineng Zhong , Qihua Liang , Guorong Li , Rongrong Ji , Xianxian Li

Ensuring safety in autonomous systems with vision-based control remains a critical challenge due to the high dimensionality of image inputs and the fact that the relationship between true system state and its visual manifestation is…

Robotics · Computer Science 2025-11-12 Xinhang Ma , Junlin Wu , Hussein Sibai , Yiannis Kantaros , Yevgeniy Vorobeychik

One of the fundamental challenges in the design of perception systems for autonomous vehicles is validating the performance of each algorithm under a comprehensive variety of operating conditions. In the case of vision-based semantic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Wei Zhou , Julie Stephany Berrio , Stewart Worrall , Eduardo Nebot

Signal Temporal Logic (STL) is expressive formal language that specifies spatio-temporal requirements in robotics. Its quantitative robustness semantics can be easily integrated with optimization-based control frameworks. However, STL…

Robotics · Computer Science 2026-03-10 Tianhao Wu , Yiwei Lyu

Monitoring consists in deciding whether a log meets a given specification. In this work, we propose an automata-based formalism to monitor logs in the form of actions associated with time stamps and arbitrarily data values over infinite…

Formal Languages and Automata Theory · Computer Science 2019-07-31 Masaki Waga , Étienne André , Ichiro Hasuo

Recurrent neural networks are able to learn complex long-term relationships from sequential data and output a pdf over the state space. Therefore, recurrent models are a natural choice to address path prediction tasks, where a trained model…

Computer Vision and Pattern Recognition · Computer Science 2018-08-30 Ronny Hug , Stefan Becker , Wolfgang Hübner , Michael Arens

Accurate single-object tracking and short-term motion forecasting remain challenging under occlusion, scale variation, and temporal drift, which disrupt the temporal coherence required for real-time perception. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhongping Dong , Pengyang Yu , Shuangjian Li , Liming Chen , Mohand Tahar Kechadi

In this paper we study a multi-robot path planning problem for persistent monitoring of an environment. We represent the areas to be monitored as the vertices of a weighted graph. For each vertex, there is a constraint on the maximum time…

Robotics · Computer Science 2019-03-15 Ahmad Bilal Asghar , Stephen L. Smith , Shreyas Sundaram

Time-sensitive machine learning benefits from Sequential Probability Ratio Test (SPRT), which provides an optimal stopping time for early classification of time series. However, in finite horizon scenarios, where input lengths are finite,…

Machine Learning · Computer Science 2025-01-31 Akinori F. Ebihara , Taiki Miyagawa , Kazuyuki Sakurai , Hitoshi Imaoka