English
Related papers

Related papers: STL-SVPIO: Signal Temporal Logic guided Stein Vari…

200 papers

This work presents an efficient method to solve a class of continuous-time, continuous-space stochastic optimal control problems of robot motion in a cluttered environment. The method builds upon a path integral representation of the…

Systems and Control · Computer Science 2016-03-10 Jung-Su Ha , Han-Lim Choi

This study considers the control problem with signal temporal logic (STL) specifications. Prior works have adopted smoothing techniques to address this problem within a feasible time frame and solve the problem by applying sequential…

Systems and Control · Electrical Eng. & Systems 2024-01-30 Yoshinari Takayama , Kazumune Hashimoto , Toshiyuki Ohtsuka

Reward design is a key component of deep reinforcement learning, yet some tasks and designer's objectives may be unnatural to define as a scalar cost function. Among the various techniques, formal methods integrated with DRL have garnered…

Artificial Intelligence · Computer Science 2023-10-24 Jiangwei Wang , Shuo Yang , Ziyan An , Songyang Han , Zhili Zhang , Rahul Mangharam , Meiyi Ma , Fei Miao

We propose a Reinforcement Learning (RL) based control design framework for handling complex tasks. The approach extends the concept of Reward Machines (RM) with Signal Temporal Logic (STL) formulas that can be used for event generation.…

Artificial Intelligence · Computer Science 2026-04-17 Ana María Gómez Ruiz , Thao Dang , Alexandre Donzé

While Large Language Models (LLM) enable non-experts to specify open-world multi-robot tasks, the generated plans often lack kinematic feasibility and are not efficient, especially in long-horizon scenarios. Formal methods like Linear…

Robotics · Computer Science 2026-02-11 Shuyuan Hu , Tao Lin , Kai Ye , Yang Yang , Tianwei Zhang

Spatio-Temporal predictive Learning is a self-supervised learning paradigm that enables models to identify spatial and temporal patterns by predicting future frames based on past frames. Traditional methods, which use recurrent neural…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Andrea Alfarano , Alberto Alfarano , Linda Friso , Andrea Bacciu , Irene Amerini , Fabrizio Silvestri

Model Predictive Control (MPC) enables reliable trajectory optimization under dynamics constraints, but often depends on accurate dynamics models and carefully hand-designed cost functions. Recent learning-based MPC methods aim to reduce…

Robotics · Computer Science 2026-03-05 Shizhe Cai , Zeya Yin , Jayadeep Jacob , Fabio Ramos

In-context imitation learning allows robots to acquire skills from demonstrations, yet one-shot trajectory generation remains fragile under environmental variation. We propose SAIL, a framework that reframes robot imitation as an iterative…

Robotics · Computer Science 2026-03-10 Makoto Sato , Yusuke Iwasawa , Yujin Tang , So Kuroki

We investigate the task and motion planning problem for dynamical systems under signal temporal logic (STL) specifications. Existing works on STL control synthesis mainly focus on generating plans that satisfy properties over a single…

Systems and Control · Electrical Eng. & Systems 2025-09-04 Jianing Zhao , Bowen Ye , Xinyi Yu , Rupak Majumdar , Xiang Yin

Urban Air Mobility (UAM), or the scenario where multiple manned and Unmanned Aerial Vehicles (UAVs) carry out various tasks over urban airspaces, is a transportation concept of the future that is gaining prominence. UAM missions with…

Systems and Control · Electrical Eng. & Systems 2020-10-01 Yash Vardhan Pant , He Yin , Murat Arcak , Sanjit A. Seshia

Multimodal reasoning in vision-language models (VLMs) typically relies on a two-stage process: supervised fine-tuning (SFT) and reinforcement learning (RL). In standard SFT, all tokens contribute equally to the loss, even though reasoning…

Artificial Intelligence · Computer Science 2026-03-20 Shaked Perek , Ben Wiesel , Avihu Dekel , Nimrod Shabtay , Eli Schwartz

Signal Temporal Logic (STL) is a powerful framework for describing the complex temporal and logical behaviour of the dynamical system. Numerous studies have attempted to employ reinforcement learning to learn a controller that enforces STL…

Systems and Control · Electrical Eng. & Systems 2023-12-05 Naman Saxena , Gorantla Sandeep , Pushpak Jagtap

Simulating the long-term dynamics of multi-scale and multi-physics systems poses a significant challenge in understanding complex phenomena across science and engineering. The complexity arises from the intricate interactions between scales…

Machine Learning · Computer Science 2025-09-22 Da Long , Shandian Zhe , Samuel Williams , Leonid Oliker , Zhe Bai

Reinforcement Learning (RL) is crucial for unlocking the complex reasoning capabilities of Diffusion-based Large Language Models (dLLMs). However, applying RL to dLLMs faces unique challenges in efficiency and stability. To address these…

Artificial Intelligence · Computer Science 2026-02-10 Jiawei Liu , Xiting Wang , Yuanyuan Zhong , Defu Lian , Yu Yang

Autonomous robots typically incorporate complex sensors in their decision-making and control loops. These sensors, such as cameras and Lidars, have imperfections in their sensing and are influenced by environmental conditions. In this…

Systems and Control · Electrical Eng. & Systems 2023-05-01 Guy Scher , Sadra Sadraddini , Russ Tedrake , Hadas Kress-Gazit

Formulating mathematical models from real-world decision problems is a core task in Operational Research, yet it typically requires considerable human expertise and effort, limiting practical application. Recent advances in large language…

Optimization and Control · Mathematics 2025-11-05 Qingyang Li , Lele Zhang , Vicky Mak-Hau

Optimizing high-level mission planning constraints is traditionally solved in exponential time and requires to split the problem into several ones, making the connections between them a convoluted task. This paper aims at generalizing…

Optimization and Control · Mathematics 2024-10-11 Thomas Claudet , Davide Martire , Damiana Losa , Francesco Sanfedino , Daniel Alazard

This paper addresses the problem of reliably and efficiently solving broad classes of long-horizon stochastic path planning problems. Starting with a vanilla RL formulation with a stochastic dynamics simulator and an occupancy matrix of the…

Machine Learning · Computer Science 2022-12-09 Naman Shah , Siddharth Srivastava

We propose an interval extension of Signal Temporal Logic (STL) called Interval Signal Temporal Logic (\ISTL). Given an STL formula, we consider an interval inclusion function for each of its predicates. Then, we use minimal inclusion…

Systems and Control · Electrical Eng. & Systems 2023-12-13 Luke Baird , Akash Harapanahalli , Samuel Coogan

Simulating trajectories of dynamical systems is a fundamental problem in a wide range of fields such as molecular dynamics, biochemistry, and pedestrian dynamics. Machine learning has become an invaluable tool for scaling physics-based…

Machine Learning · Computer Science 2026-05-28 Kiet Bennema ten Brinke , Koen Minartz , Vlado Menkovski