English
Related papers

Related papers: Markovian robots: minimal navigation strategies fo…

200 papers

Multi-robot navigation and path planning in continuous state and action spaces with uncertain environments remains an open challenge. Deep Reinforcement Learning (RL) is one of the most popular paradigms for solving this task, but its…

Robotics · Computer Science 2025-08-21 Jahid Chowdhury Choton , John Woods , William Hsu

Nanoscale devices - either biological or artificial - operate in a regime where the usual assumptions of a structureless, Markovian, bath do not hold. Being able to predict and study the dynamics of such systems is crucial and is usually…

Quantum Physics · Physics 2021-11-17 Thibaut Lacroix , Angus Dunnett , Dominic Gribben , Brendon W. Lovett , Alex Chin

Markovian jump linear systems (MJLS) are an important class of dynamical systems that arise in many control applications. In this paper, we introduce the problem of controlling unknown (discrete-time) MJLS as a new benchmark for…

Optimization and Control · Mathematics 2020-07-16 Joao Paulo Jansch-Porto , Bin Hu , Geir Dullerud

We consider state and parameter estimation for a dynamical system having both time-varying and time-invariant parameters. It has been shown that the robustness of the Markov Chain Monte Carlo (MCMC) algorithm for estimating time-invariant…

Computational Engineering, Finance, and Science · Computer Science 2022-10-18 Philippe Bisaillon , Brandon Robinson , Mohammad Khalil , Chris L. Pettit , Dominique Poirel , Abhijit Sarkar

Developing behavioral policies designed to efficiently solve target-search problems is a crucial issue both in nature and in the nanotechnology of the 21st century. Here, we characterize the target-search strategies of simple microswimmers…

Soft Condensed Matter · Physics 2023-07-25 Harpreet Kaur , Thomas Franosch , Michele Caraglio

We present a novel reinforcement learning (RL) based task allocation and decentralized navigation algorithm for mobile robots in warehouse environments. Our approach is designed for scenarios in which multiple robots are used to perform…

Robotics · Computer Science 2022-09-08 Aakriti Agrawal , Senthil Hariharan , Amrit Singh Bedi , Dinesh Manocha

Safe navigation of autonomous robots remains one of the core challenges in the field, especially in dynamic and uncertain environments. One of the prevalent approaches is safety filtering based on control barrier functions (CBFs), which are…

Robotics · Computer Science 2026-03-10 Bojan Derajić , Sebastian Bernhard , Wolfgang Hönig

Realistic quantum mechanical systems are always exposed to an external environment. The presence of the environment often gives rise to a Markovian process in which the system loses information to its surroundings. However, many quantum…

This paper deals with the design of time-invariant memoryless control policies for robots that move in a finite two- dimensional lattice and are tasked with persistent surveillance of an area in which there are forbidden regions. We model…

Systems and Control · Computer Science 2012-11-09 Eduardo Arvelo , Eric Kim , Nuno C. Martins

Navigating unknown three-dimensional (3D) rugged environments is challenging for multi-robot systems. Traditional discrete systems struggle with rough terrain due to limited individual mobility, while modular systems--where rigid,…

Robotics · Computer Science 2025-03-17 Runze Xiao , Yongdong Wang , Yusuke Tsunoda , Koichi Osuka , Hajime Asama

In daily domestic settings, frequently used objects like cups often have unfixed positions and multiple instances within the same category, and their carriers frequently change as well. As a result, it becomes challenging for a robot to…

Robotics · Computer Science 2025-01-09 Yujie Tang , Meiling Wang , Yinan Deng , Zibo Zheng , Jingchuan Deng , Yufeng Yue

Self-propelled particles serve as minimal models for emulating the dynamic self-organization of microorganisms, yet most synthetic systems remain limited to a single mode of motion, namely active Brownian particles (ABPs). Here, we present…

Memory effects arise in many complex systems, from protein folding, to the spreading of epidemics and financial decisions. While so-called non-Markovian dynamics is common in larger systems with interacting components, observations in…

The recently developed formalism of Markovian master equations for quantum open systems with external periodic driving is applied to the theory of dynamical decoupling by periodic control. This new approach provides a more detailed…

Quantum Physics · Physics 2015-09-01 Krzysztof Szczygielski , Robert Alicki

This work proposes a method for the two-dimensional simulation of Brownian particles in a fluid with restrictions. The method is based on simple numerical rules between two matrices. One of the matrix represent the identification of all…

Statistical Mechanics · Physics 2012-04-24 Eric Plaza

The non-Markovian nature of polymer motions is accounted for in folding kinetics, using frequency-dependent friction. Folding, like many other problems in the physics of disordered systems, involves barrier crossing on a correlated energy…

Statistical Mechanics · Physics 2009-10-30 Steven S. Plotkin , Peter G. Wolynes

We introduce methods for large scale Brownian Dynamics (BD) simulation of many rigid particles of arbitrary shape suspended in a fluctuating fluid. Our method adds Brownian motion to the rigid multiblob method at a cost comparable to the…

Soft Condensed Matter · Physics 2018-01-17 B. Sprinkle , F. Balboa Usabiaga , N. A. Patankar , A. Donev

It is believed that an isolated and far-from-equilibrium quantum many-body system should try to attain equilibrium via a mechanism whereby any given subsystem acts as an open quantum system that is coupled to an environment, which is the…

Quantum Physics · Physics 2025-07-08 Aditya Banerjee

Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and…

Scalable multi-robot transition is essential for ubiquitous adoption of robots. As a step towards it, a computationally efficient decentralized algorithm for continuous-time trajectory optimization in multi-robot scenarios based upon model…