English
Related papers

Related papers: Optimal switching strategies for navigation in sto…

200 papers

Robots and self-driving vehicles face a number of challenges when navigating through real environments. Successful navigation in dynamic environments requires prioritizing subtasks and monitoring resources. Animals are under similar…

Robotics · Computer Science 2019-09-17 Jinwei Xing , Xinyun Zou , Jeffrey L. Krichmar

Navigation in cluttered underwater environments is challenging, especially when there are constraints on communication and self-localisation. Part of the fully distributed underwater navigation problem has been resolved by introducing…

Robotics · Computer Science 2026-02-26 Kanzhong Yao , Ognjen Marjanovic , Simon Watson

We introduce data-driven decision-making algorithms that achieve state-of-the-art \emph{dynamic regret} bounds for non-stationary bandit settings. These settings capture applications such as advertisement allocation, dynamic pricing, and…

Machine Learning · Computer Science 2021-03-19 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

Most theories of behavior posit that agents tend to maximize some form of reward or utility. However, animals very often move with curiosity and seem to be motivated in a reward-free manner. Here we abandon the idea of reward maximization,…

Artificial Intelligence · Computer Science 2024-02-27 Jorge Ramírez-Ruiz , Dmytro Grytskyy , Chiara Mastrogiuseppe , Yamen Habib , Rubén Moreno-Bote

Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and…

Motivated by recent studies in human balance control, we study a delayed random walk with an unstable fixed point. It is observed that the random walker moves away from the unstable fixed point more slowly than is observed in the absence of…

Other Condensed Matter · Physics 2009-11-11 Tadaaki Hosaka , Toru Ohira , Christian Luciani , Juan Luis Cabrera , John G. Milton

Many real-world optimization problems occur in environments that change dynamically or involve stochastic components. Evolutionary algorithms and other bio-inspired algorithms have been widely applied to dynamic and stochastic problems.…

Neural and Evolutionary Computing · Computer Science 2020-01-30 Vahid Roostapour , Mojgan Pourhassan , Frank Neumann

The study of navigation behaviour and the associated brain dynamics have been a focus increasing research over the last decades. Coinciding with this has been an increased focus on a more ecological understanding of cognition. Here we…

Neurons and Cognition · Quantitative Biology 2026-03-13 Pablo Fernandez Velasco , Antoine Coutrot , Hugo J. Spiers

We propose a new sequential decision-making setting, combining key aspects of two established online learning problems with bandit feedback. The optimal action to play at any given moment is contingent on an underlying changing state which…

Machine Learning · Computer Science 2023-11-07 Alexander Galozy , Slawomir Nowaczyk , Mattias Ohlsson

The mammalian spatial navigation system makes use of several different sensory information channels. This information is then converted into a neural code that represents the animal's current position in space by engaging place cell, grid…

Neurons and Cognition · Quantitative Biology 2015-07-16 Daniel B Poll , Khanh Nguyen , Zachary P Kilpatrick

This paper is concerned with the problem of designing agents able to dynamically select information from multiple data sources in order to tackle tasks that involve tracking a target behavior while optimizing a reward. We formulate this…

Optimization and Control · Mathematics 2021-06-11 Émiland Garrabé , Giovanni Russo

Many complex real world phenomena exhibit abrupt, intermittent or jumping behaviors, which are more suitable to be described by stochastic differential equations under non-Gaussian L\'evy noise. Among these complex phenomena, the most…

Numerical Analysis · Mathematics 2023-09-15 Wei Wei , Ting Gao , Jinqiao Duan , Xiaoli Chen

Mobile robots are often tasked with repeatedly navigating through an environment whose traversability changes over time. These changes may exhibit some hidden structure, which can be learned. Many studies consider reactive algorithms for…

Robotics · Computer Science 2020-12-07 Florence Tsang , Tristan Walker , Ryan A. MacDonald , Armin Sadeghi , Stephen L. Smith

Understanding how decision makers balance operational efficiency with environmental and ecological risks is central to vessel navigation. We model vessel speed as a control variable in a constrained optimization framework in which vessel…

Applications · Statistics 2026-05-27 Mauli Pant , Linda Fernandez , Indranil Sahoo

Autonomous control systems use various sensors to decrease the amount of uncertainty under which they operate. While providing partial observation of the current state of the system, sensors require resources such as energy, time and…

Logic in Computer Science · Computer Science 2016-02-29 Eva Tesarova , Maria Svorenova , Jiri Barnat , Ivana Cerna

In this paper, we propose a new strategy for learning inertial robotic navigation models. The proposed strategy enhances the generalisability of end-to-end inertial modelling, and is aimed at wheeled robotic deployments. Concretely, the…

Machine Learning · Computer Science 2021-09-21 Mohammed Alloulah , Maximilian Arnold , Anton Isopoussu

Due to the sparse rewards and high degree of environment variation, reinforcement learning approaches such as Deep Deterministic Policy Gradient (DDPG) are plagued by issues of high variance when applied in complex real world environments.…

Robotics · Computer Science 2018-11-28 Linhai Xie , Yishu Miao , Sen Wang , Phil Blunsom , Zhihua Wang , Changhao Chen , Andrew Markham , Niki Trigoni

Recent advances in human mobility research have revealed consistent pairwise characteristics in movement behavior, yet existing mobility models often overlook the spatial and topological structure of mobility networks. By analyzing millions…

Physics and Society · Physics 2025-05-22 Lu Zhong , Lei Dong , Qi Wang , Chaoming Song , Jianxi Gao

We describe and study a transport based procedure called NetOTC (network optimal transition coupling) for the comparison and alignment of two networks. The networks of interest may be directed or undirected, weighted or unweighted, and may…

Machine Learning · Computer Science 2024-02-07 Bongsoo Yi , Kevin O'Connor , Kevin McGoff , Andrew B. Nobel

In most real scenarios the construction of a risk-neutral portfolio must be performed in discrete time and with transaction costs. Two human imposed constraints are the risk-aversion and the profit maximization, which together define a…

Risk Management · Quantitative Finance 2021-12-21 G. Mazzei , F. G. Bellora , J. A. Serur