English
Related papers

Related papers: Retrosynthesis Planning via Worst-path Policy Opti…

200 papers

To overcome the curse of dimensionality and curse of modeling in Dynamic Programming (DP) methods for solving classical Markov Decision Process (MDP) problems, Reinforcement Learning (RL) algorithms are popular. In this paper, we consider…

Machine Learning · Computer Science 2018-11-29 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

There exists a broad class of sequencing problems, for example, in proteins and polymers that can be formulated as a heuristic search algorithm that involve decision making akin to a computer game. AI gaming algorithms such as Monte Carlo…

Soft Condensed Matter · Physics 2020-06-08 Tarak K Patra , Troy D. Loeffler , Subramanian K R S Sankaranarayanan

In this paper we investigate the optimal controller synthesis problem, so that the system under the controller can reach a specified target set while satisfying given constraints. Existing model predictive control (MPC) methods learn from a…

Optimization and Control · Mathematics 2023-06-22 Dejin Ren , Wanli Lu , Jidong Lv , Lijun Zhang , Bai Xue

We consider the problem of controlling a fully specified Markov decision process (MDP), also known as the planning problem, when the state space is very large and calculating the optimal policy is intractable. Instead, we pursue the more…

Optimization and Control · Mathematics 2019-01-09 Yasin Abbasi-Yadkori , Peter L. Bartlett , Xi Chen , Alan Malek

Bioprocesses are often characterised by nonlinear and uncertain dynamics, posing particular challenges for model predictive control (MPC) algorithms due to their computational demands when applied to nonlinear systems. Recent advances in…

Optimization and Control · Mathematics 2025-02-05 Niels Krausch , Martin Doff-Sotta , Mark Cannon , Peter Neubauer , Mariano Nicolas Cruz Bournazou

Numerically computing global policies to optimal control problems for complex dynamical systems is mostly intractable. In consequence, a number of approximation methods have been developed. However, none of the current methods can quantify…

Robotics · Computer Science 2021-03-05 Ashwin Khadke , Hartmut Geyer

In this paper, we consider solving discounted Markov Decision Processes (MDPs) under the constraint that the resulting policy is stabilizing. In practice MDPs are solved based on some form of policy approximation. We will leverage recent…

Machine Learning · Computer Science 2021-02-03 Mario Zanon , Sébastien Gros , Michele Palladino

We consider a multi-source relaying system where independent sources randomly generate status update packets which are sent to the destination with the aid of a relay through unreliable links. We develop transmission scheduling policies to…

Signal Processing · Electrical Eng. & Systems 2023-01-10 Abolfazl Zakeri , Mohammad Moltafet , Markus Leinonen , Marian Codreanu

Following the occurrence of an extreme natural or man-made event, community recovery management should aim at providing optimal restoration policies for a community over a planning horizon. Calculating such optimal restoration polices in…

Systems and Control · Computer Science 2019-09-16 Saeed Nozhati , Yugandhar Sarkale , Edwin K. P. Chong , Bruce R. Ellingwood

We propose a new policy, called the LP-update policy, to solve finite horizon weakly-coupled Markov decision processes. The latter can be seen as multi-constraint multi-action bandits, and generalize the classical restless bandit problems.…

Optimization and Control · Mathematics 2024-05-08 Nicolas Gast , Bruno Gaujal , Chen Yan

The supertree construction problem is about combining several phylogenetic trees with possibly conflicting information into a single tree that has all the leaves of the source trees as its leaves and the relationships between the leaves are…

Computational Engineering, Finance, and Science · Computer Science 2020-02-19 Laura Koponen , Emilia Oikarinen , Tomi Janhunen , Laura Säilä

A well-known pitfall of molecular generative models is that they are not guaranteed to generate synthesizable molecules. Existing solutions for this problem often struggle to effectively navigate exponentially large combinatorial space of…

Machine Learning · Computer Science 2026-01-13 Seul Lee , Karsten Kreis , Srimukh Prasad Veccham , Meng Liu , Danny Reidenbach , Saee Paliwal , Weili Nie , Arash Vahdat

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

Path planning is a crucial algorithmic approach for designing robot behaviors. Sampling-based approaches, like rapidly exploring random trees (RRTs) or probabilistic roadmaps, are prominent algorithmic solutions for path planning problems.…

Robotics · Computer Science 2022-08-05 T. Dam , G. Chalvatzaki , J. Peters , J. Pajarinen

We consider online planning in Markov decision processes (MDPs). In online planning, the agent focuses on its current state only, deliberates about the set of possible policies from that state onwards and, when interrupted, uses the outcome…

Artificial Intelligence · Computer Science 2012-12-20 Zohar Feldman , Carmel Domshlak

In recent times, an increasing number of researchers have been devoted to utilizing deep neural networks for end-to-end flight navigation. This approach has gained traction due to its ability to bridge the gap between perception and…

Robotics · Computer Science 2024-10-11 Zhichao Han , Long Xu , Liuao Pei , Fei Gao

A reinforcement learning approach to design optimised graded metamaterials for mechanical energy confinement and amplification is described. Through the proximal policy optimisation algorithm, the reinforcement agent is trained to optimally…

Applied Physics · Physics 2023-02-27 Luca Rosafalco , Jacopo Maria De Ponti , Luca Iorio , Raffaele Ardito , Alberto Corigliano

We propose a novel approach for sampling-based and control-based motion planning that combines a representation of the environment obtained via a modified version of optimal Rapidly-exploring Random Trees (RRT*), with landmark-based…

Robotics · Computer Science 2021-06-01 Mahroo Bahreinian , Marc Mitjans , Roberto Tron

In computational phylogenetics, the problem of constructing a supertree of a given set of rooted input trees can be formalized in different ways, to cope with contradictory information in the input. We consider the Minimum Flip Supertree…

Data Structures and Algorithms · Computer Science 2011-04-25 Sebastian Böcker

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots