English
Related papers

Related papers: Influence-Augmented Online Planning for Complex En…

200 papers

Advancements in reinforcement learning have led to the development of sophisticated models capable of learning complex decision-making tasks. However, efficiently integrating world models with decision transformers remains a challenge. In…

Language agents based on large language models (LLMs) have demonstrated great promise in automating web-based tasks. Recent work has shown that incorporating advanced planning algorithms, e.g., tree search, is advantageous over reactive…

Artificial Intelligence · Computer Science 2025-04-02 Yu Gu , Kai Zhang , Yuting Ning , Boyuan Zheng , Boyu Gou , Tianci Xue , Cheng Chang , Sanjari Srivastava , Yanan Xie , Peng Qi , Huan Sun , Yu Su

In the sequential decision making setting, an agent aims to achieve systematic generalization over a large, possibly infinite, set of environments. Such environments are modeled as discrete Markov decision processes with both states and…

Machine Learning · Computer Science 2023-03-31 Mirco Mutti , Riccardo De Santi , Emanuele Rossi , Juan Felipe Calderon , Michael Bronstein , Marcello Restelli

Active inference has emerged as an alternative approach to control problems given its intuitive (probabilistic) formalism. However, despite its theoretical utility, computational implementations have largely been restricted to…

Machine Learning · Computer Science 2022-03-01 Aswin Paul , Noor Sajid , Manoj Gopalkrishnan , Adeel Razi

We develop an online gradient algorithm for optimizing the performance of product-form networks through online adjustment of control parameters. The use of standard algorithms for finding optimal parameter settings is hampered by the…

Optimization and Control · Mathematics 2012-08-31 Jaron Sanders , Sem C. Borst , Johan S. H. van Leeuwaarden

This paper investigates a new approach to model-based reinforcement learning using background planning: mixing (approximate) dynamic programming updates and model-free updates, similar to the Dyna architecture. Background planning with…

Machine Learning · Computer Science 2024-06-04 Kevin Roice , Parham Mohammad Panahi , Scott M. Jordan , Adam White , Martha White

Although reinforcement learning methods can achieve impressive results in simulation, the real world presents two major challenges: generating samples is exceedingly expensive, and unexpected perturbations or unseen situations cause…

Machine Learning · Computer Science 2019-03-01 Anusha Nagabandi , Ignasi Clavera , Simin Liu , Ronald S. Fearing , Pieter Abbeel , Sergey Levine , Chelsea Finn

We consider the problem of online learning of optimal control for repeatedly operated systems in the presence of parametric uncertainty. During each round of operation, environment selects system parameters according to a fixed but unknown…

Machine Learning · Computer Science 2016-09-20 Theja Tulabandhula

Enabling users to create their own simulations offers a powerful way to study team dynamics and performance. We introduce VirTLab, a system that allows researchers and practitioners to design interactive, customizable simulations of team…

As autonomous agents become more ubiquitous, they will eventually have to reason about the plans of other agents, which is known as theory of mind reasoning. We develop a planning-as-inference framework in which agents perform nested…

Artificial Intelligence · Computer Science 2020-03-06 Iris Rubi Seaman , Jan-Willem van de Meent , David Wingate

Effective decision-making in autonomous driving relies on accurate inference of other traffic agents' future behaviors. To achieve this, we propose an online belief-update-based behavior prediction model and an efficient planner for…

Robotics · Computer Science 2024-06-19 Zhiyu Huang , Chen Tang , Chen Lv , Masayoshi Tomizuka , Wei Zhan

We introduce a new software toolbox for agent-based simulation. Facilitating rapid prototyping by offering a user-friendly Python API, its core rests on an efficient C++ implementation to support simulation of large-scale multi-agent…

Computational Finance · Quantitative Finance 2022-09-22 Peter Belcak , Jan-Peter Calliess , Stefan Zohren

In order to optimise the costs and time of design of the new products while improving their quality, concurrent engineering is based on the digital model of these products. However, in order to be able to avoid definitively physical model…

Robotics · Computer Science 2008-10-22 Damien Chablat

The calibration of simulators for complex social systems aims to identify the optimal parameter that drives the output of the simulator best matching the target data observed from the system. As many social systems may change internally…

Neural and Evolutionary Computing · Computer Science 2026-01-28 Peng Yang , Zhenhua Yang , Boquan Jiang , Chenkai Wang , Ke Tang , Xin Yao

Efficient sampling in biomolecular simulations is critical for accurately capturing the complex dynamical behaviors of biological systems. Adaptive sampling techniques aim to improve efficiency by focusing computational resources on the…

Biomolecules · Quantitative Biology 2024-10-22 Hassan Nadeem , Diwakar Shukla

High-fidelity physics simulations are powerful tools in the design and optimization of charged particle accelerators. However, the computational burden of these simulations often limits their use in practice for design optimization and…

Accelerator Physics · Physics 2020-04-15 Auralee Edelen , Nicole Neveu , Yannick Huber , Mattias Frey , Christopher Mayes , Andreas Adelmann

The well-known influence maximization problem aims at maximizing the influence of one information cascade in a social network by selecting appropriate seed users prior to the diffusion process. In its adaptive version, additional seed users…

Social and Information Networks · Computer Science 2020-03-30 Guangmo Tong , Ruiqi Wang , Zheng Dong , Xiang Li

For discrete-time linear systems subject to parametric uncertainty described by random variables, we develop a sampling-based Stochastic Model Predictive Control algorithm. Unlike earlier results employing a scenario approximation, we…

Systems and Control · Computer Science 2016-06-21 Matthias Lorenzen , Fabrizio Dabbene , Roberto Tempo , Frank Allgöwer

This paper presents a hybrid online Partially Observable Markov Decision Process (POMDP) planning system that addresses the problem of autonomous navigation in the presence of multi-modal uncertainty introduced by other agents in the…

Robotics · Computer Science 2022-06-22 Himanshu Gupta , Bradley Hayes , Zachary Sunberg

Sampling-based motion planning is a well-established approach in autonomous driving, valued for its modularity and analytical tractability. In complex urban scenarios, however, uniform or heuristic sampling often produces many infeasible or…

Robotics · Computer Science 2026-03-24 Korbinian Moller , Roland Stroop , Mattia Piccinini , Alexander Langmann , Johannes Betz