English
Related papers

Related papers: Sparsity Inducing Representations for Policy Decom…

200 papers

Decentralized (PO)MDPs provide an expressive framework for sequential decision making in a multiagent system. Given their computational complexity, recent research has focused on tractable yet practical subclasses of Dec-POMDPs. We address…

Artificial Intelligence · Computer Science 2018-04-11 Duc Thien Nguyen , Akshat Kumar , Hoong Chuin Lau

Nonlinear trajectory optimization algorithms have been developed to handle optimal control problems with nonlinear dynamics and nonconvex constraints in trajectory planning. The performance and computational efficiency of many trajectory…

Optimization and Control · Mathematics 2024-01-17 Taewan Kim , Purnanand Elango , Danylo Malyuta , Behcet Acikmese

We describe a probabilistic framework for synthesizing control policies for general multi-robot systems, given environment and sensor models and a cost function. Decentralized, partially observable Markov decision processes (Dec-POMDPs) are…

Two new optimization techniques based on projections onto convex space (POCS) framework for solving convex optimization problems are presented. The dimension of the minimization problem is lifted by one and sets corresponding to the cost…

Data Structures and Algorithms · Computer Science 2013-09-04 Mohammad Tofighi , Kivanc Kose , Ahmet Enis Cetin

Optimally solving decentralized decision-making problems modeled as Dec-POMDPs is known to be NEXP-complete. These optimal solutions are policies based on the entire history of observations and actions of an agent. However, some…

Multiagent Systems · Computer Science 2026-04-13 Amit Sinha , Matthieu Geist , Aditya Mahajan

Motion planning and control problems are embedded and essential in almost all robotics applications. These problems are often formulated as stochastic optimal control problems and solved using dynamic programming algorithms. Unfortunately,…

Robotics · Computer Science 2018-01-12 Alex A. Gorodetsky , Sertac Karaman , Youssef M. Marzouk

Recent deep reinforcement learning methods have achieved remarkable success in solving multi-objective combinatorial optimization problems (MOCOPs) by decomposing them into multiple subproblems, each associated with a specific weight…

Artificial Intelligence · Computer Science 2026-03-23 Mingfeng Fan , Jianan Zhou , Yifeng Zhang , Yaoxin Wu , Jinbiao Chen , Guillaume Adrien Sartoretti

We present an Imitation Learning approach for the control of dynamical systems with a known model. Our policy search method is guided by solutions from MPC. Typical policy search methods of this kind minimize a distance metric between the…

Robotics · Computer Science 2020-02-18 Jan Carius , Farbod Farshidian , Marco Hutter

Task decomposition is a fundamental mechanism in program synthesis, enabling complex problems to be broken down into manageable subtasks. ExeDec, a state-of-the-art program synthesis framework, employs this approach by combining a Subgoal…

Software Engineering · Computer Science 2025-03-21 Janis Zenkner , Tobias Sesterhenn , Christian Bartelt

In optimization routines used for on-line Model Predictive Control (MPC), linear systems of equations are usually solved in each iteration. This is true both for Active Set (AS) methods as well as for Interior Point (IP) methods, and for…

Optimization and Control · Mathematics 2014-01-08 Daniel Axehill

Evaluating the causal impacts of possible interventions is crucial for informing decision-making, especially towards improving access to opportunity. However, if causal effects are heterogeneous and predictable from covariates, personalized…

Machine Learning · Computer Science 2024-04-30 Ezinne Nwankwo , Michael I. Jordan , Angela Zhou

Generally, discretization of partial differential equations (PDEs) creates a sequence of linear systems $A_k x_k = b_k, k = 0, 1, 2, ..., N$ with well-known and structured sparsity patterns. Preconditioners are often necessary to achieve…

Numerical Analysis · Mathematics 2024-06-26 Rishad Islam , Arielle Carr , Colin Jacobs

We systematically develop a learning-based treatment of stochastic optimal control (SOC), relying on direct optimization of parametric control policies. We propose a derivation of adjoint sensitivity results for stochastic differential…

Machine Learning · Computer Science 2021-06-08 Stefano Massaroli , Michael Poli , Stefano Peluchetti , Jinkyoo Park , Atsushi Yamashita , Hajime Asama

Diffusion models have seen rapid adoption in robotic imitation learning, enabling autonomous execution of complex dexterous tasks. However, action synthesis is often slow, requiring many steps of iterative denoising, limiting the extent to…

Robotics · Computer Science 2024-10-14 Sigmund H. Høeg , Yilun Du , Olav Egeland

Data-aware methods for dimensionality reduction and matrix decomposition aim to find low-dimensional structure in a collection of data. Classical approaches discover such structure by learning a basis that can efficiently express the…

Information Theory · Computer Science 2015-05-06 Eva L. Dyer , Tom A. Goldstein , Raajen Patel , Konrad P. Kording , Richard G. Baraniuk

This paper addresses the problem of optimal control of robotic sensing systems aimed at autonomous information gathering in scenarios such as environmental monitoring, search and rescue, and surveillance and reconnaissance. The information…

Systems and Control · Computer Science 2016-01-28 Mikko Lauri , Nikolay Atanasov , George J. Pappas , Risto Ritala

Learning big data by matrix decomposition always suffers from expensive computation, mixing of complicated structures and noise. In this paper, we study more adaptive models and efficient algorithms that decompose a data matrix as the sum…

Machine Learning · Statistics 2013-09-03 Tianyi Zhou , Dacheng Tao

We present a reinforcement learning algorithm for learning sparse non-parametric controllers in a Reproducing Kernel Hilbert Space. We improve the sample complexity of this approach by imposing a structure of the state-action function…

Robotics · Computer Science 2021-03-30 Ekaterina Tolstaya , Ethan Stump , Alec Koppel , Alejandro Ribeiro

Diffusion-based models for robotic control, including vision-language-action (VLA) and vision-action (VA) policies, have demonstrated significant capabilities. Yet their advancement is constrained by the high cost of acquiring large-scale…

We propose and study a general framework for regularized Markov decision processes (MDPs) where the goal is to find an optimal policy that maximizes the expected discounted total reward plus a policy regularization term. The extant…

Machine Learning · Statistics 2019-10-22 Xiang Li , Wenhao Yang , Zhihua Zhang