English
Related papers

Related papers: Lifting DecPOMDPs for Nanoscale Systems -- A Work …

200 papers

In unmanned aerial systems, especially in complex environments, accurately detecting tiny objects is crucial. Resizing images is a common strategy to improve detection accuracy, particularly for small objects. However, simply enlarging…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Luqi Gong , Haotian Chen , Yikun Chen , Tianliang Yao , Chao Li , Shuai Zhao , Guangjie Han

An increasing number of emerging applications, e.g., internet of things, vehicular communications, augmented reality, and the growing complexity due to the interoperability requirements of these systems, lead to the need to change the tools…

Multiagent Systems · Computer Science 2019-01-16 Merim Dzaferagic , M. Majid Butt , Maria Murphy , Nicholas Kaminski , Nicola Marchetti

In this work we investigate an importance sampling approach for evaluating policies for a structurally time-varying factored Markov decision process (MDP), i.e. the policy's value is estimated with a high-probability confidence interval. In…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Carmel Fiscko , Soummya Kar , Bruno Sinopoli

Factored Markov decision processes (MDPs) are a prominent paradigm within the artificial intelligence community for modeling and solving large-scale MDPs whose rewards and dynamics decompose into smaller, loosely interacting components.…

Optimization and Control · Mathematics 2024-04-03 Huikang Liu , Wolfram Wiesemann , Man-Chung Yue

The Diffusion Probabilistic Model (DPM) has emerged as a highly effective generative model in the field of computer vision. Its intermediate latent vectors offer rich semantic information, making it an attractive option for various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Haipeng Zhou , Lei Zhu , Yuyin Zhou

In this paper, we investigate a decentralized control problem with nested subsystems, which is a general model for one-directional communication amongst many subsystems. The noises in our dynamics are modelled as uncertain variables which…

Optimization and Control · Mathematics 2022-06-14 Aditya Dave , Nishanth Venkatesh , Andreas A. Malikopoulos

In this paper, we propose two novel decentralized optimization frameworks for multi-agent nonlinear optimal control problems in robotics. The aim of this work is to suggest architectures that inherit the computational efficiency and…

Systems and Control · Electrical Eng. & Systems 2022-08-09 Augustinos D. Saravanos , Yuichiro Aoyama , Hongchang Zhu , Evangelos A. Theodorou

In reinforcement learning, agents often learn policies for specific tasks without the ability to generalize this knowledge to related tasks. This paper introduces an algorithm that attempts to address this limitation by decomposing neural…

Machine Learning · Computer Science 2024-10-16 Mahdi Alikhasi , Levi H. S. Lelis

This work proposes a decision-making framework for partially observable systems in continuous time with discrete state and action spaces. As optimal decision-making becomes intractable for large state spaces we employ approximation methods…

Machine Learning · Computer Science 2024-03-01 Yannick Eich , Bastian Alt , Heinz Koeppl

Most works on multi-agent reinforcement learning focus on scenarios where the state of the environment is fully observable. In this work, we consider a cooperative policy evaluation task in which agents are not assumed to observe the…

Machine Learning · Computer Science 2023-05-17 Mert Kayaalp , Fatima Ghadieh , Ali H. Sayed

Decomposing hard problems into subproblems often makes them easier and more efficient to solve. With large language models (LLMs) crossing critical reliability thresholds for a growing slate of capabilities, there is an increasing effort to…

Computation and Language · Computer Science 2025-05-30 Elliot Meyerson , Xin Qiu

Non-stationary domains, that change in unpredicted ways, are a challenge for agents searching for optimal policies in sequential decision-making problems. This paper presents a combination of Markov Decision Processes (MDP) with Answer Set…

Artificial Intelligence · Computer Science 2017-06-06 Leonardo A. Ferreira , Reinaldo A. C. Bianchi , Paulo E. Santos , Ramon Lopez de Mantaras

Decentralized optimization is widely used in large scale and privacy preserving machine learning and various distributed control and sensing systems. It is assumed that every agent in the network possesses a local objective function, and…

Optimization and Control · Mathematics 2023-01-31 Savelii Chezhegov , Anton Novitskii , Alexander Rogozin , Sergei Parsegov , Pavel Dvurechensky , Alexander Gasnikov

Feature Markov Decision Processes (PhiMDPs) are well-suited for learning agents in general environments. Nevertheless, unstructured (Phi)MDPs are limited to relatively simple environments. Structured MDPs like Dynamic Bayesian Networks…

Artificial Intelligence · Computer Science 2009-12-30 Marcus Hutter

Denoising diffusion probabilistic models have recently received much research attention since they outperform alternative approaches, such as GANs, and currently provide state-of-the-art generative performance. The superior performance of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Dmitry Baranchuk , Ivan Rubachev , Andrey Voynov , Valentin Khrulkov , Artem Babenko

Partially observable Markov Decision Processes (POMDPs) are a standard model for agents making decisions in uncertain environments. Most work on POMDPs focuses on synthesizing strategies based on the available capabilities. However, system…

Artificial Intelligence · Computer Science 2024-07-12 Alyzia-Maria Konsta , Alberto Lluch Lafuente , Christoph Matheja

Topological photonic systems, with their ability to host states protected against disorder and perturbation, allow us to do with photons what topological insulators do with electrons. Topological photonics can refer to electronic systems…

Mesoscale and Nanoscale Physics · Physics 2019-05-01 Marie S. Rider , Samuel J. Palmer , Simon R. Pocock , Xiaofei Xiao , Paloma Arroyo Huidobro , Vincenzo Giannini

Autonomous systems often must predict the motions of nearby agents from partial and noisy data. This paper asks and answers the question: "can we learn, in real-time, a nonlinear predictive model of another agent's motions?" Our online…

Robotics · Computer Science 2026-03-09 Stella Kombo , Masih Haseli , Skylar X. Wei , Joel W. Burdick

An ability to generalize unconstrained conditions such as severe occlusions and large pose variations remains a challenging goal to achieve in face alignment. In this paper, a multistage model based on deep neural networks is proposed which…

Computer Vision and Pattern Recognition · Computer Science 2020-02-05 Huabin Wang , Rui Cheng , Jian Zhou , Liang Tao , Hon Keung Kwan

Recently, machine learning methods have gained significant traction in scientific computing, particularly for solving Partial Differential Equations (PDEs). However, methods based on deep neural networks (DNNs) often lack convergence…

Artificial Intelligence · Computer Science 2025-06-16 Li Liu , Heng Yong