English
Related papers

Related papers: Voronoi Progressive Widening: Efficient Online Sol…

200 papers

Solving partially observable Markov decision processes (POMDPs) is highly intractable in general, at least in part because the optimal policy may be infinitely large. In this paper, we explore the problem of finding the optimal policy from…

Artificial Intelligence · Computer Science 2013-01-30 Nicolas Meuleau , Kee-Eung Kim , Leslie Pack Kaelbling , Anthony R. Cassandra

Partially Observable Markov Decision Processes (POMDPs) are a general and principled framework for motion planning under uncertainty. Despite tremendous improvement in the scalability of POMDP solvers, long-horizon POMDPs (e.g., $\geq15$…

Robotics · Computer Science 2024-11-12 Yuanchu Liang , Edward Kim , Wil Thomason , Zachary Kingston , Hanna Kurniawati , Lydia E. Kavraki

Large language models frequently exhibit suboptimal performance on low resource languages, primarily due to inefficient subword segmentation and systemic training data imbalances. In this paper, we propose Variable Entropy Policy…

Computation and Language · Computer Science 2026-03-20 Chonghan Liu , Yimin Du , Qi An , Xin He , Cunqi Zhai , Fei Tan , Weijia Lin , Xiaochun Gong , Yongchao Deng , Shousheng Jia , Xiangzheng Zhang

Group Relative Policy Optimization (GRPO) is a powerful technique for aligning generative models, but its effectiveness is bottlenecked by the conflict between large group sizes and prohibitive computational costs. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shiran Ge , Chenyi Huang , Yuang Ai , Qihang Fan , Huaibo Huang , Ran He

Gradient-based approaches to direct policy search in reinforcement learning have received much recent attention as a means to solve problems of partial observability and to avoid some of the problems associated with policy degradation in…

Artificial Intelligence · Computer Science 2019-11-18 Jonathan Baxter , Peter L. Bartlett

For the purpose of addressing the multi-objective optimal reactive power dispatch (MORPD) problem, a two-step approach is proposed in this paper. First of all, to ensure the economy and security of the power system, the MORPD model aiming…

Optimization and Control · Mathematics 2020-03-06 Meng Zhang , Yang Li

Reinforcement Learning with Verifiable Rewards (RLVR) has become a promising paradigm for scaling reasoning capabilities of Large Language Models (LLMs). However, the sparsity of binary verifier rewards often leads to low efficiency and…

Machine Learning · Computer Science 2026-05-22 Shuo Yang , Jinda Lu , Kexin Huang , Chiyu Ma , Shaohang Wei , Yuyang Liu , Guoyin Wang , Jingren Zhou , Li Yuan

Effective decision-making in autonomous driving relies on accurate inference of other traffic agents' future behaviors. To achieve this, we propose an online belief-update-based behavior prediction model and an efficient planner for…

Robotics · Computer Science 2024-06-19 Zhiyu Huang , Chen Tang , Chen Lv , Masayoshi Tomizuka , Wei Zhan

To facilitate efficient learning, policy gradient approaches to deep reinforcement learning (RL) are typically paired with variance reduction measures and strategies for making large but safe policy changes based on a batch of experiences.…

Machine Learning · Computer Science 2023-11-13 Jared Markowitz , Edward W. Staley

This paper extends boolean particle swarm optimization to a multi-objective setting, to our knowledge for the first time in the literature. Our proposed new boolean algorithm, MBOnvPSO, is notably simplified by the omission of a velocity…

Neural and Evolutionary Computing · Computer Science 2022-10-13 Wei Quan , Denise Gorse

Efficiently locating target objects in complex indoor environments with diverse furniture, such as shelves, tables, and beds, is a significant challenge for mobile robots. This difficulty arises from factors like localization errors,…

Robotics · Computer Science 2026-04-17 Yongbo Chen , Hesheng Wang , Shoudong Huang , Hanna Kurniawati

A global optimization framework, acronymed COMBEO (Change OfMeasure Based Evolutionary Optimization), is proposed. An important aspect in the development is a set of derivative-free additive directional terms obtainable through a change of…

Methodology · Statistics 2014-11-10 Saikat Sarkar , Debasish Roy

This paper delves into an in-depth exploration of the Variable Projection (VP) algorithm, a powerful tool for solving separable nonlinear optimization problems across multiple domains, including system identification, image processing, and…

Optimization and Control · Mathematics 2025-01-08 Guangyong Chen , Peng Xue , Min Gan , Jing Chen , Wenzhong Guo , C. L. Philip. Chen

Risk-averse decision-making under uncertainty in partially observable domains is a central challenge in artificial intelligence and is essential for developing reliable autonomous agents. The formal framework for such problems is the…

Statistics Theory · Mathematics 2026-02-27 Yaacov Pariente , Vadim Indelman

In the realm of household robotics, the Zero-Shot Object Navigation (ZSON) task empowers agents to adeptly traverse unfamiliar environments and locate objects from novel categories without prior explicit training. This paper introduces…

Robotics · Computer Science 2024-02-07 Pengying Wu , Yao Mu , Bingxian Wu , Yi Hou , Ji Ma , Shanghang Zhang , Chang Liu

Population-based memetic algorithms have been successfully applied to solve many difficult combinatorial problems. Often, a population of fixed size was used in such algorithms to record some best solutions sampled during the search.…

Neural and Evolutionary Computing · Computer Science 2019-09-20 Yangming Zhou , Jin-Kao Hao , Zhang-Hua Fu , Zhe Wang , Xiangjing Lai

This paper introduces tvopt, a Python framework for prototyping and benchmarking time-varying (or online) optimization algorithms. The paper first describes the theoretical approach that informed the development of tvopt. Then it discusses…

Mathematical Software · Computer Science 2024-05-07 Nicola Bastianello

We study the Constrained Convex Markov Decision Process (MDP), where the goal is to minimize a convex functional of the visitation measure, subject to a convex constraint. Designing algorithms for a constrained convex MDP faces several…

Machine Learning · Computer Science 2024-02-19 Zihao Li , Boyi Liu , Zhuoran Yang , Zhaoran Wang , Mengdi Wang

Planning under uncertainty is critical to robotics. The Partially Observable Markov Decision Process (POMDP) is a mathematical framework for such planning problems. It is powerful due to its careful quantification of the non-deterministic…

Robotics · Computer Science 2021-07-19 Hanna Kurniawati

Partially observable Markov decision processes (POMDPs) are a natural model for planning problems where effects of actions are nondeterministic and the state of the world is not completely observable. It is difficult to solve POMDPs…

Artificial Intelligence · Computer Science 2009-09-25 N. L. Zhang , W. Liu