English
Related papers

Related papers: Generalized Nested Rollout Policy Adaptation with …

200 papers

In this work, we consider the problem of finding a set of tours to a traveling salesperson problem (TSP) instance maximizing diversity, while satisfying a given cost constraint. This study aims to investigate the effectiveness of applying…

Neural and Evolutionary Computing · Computer Science 2022-04-20 Anh Viet Do , Mingyu Guo , Aneta Neumann , Frank Neumann

End-to-end training of neural network solvers for graph combinatorial optimization problems such as the Travelling Salesperson Problem (TSP) have seen a surge of interest recently, but remain intractable and inefficient beyond graphs with…

Machine Learning · Computer Science 2022-05-26 Chaitanya K. Joshi , Quentin Cappart , Louis-Martin Rousseau , Thomas Laurent

Maneuver decision-making can be regarded as a Markov decision process and can be address by reinforcement learning. However, original reinforcement learning algorithms can hardly solve the maneuvering decision-making problem. One reason is…

Artificial Intelligence · Computer Science 2023-09-19 Zhang Hong-Peng

We describe an iterative procedure for optimizing policies, with guaranteed monotonic improvement. By making several approximations to the theoretically-justified procedure, we develop a practical algorithm, called Trust Region Policy…

Machine Learning · Computer Science 2017-04-24 John Schulman , Sergey Levine , Philipp Moritz , Michael I. Jordan , Pieter Abbeel

This paper presents a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent network that, given a set of city…

Artificial Intelligence · Computer Science 2017-01-16 Irwan Bello , Hieu Pham , Quoc V. Le , Mohammad Norouzi , Samy Bengio

Non-commutative polynomial optimization (NPO) problems seek to minimize the state average of a polynomial of some operator variables, subject to polynomial constraints, over all states and operators, as well as the Hilbert spaces where…

Quantum Physics · Physics 2025-07-22 Mateus Araújo , Andrew J. P. Garner , Miguel Navascues

Generalist robot manipulation policies (GMPs) have the potential to generalize across a wide range of tasks, devices, and environments. However, existing policies continue to struggle with out-of-distribution scenarios due to the inherent…

Robotics · Computer Science 2024-10-03 Wenbo Zhang , Yang Li , Yanyuan Qiao , Siyuan Huang , Jiajun Liu , Feras Dayoub , Xiao Ma , Lingqiao Liu

We extend Random Access, a fundamental operation that enables efficient search and exploration algorithms, to the modern interactive data systems based on Ranked Retrieval and Similarity Search, where orderings are dynamically defined over…

Data Structures and Algorithms · Computer Science 2026-05-26 Mohsen Dehghankar , Abolfazl Asudeh , Raghav Mittal , Suraj Shetiya , Gautam Das

Deep learning has been extended to a number of new domains with critical success, though some traditional orienteering problems such as the Travelling Salesman Problem (TSP) and its variants are not commonly solved using such techniques.…

Machine Learning · Computer Science 2019-03-11 Wei Shao , Flora D. Salim , Jeffrey Chan , Sean Morrison , Fabio Zambetta

A commonly used family of RL algorithms for diffusion policies conducts softmax reweighting over samples from the behavior policy, which often induces an overgreedy policy and fails to utilize feedback from negative samples. In this work,…

Machine Learning · Computer Science 2026-05-26 Haitong Ma , Chenxiao Gao , Tianyi Chen , Na Li , Bo Dai

Assortment optimization seeks to select a subset of substitutable products, subject to constraints, to maximize expected revenue. The problem is NP-hard due to its combinatorial and nonlinear nature and arises frequently in industries such…

Machine Learning · Computer Science 2025-11-18 Guokai Li , Pin Gao , Stefanus Jasin , Zizhuo Wang

In dynamic games with shared constraints, Generalized Nash Equilibria (GNE) are often computed using the normalized solution concept, which assumes identical Lagrange multipliers for shared constraints across all players. While widely used,…

Robotics · Computer Science 2025-11-07 Mark Pustilnik , Francesco Borrelli

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising approach to improve the reasoning abilities of Large Language Models (LLMs). Among RLVR algorithms, Group Relative Policy Optimization (GRPO) and its variants…

Artificial Intelligence · Computer Science 2026-04-21 Zhaokang Liao , Yingguo Gao , Yi Yang , Yongheng Hu , Jingting Ding

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models. While Group Relative Policy Optimization (GRPO) is widely adopted, its coarse credit assignment uniformly…

Machine Learning · Computer Science 2026-04-03 Gengsheng Li , Tianyu Yang , Junfeng Fang , Mingyang Song , Mao Zheng , Haiyun Guo , Dan Zhang , Jinqiao Wang , Tat-Seng Chua

A recursive tree planner (RTP) is designed to function as a pure planner without policies at one extreme and run a pure greedy policy at the other. In between, the RTP exploits policies to improve planning performance and improve zero-shot…

Robotics · Computer Science 2024-05-24 A. Norman Redlich

Learning to evaluate and improve policies is a core problem of Reinforcement Learning (RL). Traditional RL algorithms learn a value function defined for a single policy. A recently explored competitive alternative is to learn a single value…

Machine Learning · Computer Science 2022-07-05 Francesco Faccio , Aditya Ramesh , Vincent Herrmann , Jean Harb , Jürgen Schmidhuber

Post-training with reinforcement learning (RL) has recently shown strong promise for advancing multimodal agents beyond supervised imitation. However, RL remains limited by poor data efficiency, particularly in settings where interaction…

Machine Learning · Computer Science 2026-03-05 Chengxuan Lu , Zhenquan Zhang , Shukuan Wang , Qunzhi Lin , Baigui Sun , Yang Liu

Continual learning (CL) in deep neural networks (DNNs) involves incrementally accumulating knowledge in a DNN from a growing data stream. A major challenge in CL is that non-stationary data streams cause catastrophic forgetting of…

Machine Learning · Computer Science 2024-05-02 Md Yousuf Harun , Jhair Gallardo , Junyu Chen , Christopher Kanan

This paper presents a constrained adaptive dynamic programming (CADP) algorithm to solve general nonlinear nonaffine optimal control problems with known dynamics. Unlike previous ADP algorithms, it can directly deal with problems with state…

Systems and Control · Electrical Eng. & Systems 2022-04-11 Jingliang Duan , Zhengyu Liu , Shengbo Eben Li , Qi Sun , Zhenzhong Jia , Bo Cheng

The generalized traveling salesman problem (GTSP) is an extension of the well-known traveling salesman problem. In GTSP, we are given a partition of cities into groups and we are required to find a minimum length tour that includes exactly…

Data Structures and Algorithms · Computer Science 2010-03-30 Gregory Gutin , Daniel Karapetyan