English
Related papers

Related papers: Mapping State Space using Landmarks for Universal …

200 papers

Goal-conditioned hierarchical reinforcement learning (HRL) has shown promising results for solving complex and long-horizon RL tasks. However, the action space of high-level policy in the goal-conditioned HRL is often large, so it results…

Machine Learning · Computer Science 2021-12-07 Junsu Kim , Younggyo Seo , Jinwoo Shin

Deploying the idea of long-term cumulative return, reinforcement learning has shown remarkable performance in various fields. We propose a formulation of the landmark localization in 3D medical images as a reinforcement learning problem.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-03 Walid Abdullah Al , Il Dong Yun

We consider planning problems, that often arise in autonomous driving applications, in which an agent should decide on immediate actions so as to optimize a long term objective. For example, when a car tries to merge in a roundabout it…

Machine Learning · Computer Science 2016-02-05 Shai Shalev-Shwartz , Nir Ben-Zrihem , Aviad Cohen , Amnon Shashua

We study the problem of learning a function that maps context observations (input) to parameters of a submodular function (output). Our motivating case study is a specific type of vehicle routing problem, in which a team of Unmanned Ground…

Robotics · Computer Science 2023-09-26 Guangyao Shi , Pratap Tokekar

We address the problem of vehicle self-localization from multi-modal sensor information and a reference map. The map is generated off-line by extracting landmarks from the vehicle's field of view, while the measurements are collected…

Robotics · Computer Science 2019-07-22 Nico Engel , Stefan Hoermann , Markus Horn , Vasileios Belagiannis , Klaus Dietmayer

This work presents a modular and hierarchical approach to learn policies for exploring 3D environments, called `Active Neural SLAM'. Our approach leverages the strengths of both classical and learning-based methods, by using analytical path…

Computer Vision and Pattern Recognition · Computer Science 2020-04-13 Devendra Singh Chaplot , Dhiraj Gandhi , Saurabh Gupta , Abhinav Gupta , Ruslan Salakhutdinov

Model-free reinforcement learning has recently been shown to be effective at learning navigation policies from complex image input. However, these algorithms tend to require large amounts of interaction with the environment, which can be…

Robotics · Computer Science 2018-07-17 Jake Bruce , Niko Sünderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

We consider a setting involving $N$ agents, where each agent interacts with an environment modeled as a Markov Decision Process (MDP). The agents' MDPs differ in their reward functions, capturing heterogeneous objectives/tasks. The…

Machine Learning · Computer Science 2024-09-10 Feng Zhu , Robert W. Heath , Aritra Mitra

Conventional reinforcement learning (RL) methods can successfully solve a wide range of sequential decision problems. However, learning policies that can generalize predictably across multiple tasks in a setting with non-Markovian reward…

Machine Learning · Computer Science 2024-06-04 Guillermo Infante , David Kuric , Anders Jonsson , Vicenç Gómez , Herke van Hoof

This paper presents a novel state representation for reward-free Markov decision processes. The idea is to learn, in a self-supervised manner, an embedding space where distances between pairs of embedded states correspond to the minimum…

Machine Learning · Computer Science 2022-05-05 Lorenzo Steccanella , Anders Jonsson

Large-scale Markov decision processes (MDPs) require planning algorithms with runtime independent of the number of states of the MDP. We consider the planning problem in MDPs using linear value function approximation with only weak…

Machine Learning · Computer Science 2020-07-14 Roshan Shariff , Csaba Szepesvári

Target localization is a critical task in sensitive applications, where multiple sensing agents communicate and collaborate to identify the target location based on sensor readings. Existing approaches investigated the use of Multi-Agent…

Machine Learning · Computer Science 2025-01-22 Ahmed Alagha , Rabeb Mizouni , Shakti Singh , Jamal Bentahar , Hadi Otrok

In this paper, we present a novel approach to incrementally learn an Abstract Model of an unknown environment, and show how an agent can reuse the learned model for tackling the Object Goal Navigation task. The Abstract Model is a finite…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Tommaso Campari , Leonardo Lamanna , Paolo Traverso , Luciano Serafini , Lamberto Ballan

Spatial public goods games are characterized by high-dimensional state spaces and localized externalities, which pose significant challenges for achieving stable and widespread cooperation. Traditional approaches often struggle to…

Computer Science and Game Theory · Computer Science 2026-02-24 Jinshuo Yang , Zhaoqilin Yang , Wenjie Zhou , Xin Wang , Youliang Tian

This paper explores the distance-based relative state estimation problem in large-scale systems, which is hard to solve effectively due to its high-dimensionality and non-convexity. In this paper, we alleviate this inherent hardness to…

Robotics · Computer Science 2024-06-03 Tianyue Wu , Gongye Zaitian , Qianhao Wang , Fei Gao

Solving real-life sequential decision making problems under partial observability involves an exploration-exploitation problem. To be successful, an agent needs to efficiently gather valuable information about the state of the world for…

Machine Learning · Computer Science 2020-11-03 Haiyan Yin , Yingzhen Li , Sinno Jialin Pan , Cheng Zhang , Sebastian Tschiatschek

Modern reinforcement learning algorithms reach super-human performance on many board and video games, but they are sample inefficient, i.e. they typically require significantly more playing experience than humans to reach an equal…

Machine Learning · Computer Science 2018-06-12 Dane Corneil , Wulfram Gerstner , Johanni Brea

Reinforcement Learning (RL) in environments with complex, history-dependent reward structures poses significant challenges for traditional methods. In this work, we introduce a novel approach that leverages automaton-based feedback to guide…

Machine Learning · Computer Science 2025-10-20 Mahyar Alinejad , Alvaro Velasquez , Yue Wang , George Atia

In recent years, there are great interests as well as challenges in applying reinforcement learning (RL) to recommendation systems (RS). In this paper, we summarize three key practical challenges of large-scale RL-based recommender systems:…

Information Retrieval · Computer Science 2021-04-13 Kai Wang , Zhene Zou , Qilin Deng , Runze Wu , Jianrong Tao , Changjie Fan , Liang Chen , Peng Cui

High computational costs of manifold learning prohibit its application for large point sets. A common strategy to overcome this problem is to perform dimensionality reduction on selected landmarks and to successively embed the entire…

Machine Learning · Computer Science 2015-03-13 Christian Wachinger , Polina Golland