English
Related papers

Related papers: A novel approach to model exploration for value fu…

200 papers

Discovering relevant patterns for a particular user remains a challenging tasks in data mining. Several approaches have been proposed to learn user-specific pattern ranking functions. These approaches generalize well, but at the expense of…

Artificial Intelligence · Computer Science 2022-03-08 Nassim Belmecheri , Noureddine Aribi , Nadjib Lazaar , Yahia Lebbah , Samir Loudni

In the last years decision-focused learning framework, also known as predict-and-optimize, have received increasing attention. In this setting, the predictions of a machine learning model are used as estimated cost coefficients in the…

Machine Learning · Computer Science 2022-06-20 Jayanta Mandi , Víctor Bucarey , Maxime Mulamba , Tias Guns

Model Predictive Control (MPC) is a classic tool for optimal control of complex, real-world systems. Although it has been successfully applied to a wide range of challenging tasks in robotics, it is fundamentally limited by the prediction…

Robotics · Computer Science 2021-04-08 Nathan Hatch , Byron Boots

Personalized Route Recommendation (PRR) aims to generate user-specific route suggestions in response to users' route queries. Early studies cast the PRR task as a pathfinding problem on graphs, and adopt adapted search algorithms by…

Artificial Intelligence · Computer Science 2019-07-22 Jingyuan Wang , Ning Wu , Wayne Xin Zhao , Fanzhang Peng , Xin Lin

Path finding in graphs is one of the most studied classes of problems in computer science. In this context, search algorithms are often extended with heuristics for a more efficient search of target nodes. In this work we combine recent…

Artificial Intelligence · Computer Science 2022-04-20 Danilo Numeroso , Davide Bacciu , Petar Veličković

Large Language Models (LLMs) have demonstrated impressive planning abilities due to their vast "world knowledge". Yet, obtaining plans that are both feasible (grounded in affordances) and cost-effective (in plan length), remains a…

Artificial Intelligence · Computer Science 2024-01-03 Rishi Hazra , Pedro Zuidberg Dos Martires , Luc De Raedt

Besides training, mathematical optimization is also used in deep learning to model and solve formulations over trained neural networks for purposes such as verification, compression, and optimization with learned constraints. However,…

Optimization and Control · Mathematics 2024-01-30 Jiatai Tong , Junyang Cai , Thiago Serra

Graph search planning algorithms for navigation typically rely heavily on heuristics to efficiently plan paths. As a result, while such approaches require no training phase and can directly plan long horizon paths, they often require…

Robotics · Computer Science 2025-07-29 Rishi Veerapaneni , Muhammad Suhail Saleem , Maxim Likhachev

Reinforcement learning systems are often concerned with balancing exploration of untested actions against exploitation of actions that are known to be good. The benefit of exploration can be estimated using the classical notion of Value of…

Artificial Intelligence · Computer Science 2013-01-30 Richard Dearden , Nir Friedman , David Andre

Curriculum learning in reinforcement learning is used to shape exploration by presenting the agent with increasingly complex tasks. The idea of curriculum learning has been largely applied in both animal training and pedagogy. In…

Machine Learning · Computer Science 2019-06-14 Francesco Foglino , Christiano Coletto Christakou , Matteo Leonetti

An agent's ability to leverage past experience is critical for efficiently solving new tasks. Approximate solutions for new tasks can be obtained from previously derived value functions, as demonstrated by research on transfer learning,…

Machine Learning · Computer Science 2023-09-06 Jacob Adamczyk , Stas Tiomkin , Rahul Kulkarni

Driving in a human-like manner is important for an autonomous vehicle to be a smart and predictable traffic participant. To achieve this goal, parameters of the motion planning module should be carefully tuned, which needs great effort and…

Computer Vision and Pattern Recognition · Computer Science 2020-05-26 Donghao Xu , Zhezhang Ding , Xu He , Huijing Zhao , Mathieu Moze , François Aioun , Franck Guillemard

Exhaustive enumeration of all possible join orders is often avoided, and most optimizers leverage heuristics to prune the search space. The design and implementation of heuristics are well-understood when the cost model is roughly linear,…

Databases · Computer Science 2019-01-14 Sanjay Krishnan , Zongheng Yang , Ken Goldberg , Joseph Hellerstein , Ion Stoica

Recent studies in using deep learning to solve routing problems focus on construction heuristics, the solutions of which are still far from optimality. Improvement heuristics have great potential to narrow this gap by iteratively refining a…

Artificial Intelligence · Computer Science 2020-05-12 Yaoxin Wu , Wen Song , Zhiguang Cao , Jie Zhang , Andrew Lim

Sequential decision making, commonly formalized as Markov Decision Process (MDP) optimization, is a important challenge in artificial intelligence. Two key approaches to this problem are reinforcement learning (RL) and planning. This paper…

Machine Learning · Computer Science 2022-04-01 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

We propose an exploration method that incorporates look-ahead search over basic learnt skills and their dynamics, and use it for reinforcement learning (RL) of manipulation policies . Our skills are multi-goal policies learned in isolation…

Robotics · Computer Science 2018-11-21 Arpit Agarwal , Katharina Muelling , Katerina Fragkiadaki

Value estimation is a critical component of the reinforcement learning (RL) paradigm. The question of how to effectively learn value predictors from data is one of the major problems studied by the RL community, and different approaches…

Machine Learning · Computer Science 2020-10-22 Arthur Guez , Fabio Viola , Théophane Weber , Lars Buesing , Steven Kapturowski , Doina Precup , David Silver , Nicolas Heess

Reinforcement learning (RL) involves sequential decision making in uncertain environments. The aim of the decision-making agent is to maximize the benefit of acting in its environment over an extended period of time. Finding an optimal…

Artificial Intelligence · Computer Science 2007-05-23 Istvan Szita , Balint Takacs , Andras Lorincz

Heuristics are a central component of deterministic planning, particularly in domain-independent settings where general applicability is prioritized over task-specific tuning. This work revisits that paradigm in light of recent advances in…

Artificial Intelligence · Computer Science 2026-01-07 Alexander Tuisov , Yonatan Vernik , Alexander Shleyfman

Landmarks are facts or actions that appear in all valid solutions of a planning problem. They have been used successfully to calculate heuristics that guide the search for a plan. We investigate an extension to this concept by defining a…

Artificial Intelligence · Computer Science 2024-03-13 Oliver Kim , Mohan Sridharan