English
Related papers

Related papers: A Differentiable Loss Function for Learning Heuris…

200 papers

Parallel best-first search algorithms such as Hash Distributed A* (HDA*) distribute work among the processes using a global hash function. We analyze the search and communication overheads of state-of-the-art hash-based parallel best-first…

Artificial Intelligence · Computer Science 2017-11-13 Yuu Jinnai , Alex Fukunaga

Parallel search algorithms have been shown to improve planning speed by harnessing the multithreading capability of modern processors. One such algorithm PA*SE achieves this by parallelizing state expansions, whereas another algorithm…

Robotics · Computer Science 2023-03-13 Shohin Mukherjee , Maxim Likhachev

The unordered tree edit distance is a natural metric to compute distances between trees without intrinsic child order, such as representations of chemical molecules. While the unordered tree edit distance is MAX SNP-hard in principle, it is…

Artificial Intelligence · Computer Science 2022-02-11 Benjamin Paaßen

In recent years, combining neural networks with local search heuristics has become popular in the field of combinatorial optimization. Despite its considerable computational demands, this approach has exhibited promising outcomes with…

Artificial Intelligence · Computer Science 2023-11-01 Ankur Nath , Alan Kuhnle

Large language models (LLMs) have demonstrated powerful decision-making and planning capabilities in solving complicated real-world problems. LLM-based autonomous agents can interact with diverse tools (e.g., functional APIs) and generate…

Computation and Language · Computer Science 2023-10-23 Yuchen Zhuang , Xiang Chen , Tong Yu , Saayan Mitra , Victor Bursztyn , Ryan A. Rossi , Somdeb Sarkhel , Chao Zhang

Recent work investigated the use of Reinforcement Learning (RL) for the synthesis of heuristic guidance to improve the performance of temporal planners when a domain is fixed and a set of training problems (not plans) is given. The idea is…

Artificial Intelligence · Computer Science 2025-05-20 Irene Brugnara , Alessandro Valentini , Andrea Micheli

The success of deep learning is due, to a large extent, to the remarkable effectiveness of gradient-based optimization methods applied to large neural networks. The purpose of this work is to propose a modern view and a general mathematical…

Machine Learning · Computer Science 2021-05-28 Chaoyue Liu , Libin Zhu , Mikhail Belkin

This letter explains an algorithm for finding a set of base functions. The method aims to capture the leading behavior of the dataset in terms of a few base functions. Implementation of the A-star search will help find these functions,…

Data Analysis, Statistics and Probability · Physics 2022-11-10 Nima Tatari

The problem of drawing samples from a discrete distribution can be converted into a discrete optimization problem. In this work, we show how sampling from a continuous distribution can be converted into an optimization problem over…

Computation · Statistics 2015-01-27 Chris J. Maddison , Daniel Tarlow , Tom Minka

Parallel search algorithms harness the multithreading capability of modern processors to achieve faster planning. One such algorithm is PA*SE (Parallel A* for Slow Expansions), which parallelizes state expansions to achieve faster planning…

Robotics · Computer Science 2023-01-11 Shohin Mukherjee , Sandip Aine , Maxim Likhachev

Many neural networks deployed in the real world scenarios are trained using cross entropy based loss functions. From the optimization perspective, it is known that the behavior of first order methods such as gradient descent crucially…

Machine Learning · Computer Science 2023-10-09 Zhu Wang , Praveen Raj Veluswami , Harsh Mishra , Sathya N. Ravi

The search cost of neural architecture search (NAS) has been largely reduced by weight-sharing methods. These methods optimize a super-network with all possible edges and operations, and determine the optimal sub-network by discretization,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-08 Yunjie Tian , Chang Liu , Lingxi Xie , Jianbin Jiao , Qixiang Ye

The difficulty of deterministic planning increases exponentially with search-tree depth. Black-box planning presents an even greater challenge, since planners must operate without an explicit model of the domain. Heuristics can make search…

Artificial Intelligence · Computer Science 2021-06-25 Cameron Allen , Michael Katz , Tim Klinger , George Konidaris , Matthew Riemer , Gerald Tesauro

There is no such thing as a perfect dataset. In some datasets, deep neural networks discover underlying heuristics that allow them to take shortcuts in the learning process, resulting in poor generalization capability. Instead of using…

Computation and Language · Computer Science 2022-11-28 Frano Rajič , Ivan Stresec , Axel Marmet , Tim Poštuvan

Evaluation metrics in machine learning are often hardly taken as loss functions, as they could be non-differentiable and non-decomposable, e.g., average precision and F1 score. This paper aims to address this problem by revisiting the…

Machine Learning · Computer Science 2022-03-01 Tao Huang , Zekang Li , Hua Lu , Yong Shan , Shusheng Yang , Yang Feng , Fei Wang , Shan You , Chang Xu

The endeavor of artificial intelligence (AI) is to design autonomous agents capable of achieving complex tasks. Namely, reinforcement learning (RL) proposes a theoretical background to learn optimal behaviors. In practice, RL algorithms…

Machine Learning · Computer Science 2022-09-27 Firas Jarboui , Ahmed Akakzia

Deploying deep learning models requires taking into consideration neural network metrics such as model size, inference latency, and #FLOPs, aside from inference accuracy. This results in deep learning model designers leveraging…

Machine Learning · Computer Science 2024-08-20 Yiyang Zhao , Linnan Wang , Tian Guo

Recent advances in metareasoning for search has shown its usefulness in improving numerous search algorithms. This paper applies rational metareasoning to IDA* when several admissible heuristics are available. The obvious basic approach of…

Artificial Intelligence · Computer Science 2014-11-25 David Tolpin , Oded Betzalel , Ariel Felner , Solomon Eyal Shimony

The study of a machine learning problem is in many ways is difficult to separate from the study of the loss function being used. One avenue of inquiry has been to look at these loss functions in terms of their properties as scoring rules…

Machine Learning · Computer Science 2022-09-02 Zac Cranko , Robert C. Williamson , Richard Nock

When training neural networks with custom objectives, such as ranking losses and shortest-path losses, a common problem is that they are, per se, non-differentiable. A popular approach is to continuously relax the objectives to provide…

Machine Learning · Computer Science 2024-10-28 Felix Petersen , Christian Borgelt , Tobias Sutter , Hilde Kuehne , Oliver Deussen , Stefano Ermon