English
Related papers

Related papers: Towards Learning Foundation Models for Heuristic F…

200 papers

While foundation models have achieved remarkable results across a diversity of domains, they still rely on human-generated data, such as text, as a fundamental source of knowledge. However, this data is ultimately the product of human…

Neurons and Cognition · Quantitative Biology 2026-01-21 Maël Donoso

Foundation models pre-trained on massive datasets, including large language models (LLMs), vision-language models (VLMs), and large multimodal models, have demonstrated remarkable success in diverse downstream tasks. However, recent studies…

Machine Learning · Computer Science 2025-07-25 Neil He , Hiren Madhu , Ngoc Bui , Menglin Yang , Rex Ying

Reasoning, a crucial ability for complex problem-solving, plays a pivotal role in various real-world settings such as negotiation, medical diagnosis, and criminal investigation. It serves as a fundamental methodology in the field of…

Recent studies in using deep learning to solve routing problems focus on construction heuristics, the solutions of which are still far from optimality. Improvement heuristics have great potential to narrow this gap by iteratively refining a…

Artificial Intelligence · Computer Science 2020-05-12 Yaoxin Wu , Wen Song , Zhiguang Cao , Jie Zhang , Andrew Lim

The neural network-based approach to solving partial differential equations has attracted considerable attention due to its simplicity and flexibility in representing the solution of the partial differential equation. In training a neural…

Machine Learning · Computer Science 2022-01-10 Jihun Han , Yoonsang Lee

Artificial intelligence, particularly the subfield of machine learning, has seen a paradigm shift towards data-driven models that learn from and adapt to data. This has resulted in unprecedented advancements in various domains such as…

Machine Learning · Computer Science 2023-10-26 Leonardo Petrini

Motion planning is an essential component in most of today's robotic applications. In this work, we consider the learning setting, where a set of solved motion planning problems is used to improve the efficiency of motion planning on…

Robotics · Computer Science 2019-06-04 Tom Jurgenson , Aviv Tamar

Deep reinforcement learning has achieved many impressive results in recent years. However, tasks with sparse rewards or long horizons continue to pose significant challenges. To tackle these important problems, we propose a general…

Artificial Intelligence · Computer Science 2017-04-12 Carlos Florensa , Yan Duan , Pieter Abbeel

This study proposes a hybrid deep-learning-metaheuristic framework with a bi-level architecture for road network design problems (NDPs). We train a graph neural network (GNN) to approximate the solution of the user equilibrium (UE) traffic…

Neural and Evolutionary Computing · Computer Science 2023-12-12 Bahman Madadi , Goncalo Homem de Almeida Correia

Recently, several studies have explored the use of neural network to solve different routing problems, which is an auspicious direction. These studies usually design an encoder-decoder based framework that uses encoder embeddings of nodes…

Artificial Intelligence · Computer Science 2021-09-13 Zongtao Liu , Jing Xu , Jintao Su , Tao Xiao , Yang Yang

We study the problem of learning differentiable functions expressed as programs in a domain-specific language. Such programmatic models can offer benefits such as composability and interpretability; however, learning them requires…

Machine Learning · Computer Science 2021-03-30 Ameesh Shah , Eric Zhan , Jennifer J. Sun , Abhinav Verma , Yisong Yue , Swarat Chaudhuri

Inferential decision-making algorithms typically assume that an underlying probabilistic model of decision alternatives and outcomes may be learned a priori or online. Furthermore, when applied to robots in real-world settings they often…

Robotics · Computer Science 2023-09-15 Yucheng Chen , Pingping Zhu , Anthony Alers , Tobias Egner , Marc A. Sommer , Silvia Ferrari

The data-to-equation (Data2Eqn) task aims to discover interpretable mathematical equations that map observed values to labels, offering physical insights and broad applicability across academic and industrial domains. Genetic programming…

Machine Learning · Computer Science 2025-05-22 Wangyang Ying , Haoyue Bai , Nanxu Gong , Xinyuan Wang , Sixun Dong , Haifeng Chen , Yanjie Fu

Deep learning is mainly based on utilizing gradient-based optimization for training Deep Neural Network (DNN) models. Although robust and widely used, gradient-based optimization algorithms are prone to getting stuck in local minima. In…

Neural and Evolutionary Computing · Computer Science 2024-08-15 Rasa Khosrowshahli , Shahryar Rahnamayan , Beatrice Ombuki-Berman

Deep reinforcement learning can match or exceed human performance in stable contexts, but with minor changes to the environment artificial networks, unlike humans, often cannot adapt. Humans rely on a combination of heuristics to simplify…

Artificial Intelligence · Computer Science 2020-06-15 Erik J Peterson , Necati Alp Müyesser , Timothy Verstynen , Kyle Dunovan

A key challenge facing deep learning is that neural networks are often not robust to shifts in the underlying data distribution. We study this problem from the perspective of the statistical concept of parameter identification.…

Machine Learning · Computer Science 2022-02-18 Kan Xu , Hamsa Bastani , Osbert Bastani

Computing goal-directed behavior is essential to designing efficient AI systems. Due to the computational complexity of planning, current approaches rely primarily upon hand-coded symbolic action models and hand-coded heuristic-function…

Machine Learning · Computer Science 2020-10-21 Rushang Karia , Siddharth Srivastava

Domain experts from all fields are called upon, working with data scientists, to explore the use of ML techniques to solve their problems. Starting from a domain problem/question, ML-based problem-solving typically involves three steps: (1)…

Machine Learning · Computer Science 2024-09-20 Lokman Saleh , Hafedh Mili , Mounir Boukadoum , Abderrahmane Leshob

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems have been solved in tasks such as game playing and robotics. Unfortunately, the sample complexity of most…

Machine Learning · Computer Science 2020-12-03 Aske Plaat , Walter Kosters , Mike Preuss

With the rapid advancements of deep learning in the past decade, it can be foreseen that deep learning will be continuously deployed in more and more safety-critical applications such as autonomous driving and robotics. In this context,…

Hardware Architecture · Computer Science 2022-04-06 Cheng Liu , Zhen Gao , Siting Liu , Xuefei Ning , Huawei Li , Xiaowei Li