中文
相关论文

相关论文: Neural Combinatorial Optimization with Heavy Decod…

200 篇论文

Recent deep models for solving routing problems always assume a single distribution of nodes for training, which severely impairs their cross-distribution generalization ability. In this paper, we exploit group distributionally robust…

机器学习 · 计算机科学 2022-02-16 Yuan Jiang , Yaoxin Wu , Zhiguang Cao , Jie Zhang

Column generation (CG) is a vital method to solve large-scale problems by dynamically generating variables. It has extensive applications in common combinatorial optimization, such as vehicle routing and scheduling problems, where each…

机器学习 · 计算机科学 2023-10-17 Kuan Xu , Li Shen , Lindong Liu

Combinatorial optimization (CO) aims to efficiently find the best solution to NP-hard problems ranging from statistical physics to social media marketing. A wide range of CO applications can benefit from local search methods because they…

机器学习 · 计算机科学 2023-04-14 Yuanhang Shao , Tonmoy Dey , Nikola Vuckovic , Luke Van Popering , Alan Kuhnle

The field of neural machine translation (NMT) has changed with the advent of large language models (LLMs). Much of the recent emphasis in natural language processing (NLP) has been on modeling machine translation and many other problems…

计算与语言 · 计算机科学 2025-06-03 Yingfeng Luo , Tong Zheng , Yongyu Mu , Bei Li , Qinghong Zhang , Yongqi Gao , Ziqiang Xu , Peinan Feng , Xiaoqian Liu , Tong Xiao , Jingbo Zhu

Ant Colony Optimization (ACO) is a meta-heuristic algorithm that has been successfully applied to various Combinatorial Optimization Problems (COPs). Traditionally, customizing ACO for a specific problem requires the expert design of…

神经与进化计算 · 计算机科学 2023-11-07 Haoran Ye , Jiarui Wang , Zhiguang Cao , Helan Liang , Yong Li

PDE-Constrained Optimization (PDECO) problems can be accelerated significantly by employing gradient-based methods with surrogate models like neural operators compared to traditional numerical solvers. However, this approach faces two key…

机器学习 · 计算机科学 2025-06-17 Ze Cheng , Zhuoyu Li , Xiaoqiang Wang , Jianing Huang , Zhizhou Zhang , Zhongkai Hao , Hang Su

Large Language Model (LLM) agents trained with reinforcement learning (RL) show great promise for solving complex, multi-step tasks. However, their performance is often crippled by "Context Explosion", where the accumulation of long text…

计算与语言 · 计算机科学 2025-12-16 Xuanzhang Liu , Jianglun Feng , Zhuoran Zhuang , Junzhe Zhao , Maofei Que , Jieting Li , Dianlei Wang , Hao Tong , Ye Chen , Pan Li

Large Language Models (LLMs) are deep learning models designed to generate text based on textual input. Although researchers have been developing these models for more complex tasks such as code generation and general reasoning, few efforts…

计算与语言 · 计算机科学 2024-05-06 Mahmoud Masoud , Ahmed Abdelhay , Mohammed Elhenawy

Large language models (LLMs) have recently advanced automatic heuristic design (AHD) for combinatorial optimization (CO), where candidate heuristics are iteratively proposed, evaluated, and refined. Most existing approaches search over…

人工智能 · 计算机科学 2026-05-08 Nguyen Viet Tuan Kiet , Bui Dinh Pham , Dao Van Tung , Tran Cong Dao , Huynh Thi Thanh Binh

Recent studies have revealed that neural combinatorial optimization (NCO) has advantages over conventional algorithms in many combinatorial optimization problems such as routing, but it is less efficient for more complicated optimization…

人工智能 · 计算机科学 2021-11-15 Dongda Li , Zhaoquan Gu , Yuexuan Wang , Changwei Ren , Francis C. M. Lau

The design of good heuristics or approximation algorithms for NP-hard combinatorial optimization problems often requires significant specialized knowledge and trial-and-error. Can we automate this challenging, tedious process, and learn the…

机器学习 · 计算机科学 2018-02-23 Hanjun Dai , Elias B. Khalil , Yuyu Zhang , Bistra Dilkina , Le Song

In complex engineering systems, the dependencies among components or development activities are often modeled and analyzed using Design Structure Matrix (DSM). Reorganizing elements within a DSM to minimize feedback loops and enhance…

计算工程、金融与科学 · 计算机科学 2026-04-07 Shuo Jiang , Min Xie , Jianxi Luo

We introduce Limited Rollout Beam Search (LRBS), a beam search strategy for deep reinforcement learning (DRL) based combinatorial optimization improvement heuristics. Utilizing pre-trained models on the Euclidean Traveling Salesperson…

机器学习 · 计算机科学 2024-12-16 Federico Julian Camerota Verdù , Lorenzo Castelli , Luca Bortolussi

Combinatorial optimization problems are notoriously challenging for neural networks, especially in the absence of labeled instances. This work proposes an unsupervised learning framework for CO problems on graphs that can provide integral…

机器学习 · 计算机科学 2021-03-09 Nikolaos Karalias , Andreas Loukas

In the field of quantum computing, combinatorial optimization problems are typically addressed using QUBO (Quadratic Unconstrained Binary Optimization) solvers. However, these solvers are often insufficient for tackling higher-order…

量子物理 · 物理学 2024-07-24 Yuichiro Minato

We explore the impact of learning paradigms on training deep neural networks for the Travelling Salesman Problem. We design controlled experiments to train supervised learning (SL) and reinforcement learning (RL) models on fixed graph sizes…

机器学习 · 计算机科学 2019-11-01 Chaitanya K. Joshi , Thomas Laurent , Xavier Bresson

Automatic neural architecture design has shown its potential in discovering powerful neural network architectures. Existing methods, no matter based on reinforcement learning or evolutionary algorithms (EA), conduct architecture search in a…

机器学习 · 计算机科学 2019-09-05 Renqian Luo , Fei Tian , Tao Qin , Enhong Chen , Tie-Yan Liu

We introduce Robust Multi-Objective Decoding (RMOD), a novel inference-time algorithm that robustly aligns Large Language Models (LLMs) to multiple human objectives (e.g., instruction-following, helpfulness, safety) by maximizing the…

机器学习 · 计算机科学 2026-02-17 Seongho Son , William Bankes , Sangwoong Yoon , Shyam Sundhar Ramesh , Xiaohang Tang , Ilija Bogunovic

Vehicle routing problems (VRPs) are central to combinatorial optimization with significant practical implications. Recent advancements in neural combinatorial optimization (NCO) have demonstrated promising results by leveraging neural…

机器学习 · 计算机科学 2025-07-08 Han Li , Fei Liu , Zhenkun Wang , Qingfu Zhang

In this work we explore the combination of metaheuristics and learned neural network solvers for combinatorial optimization. We do this in the context of the transit network design problem, a uniquely challenging combinatorial optimization…

神经与进化计算 · 计算机科学 2023-06-02 Andrew Holliday , Gregory Dudek