English

Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimization

Artificial Intelligence 2024-12-17 v2

Abstract

To advance capabilities of large language models (LLMs) in solving combinatorial optimization problems (COPs), this paper presents the Language-based Neural COP Solver (LNCS), a novel framework that is unified for the end-to-end resolution of diverse text-attributed COPs. LNCS leverages LLMs to encode problem instances into a unified semantic space, and integrates their embeddings with a Transformer-based solution generator to produce high-quality solutions. By training the solution generator with conflict-free multi-task reinforcement learning, LNCS effectively enhances LLM performance in tackling COPs of varying types and sizes, achieving state-of-the-art results across diverse problems. Extensive experiments validate the effectiveness and generalizability of the LNCS, highlighting its potential as a unified and practical framework for real-world COP applications.

Keywords

Cite

@article{arxiv.2408.12214,
  title  = {Bridging Large Language Models and Optimization: A Unified Framework for Text-attributed Combinatorial Optimization},
  author = {Xia Jiang and Yaoxin Wu and Yuan Wang and Yingqian Zhang},
  journal= {arXiv preprint arXiv:2408.12214},
  year   = {2024}
}
R2 v1 2026-06-28T18:20:31.301Z