English
Related papers

Related papers: OptiMUS: Scalable Optimization Modeling with (MI)L…

200 papers

While model serving has unlocked unprecedented capabilities, the high cost of serving large-scale models continues to be a significant barrier to widespread accessibility and rapid innovation. Compiler optimizations have long driven…

Machine Learning · Computer Science 2026-02-05 Annabelle Sujun Tang , Christopher Priebe , Rohan Mahapatra , Lianhui Qin , Hadi Esmaeilzadeh

Large Language Models (LLMs) have shown remarkable performance in various natural language processing tasks but face challenges in mathematical reasoning, where complex problem-solving requires both linguistic understanding and mathematical…

Computation and Language · Computer Science 2025-03-20 Shuguang Chen , Guang Lin

Automatically generating high-quality step-by-step solutions to math word problems has many applications in education. Recently, combining large language models (LLMs) with external tools to perform complex reasoning and calculation has…

Computation and Language · Computer Science 2023-04-19 Joy He-Yueya , Gabriel Poesia , Rose E. Wang , Noah D. Goodman

Various human-designed prompt engineering techniques have been proposed to improve problem solvers based on Large Language Models (LLMs), yielding many disparate code bases. We unify these approaches by describing LLM-based agents as…

Artificial Intelligence · Computer Science 2024-08-23 Mingchen Zhuge , Wenyi Wang , Louis Kirsch , Francesco Faccio , Dmitrii Khizbullin , Jürgen Schmidhuber

Automated optimization modeling via Large Language Models (LLMs) has emerged as a promising approach to assist complex human decision-making. While post-training has become a pivotal technique to enhance LLMs' capabilities in this domain,…

Machine Learning · Computer Science 2026-02-13 Weiting Liu , Han Wu , Yufei Kuang , Xiongwei Han , Tao Zhong , Jianfeng Feng , Wenlian Lu

With recent advancements in natural language processing, Large Language Models (LLMs) have emerged as powerful tools for various real-world applications. Despite their prowess, the intrinsic generative abilities of LLMs may prove…

Artificial Intelligence · Computer Science 2025-12-30 Jingqing Ruan , Yihong Chen , Bin Zhang , Zhiwei Xu , Tianpeng Bao , Guoqing Du , Shiwei Shi , Hangyu Mao , Ziyue Li , Xingyu Zeng , Rui Zhao

Large Language Models (LLMs) have demonstrated remarkable reasoning abilities, prompting interest in their application as black-box optimizers. This paper asserts that LLMs possess the capability for zero-shot optimization across diverse…

We present a framework in which a large language model (LLM) acts as an online adaptive controller for SIMP topology optimization, replacing conventional fixed-schedule continuation with real-time, state-conditioned parameter decisions. At…

Computational Engineering, Finance, and Science · Computer Science 2026-05-18 Shaoliang Yang , Jun Wang , Yunsheng Wang

Recent Large Language Models (LLMs) such as OpenAI o3-mini and DeepSeek-R1 use enhanced reasoning through Chain-of-Thought (CoT). Their potential in hardware design, which relies on expert-driven iterative optimization, remains unexplored.…

Artificial Intelligence · Computer Science 2025-04-15 Luca Collini , Andrew Hennessee , Ramesh Karri , Siddharth Garg

Large Language Models (LLMs) have become a milestone in the field of artificial intelligence and natural language processing. However, their large-scale deployment remains constrained by the need for significant computational resources.…

Computation and Language · Computer Science 2025-08-07 Julián Camilo Velandia Gutiérrez

Recommender systems have traditionally followed modular architectures comprising candidate generation, multi-stage ranking, and re-ranking, each trained separately with supervised objectives and hand-engineered features. While effective in…

Information Retrieval · Computer Science 2025-10-06 Rahul Raja , Anshaj Vats , Arpita Vats , Anirban Majumder

As multiple crises threaten the sustainability of our societies and pose at risk the planetary boundaries, complex challenges require timely, updated, and usable information. Natural-language processing (NLP) tools enhance and expand data…

Computers and Society · Computer Science 2025-02-05 Francesca Larosa , Sergio Hoyas , H. Alberto Conejero , Javier Garcia-Martinez , Francesco Fuso Nerini , Ricardo Vinuesa

In the field of software operations, Large Language Models (LLMs) have attracted increasing attention. However, existing research has not yet achieved efficient and effective end-to-end intelligent operations due to low-quality data,…

Machine Learning · Computer Science 2026-05-13 Jingkai He , Pengfei Chen , Chenghui Wu , Shuang Liang , Ye Li , Gou Tan , Xiadao Wen , Chuanfu Zhang

Large-scale optimization is a key backbone of modern business decision-making. However, building these models is often labor-intensive and time-consuming. We address this by proposing LEAN-LLM-OPT, a LightwEight AgeNtic workflow…

Artificial Intelligence · Computer Science 2026-02-03 Kuo Liang , Yuhang Lu , Jianming Mao , Shuyi Sun , Chunwei Yang , Congcong Zeng , Xiao Jin , Hanzhang Qin , Ruihao Zhu , Chung-Piaw Teo

Recent studies have suggested that large language models (LLMs) underperform on mathematical and computer science tasks when these problems are translated from Romanian into English, compared to their original Romanian format. Accurate…

This is the first work to look at the application of large language models (LLMs) for the purpose of model space edits in automated planning tasks. To set the stage for this union, we explore two different flavors of model space problems…

Artificial Intelligence · Computer Science 2024-03-06 Turgay Caglar , Sirine Belhaj , Tathagata Chakraborti , Michael Katz , Sarath Sreedharan

The optimization of nuclear engineering designs, such as nuclear fuel assembly configurations, involves managing competing objectives like reactivity control and power distribution. This study explores the use of Optimization by Prompting,…

The difficulty and expense of obtaining large-scale human responses make Large Language Models (LLMs) an attractive alternative and a promising proxy for human behavior. However, prior work shows that LLMs often produce homogeneous outputs…

Artificial Intelligence · Computer Science 2025-10-09 Manh Hung Nguyen , Sebastian Tschiatschek , Adish Singla

The recent development of Large Language Models (LLMs) has been accompanied by an effervescence of novel ideas and methods to better optimize the loss of deep learning models. Claims from those methods are myriad: from faster convergence to…

Machine Learning · Computer Science 2025-09-03 Andrei Semenov , Matteo Pagliardini , Martin Jaggi

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP) by automating traditional labor-intensive tasks and consequently accelerated the development of computer-aided applications. As researchers…

Computation and Language · Computer Science 2025-06-24 Summra Saleem , Muhammad Nabeel Asim , Shaista Zulfiqar , Andreas Dengel