English
Related papers

Related papers: SemanticOpt: Towards LLM-Based Semantic Black-Box …

200 papers

Large Language Models (LLMs) have shown notable potential in code generation for optimization algorithms, unlocking exciting new opportunities. This paper examines how LLMs, rather than creating algorithms from scratch, can improve existing…

Artificial Intelligence · Computer Science 2025-07-22 Camilo Chacón Sartori , Christian Blum

Bayesian optimisation is a powerful tool to solve expensive black-box problems, but fails when the stationary assumption made on the objective function is strongly violated, which is the case in particular for ill-conditioned or…

Machine Learning · Statistics 2019-12-06 Victor Picheny , Sattar Vakili , Artem Artemev

We introduce LogicAsker, a novel approach for evaluating and enhancing the logical reasoning capabilities of large language models (LLMs) such as ChatGPT and GPT-4. Despite LLMs' prowess in tasks like writing assistance, code generation,…

Software Engineering · Computer Science 2024-10-10 Yuxuan Wan , Wenxuan Wang , Yiliu Yang , Youliang Yuan , Jen-tse Huang , Pinjia He , Wenxiang Jiao , Michael R. Lyu

Black-box Large Language Models (LLMs) have shown great power in solving various tasks and are considered general problem solvers. However, LLMs still fail in many specific tasks although understand the task instruction. In this paper, we…

Computation and Language · Computer Science 2024-08-13 Wangtao Sun , Xuanqing Yu , Shizhu He , Jun Zhao , Kang Liu

Test-time scaling has enabled Large Language Models (LLMs) with remarkable reasoning capabilities, particularly in mathematical domains, through intermediate chain-of-thought (CoT) reasoning before generating final answers. However, the…

Machine Learning · Computer Science 2025-10-21 Binxin Gao , Jingjun Han

Recent advancements in large language models (LLMs) are propelling us toward artificial general intelligence with their remarkable emergent abilities and reasoning capabilities. However, the substantial computational and memory requirements…

Machine Learning · Computer Science 2024-10-10 Ruihao Gong , Yang Yong , Shiqiao Gu , Yushi Huang , Chengtao Lv , Yunchen Zhang , Xianglong Liu , Dacheng Tao

The Natural Language for Optimization (NL4Opt) Competition was created to investigate methods of extracting the meaning and formulation of an optimization problem based on its text description. Specifically, the goal of the competition is…

Black-box optimization is increasingly used in engineering design problems where simulation-based evaluations are costly and gradients are unavailable. In this context, the optimization community has largely analyzed algorithm performance…

Neural and Evolutionary Computing · Computer Science 2026-02-06 Iván Olarte Rodríguez , Gokhan Serhat , Mariusz Bujny , Fabian Duddeck , Thomas Bäck , Elena Raponi

The rapid advancements in Large Language Models (LLMs) have significantly expanded their applications, ranging from multilingual support to domain-specific tasks and multimodal integration. In this paper, we present OmniEvalKit, a novel…

Computation and Language · Computer Science 2024-12-10 Yi-Kai Zhang , Xu-Xiang Zhong , Shiyin Lu , Qing-Guo Chen , De-Chuan Zhan , Han-Jia Ye

Large Language Models (LLMs) have revolutionized various domains but encounter substantial challenges in tackling optimization modeling tasks for Operations Research (OR), particularly when dealing with complex problem. In this work, we…

Computation and Language · Computer Science 2025-06-24 Yang Wu , Yifan Zhang , Yurong Wu , Yuran Wang , Junkai Zhang , Jian Cheng

Optimization modeling plays a critical role in the application of Operations Research (OR) tools to address real-world problems, yet they pose challenges and require extensive expertise from OR experts. With the advent of large language…

Computation and Language · Computer Science 2025-07-30 Chenyu Huang , Zhengyang Tang , Shixi Hu , Ruoqing Jiang , Xin Zheng , Dongdong Ge , Benyou Wang , Zizhuo Wang

Large Language Models excel in tasks like natural language understanding and text generation. Prompt engineering plays a critical role in leveraging LLM effectively. However, LLMs black-box nature hinders its interpretability and effective…

Computation and Language · Computer Science 2024-10-31 Ximing Dong , Shaowei Wang , Dayi Lin , Gopi Krishnan Rajbahadur , Boquan Zhou , Shichao Liu , Ahmed E. Hassan

Research on new optimization algorithms is often funded based on the motivation that such algorithms might improve the capabilities to deal with real-world and industrially relevant optimization challenges. Besides a huge variety of…

Neural and Evolutionary Computing · Computer Science 2020-07-02 Ramses Sala , Ralf Müller

Large language models (LLMs) have demonstrated remarkable zero-shot generalization abilities: state-of-the-art chatbots can provide plausible answers to many common questions that arise in daily life. However, so far, LLMs cannot reliably…

Artificial Intelligence · Computer Science 2023-09-28 Bo Liu , Yuqian Jiang , Xiaohan Zhang , Qiang Liu , Shiqi Zhang , Joydeep Biswas , Peter Stone

Information Technology (IT) Operations (Ops), particularly Artificial Intelligence for IT Operations (AIOps), is the guarantee for maintaining the orderly and stable operation of existing information systems. According to Gartner's…

Large Language Models (LLMs) excel at understanding natural language but struggle with optimisation tasks involving multiple constraints and user-defined preferences, which commonly arise in domains such as robotics. We propose a hybrid…

Artificial Intelligence · Computer Science 2026-05-29 Pedro Orvalho , Marta Kwiatkowska , Guillem Alenyà , Felip Manyà

The rapid integration of Large Language Models (LLMs) into various industries presents both revolutionary opportunities and unique challenges. This research aims to establish a scalable and efficient framework for LLM customization,…

Software Engineering · Computer Science 2024-05-22 Panos Fitsilis , Vyron Damasiotis , Vasileios Kyriatzis , Paraskevi Tsoutsa

The goal of personalized medicine is to discover a treatment regimen that optimizes a patient's clinical outcome based on their personal genetic and environmental factors. However, candidate treatments cannot be arbitrarily administered to…

Machine Learning · Computer Science 2026-02-09 Michael S. Yao , Osbert Bastani , Alma Andersson , Tommaso Biancalani , Aïcha Bentaieb , Claudia Iriondo

Large language models have achieved substantial progress in mathematical reasoning, yet their advancement is limited by the scarcity of high-quality, high-difficulty training data. Existing synthesis methods largely rely on transforming…

Computation and Language · Computer Science 2026-03-10 Shaoxiong Zhan , Yanlin Lai , Ziyu Lu , Dahua Lin , Ziqing Yang , Fei Tan

Large Language Models (LLMs) are increasingly being used to automate programming tasks. Yet, LLMs' capabilities in reasoning about program semantics are still inadequately studied, leaving significant potential for further exploration. This…

Programming Languages · Computer Science 2025-05-30 Thanh Le-Cong , Bach Le , Toby Murray