English
Related papers

Related papers: Generalists vs. Specialists: Evaluating LLMs on Hi…

200 papers

Large Language Models (LLMs) have garnered considerable interest due to their impressive natural language capabilities, which in conjunction with various emergent properties make them versatile tools in workflows ranging from complex code…

Materials Science · Physics 2024-10-22 Ge Lei , Ronan Docherty , Samuel J. Cooper

Large Language Models (LLMs) have rapidly transformed the landscape of artificial intelligence, enabling natural language interfaces and dynamic orchestration of software components. However, their reliance on probabilistic inference limits…

Machine Learning · Computer Science 2025-07-01 Claudionor Coelho , Yanen Li , Philip Tee

The emergence of Large Language Models (LLMs) has revolutionized natural language processing in various applications especially in e-commerce. One crucial step before the application of such LLMs in these fields is to understand and compare…

Computation and Language · Computer Science 2024-08-26 Chester Palen-Michel , Ruixiang Wang , Yipeng Zhang , David Yu , Canran Xu , Zhe Wu

Large Language Models (LLMs) have shown great potential in automatically generating and optimizing (meta)heuristics, making them valuable tools in heuristic optimization tasks. However, LLMs are generally inefficient when it comes to…

Neural and Evolutionary Computing · Computer Science 2025-05-23 Niki van Stein , Diederick Vermetten , Thomas Bäck

Recent advancements in Large Language Models (LLMs) have showcased striking results on existing logical reasoning benchmarks, with some models even surpassing human performance. However, the true depth of their competencies and robustness…

Computation and Language · Computer Science 2024-11-05 Pengfei Hong , Navonil Majumder , Deepanway Ghosal , Somak Aditya , Rada Mihalcea , Soujanya Poria

In this work, we provide a systematic analysis of how large language models (LLMs) contribute to solving planning problems. In particular, we examine how LLMs perform when they are used as problem solver, solution verifier, and heuristic…

Artificial Intelligence · Computer Science 2024-12-16 Haoming Li , Zhaoliang Chen , Songyuan Liu , Yiming Lu , Fei Liu

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

Computation and Language · Computer Science 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Optimization is ubiquitous. While derivative-based algorithms have been powerful tools for various problems, the absence of gradient imposes challenges on many real-world applications. In this work, we propose Optimization by PROmpting…

Machine Learning · Computer Science 2024-04-16 Chengrun Yang , Xuezhi Wang , Yifeng Lu , Hanxiao Liu , Quoc V. Le , Denny Zhou , Xinyun Chen

The goal of personalized medicine is to discover a treatment regimen that optimizes a patient's clinical outcome based on their personal genetic and environmental factors. However, candidate treatments cannot be arbitrarily administered to…

Machine Learning · Computer Science 2026-02-09 Michael S. Yao , Osbert Bastani , Alma Andersson , Tommaso Biancalani , Aïcha Bentaieb , Claudia Iriondo

Optimizing instructions for large language models (LLMs) is critical for harnessing their full potential in complex and diverse tasks. However, relying solely on white-box approaches demands extensive computational resources and offers…

Computation and Language · Computer Science 2025-06-30 Yanwei Ren , Liu Liu , Baosheng Yu , Jiayan Qiu , Quan Chen

Large Language Models (LLMs) show promise for equation discovery, yet their outputs are highly sensitive to prompt phrasing, a phenomenon we term instruction brittleness. Static prompts cannot adapt to the evolving state of a multi-step…

Machine Learning · Computer Science 2026-01-05 Junqi Qu , Yan Zhang , Shangqian Gao , Shibo Li

There is considerable confusion about the role of Large Language Models (LLMs) in planning and reasoning tasks. On one side are over-optimistic claims that LLMs can indeed do these tasks with just the right prompting or self-verification…

Artificial Intelligence · Computer Science 2024-06-13 Subbarao Kambhampati , Karthik Valmeekam , Lin Guan , Mudit Verma , Kaya Stechly , Siddhant Bhambri , Lucas Saldyt , Anil Murthy

Large Language Models (LLMs) have demonstrated impressive capabilities across numerous fields, presenting an opportunity to revolutionize optimization problem-solving, a crucial, ubiquitous, and complex domain. This paper explores the…

Computation and Language · Computer Science 2025-02-05 Soheil Abbasloo

This paper investigates the capabilities of large language models (LLMs) in formulating and solving decision-making problems using mathematical programming. We first conduct a systematic review and meta-analysis of recent literature to…

Artificial Intelligence · Computer Science 2025-08-26 Mohammad J. Abdel-Rahman , Yasmeen Alslman , Dania Refai , Amro Saleh , Malik A. Abu Loha , Mohammad Yahya Hamed

Autonomous tuning of particle accelerators is an active and challenging field of research with the goal of enabling novel accelerator technologies cutting-edge high-impact applications, such as physics discovery, cancer research and…

Computation and Language · Computer Science 2024-05-16 Jan Kaiser , Annika Eichler , Anne Lauscher

Multi-omics studies often rely on pathway enrichment to interpret heterogeneous molecular changes, but pathway enrichment (PE)-based workflows inherit structural limitations of pathway resources, including curation lag, functional…

Computation and Language · Computer Science 2026-01-01 Sibo Wei , Peng Chen , Lifeng Dong , Yin Luo , Lei Wang , Peng Zhang , Wenpeng Lu , Jianbin Guo , Hongjun Yang , Dajun Zeng

The applications of large language models (LLMs) are promising for biomedical and healthcare research. Despite the availability of open-source LLMs trained using a wide range of biomedical data, current research on the applications of LLMs…

Machine Learning · Computer Science 2024-09-25 Tianyu Liu , Yijia Xiao , Xiao Luo , Hua Xu , W. Jim Zheng , Hongyu Zhao

Large language models (LLMs) have significantly advanced natural language processing, excelling in areas like text generation, summarization, and question-answering. Despite their capabilities, these models face challenges when fine-tuned…

Computation and Language · Computer Science 2024-12-23 Ali Hamdi , Hozaifa Kassab , Mohamed Bahaa , Marwa Mohamed

Large Language Models (LLMs) are the cornerstone in automating Requirements Engineering (RE) tasks, underpinning recent advancements in the field. Their pre-trained comprehension of natural language is pivotal for effectively tailoring them…

Software Engineering · Computer Science 2024-05-16 Andreas Vogelsang , Jannik Fischbach

Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the…

Software Engineering · Computer Science 2024-04-11 Xinyi Hou , Yanjie Zhao , Yue Liu , Zhou Yang , Kailong Wang , Li Li , Xiapu Luo , David Lo , John Grundy , Haoyu Wang