English
Related papers

Related papers: optimize_anything: A Universal API for Optimizing …

200 papers

Generative artificial intelligence (GenAI) holds great promise as a tool to support personalized learning. Teachers need tools to efficiently and effectively enhance content readability of educational texts so that they are matched to…

Large Language Models (LLMs) have demonstrated remarkable capabilities in software engineering, yet comprehensive benchmarks covering diverse SE activities remain limited. We present a multi-task evaluation of 11 state-of-the-art LLMs…

Software Engineering · Computer Science 2026-02-10 Go Frendi Gunawan , Mukhlis Amien

While many researchers use Large Language Models (LLMs) through chat-based access, their real potential lies in leveraging LLMs via application programming interfaces (APIs). This paper conceptualizes LLMs as universal text processing…

Computation and Language · Computer Science 2026-03-23 Ivan Zupic

Developing autonomous agents for web-based tasks is a core challenge in AI. While Large Language Model (LLM) agents can interpret complex user requests, they often operate as black boxes, making it difficult to diagnose why they fail or how…

Artificial Intelligence · Computer Science 2026-03-16 Orit Shahnovsky , Rotem Dror

The performance of large language model (LLM) systems depends not only on model weights, but also on their harness: the code that determines what information to store, retrieve, and present to the model. Yet harnesses are still designed…

Artificial Intelligence · Computer Science 2026-03-31 Yoonho Lee , Roshen Nair , Qizheng Zhang , Kangwook Lee , Omar Khattab , Chelsea Finn

Test-Time Scaling (TTS) improves large language models (LLMs) by allocating additional computation during inference, typically through parallel, sequential, or hybrid scaling. However, prior studies often assume fixed collaboration…

Machine Learning · Computer Science 2025-11-04 Fali Wang , Jihai Chen , Shuhua Yang , Runxue Bao , Tianxiang Zhao , Zhiwei Zhang , Xianfeng Tang , Hui Liu , Qi He , Suhang Wang

AI is undergoing a paradigm shift, with breakthroughs achieved by systems orchestrating multiple large language models (LLMs) and other complex components. As a result, developing principled and automated optimization methods for compound…

Computation and Language · Computer Science 2024-06-12 Mert Yuksekgonul , Federico Bianchi , Joseph Boen , Sheng Liu , Zhi Huang , Carlos Guestrin , James Zou

The pervasive deployment of Large Language Models-LLMs in various sectors often neglects the nuanced requirements of individuals and small organizations, who benefit more from models precisely tailored to their specific business contexts…

Computation and Language · Computer Science 2024-07-10 Jiaxi Cui , Wentao Zhang , Jing Tang , Xudong Tong , Zhenwei Zhang , Amie , Jing Wen , Rongsheng Wang , Pengfei Wu

Background: The surge in single-cell omics data exposes limitations in traditional, manually defined analysis workflows. AI agents offer a paradigm shift, enabling adaptive planning, executable code generation, traceable decisions, and…

Genomics · Quantitative Biology 2026-03-17 Yang Liu , Lu Zhou , Xiawei Du , Ruikun He , Xuguang Zhang , Rongbo Shen , Yixue Li

GPU code optimization is a key performance bottleneck for HPC workloads as well as large-model training and inference. Although compiler optimizations and hand-written kernels can partially alleviate this issue, achieving…

Computation and Language · Computer Science 2026-01-26 Qiuyi Qu , Yicheng Sui , Yufei Sun , Rui Chen , Xiaofei Zhang , Yuzhi Zhang , Haofeng Wang , Ge Lan

Large Language Models (LLMs) have demonstrated remarkable performance across diverse domains. However, effectively leveraging their vast knowledge for training smaller downstream models remains an open challenge, especially in domains like…

Machine Learning · Computer Science 2025-07-28 Davor Vukadin , Marin Šilić , Goran Delač

Large language models (LLMs) excel in open domains but struggle in specialized settings with limited data and evolving knowledge. Existing domain adaptation practices rely heavily on manual trial-and-error processes, incur significant…

Machine Learning · Computer Science 2026-03-10 Sidharth Sinha , Anson Bastos , Xuchao Zhang , Akshay Nambi , Chetan Bansal , Saravan Rajmohan

While large language models (LLMs) have recently demonstrated strong potential in solving planning problems, there is a trade-off between flexibility and complexity. LLMs, as zero-shot planners themselves, are still not capable of directly…

Artificial Intelligence · Computer Science 2025-07-10 Yilun Hao , Yang Zhang , Chuchu Fan

Edge intelligence delivers low-latency inference, yet most edge analytics remain hard-coded and must be redeployed as conditions change. When data patterns shift or new questions arise, engineers often need to write new scripts and push…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-14 Chinmaya Kumar Dehury , Siddharth Singh Kushwaha , Qiyang Zhang , Alaa Saleh , Praveen Kumar Donta

Optimization models developed by operations research (OR) experts are often deployed as decision-support systems in industrial settings. However, real-world environments are dynamic, with evolving business rules and unforeseen…

Artificial Intelligence · Computer Science 2026-05-28 Tinghan Ye , Arnaud Deza , Ved Mohan , El Mehdi Er Raqabi , Pascal Van Hentenryck

As Large Language Models (LLMs) have become integral to both research and daily operations, rigorous evaluation is crucial. This assessment is important not only for individual tasks but also for understanding their societal impact and…

Software Engineering · Computer Science 2024-04-02 Zeeshan Rasheed , Muhammad Waseem , Kari Systä , Pekka Abrahamsson

The efficacy of large language models (LLMs) on downstream tasks usually hinges on instruction tuning, which relies critically on the quality of training data. Unfortunately, collecting high-quality and diverse data is both expensive and…

Computation and Language · Computer Science 2024-11-25 Hang Zhou , Yehui Tang , Haochen Qin , Yujie Yang , Renren Jin , Deyi Xiong , Kai Han , Yunhe Wang

Language models (LMs) are often expected to generate strings in some formal language; for example, structured data, API calls, or code snippets. Although LMs can be tuned to improve their adherence to formal syntax, this does not guarantee…

Computation and Language · Computer Science 2024-08-06 Terry Koo , Frederick Liu , Luheng He

Recent advancements in Large Language Models (LLMs) and their utilization in code generation tasks have significantly reshaped the field of software development. Despite the remarkable efficacy of code completion solutions in mainstream…

Software Engineering · Computer Science 2024-06-12 Bohdan Petryshyn , Mantas Lukoševičius

Large language models (LLMs) are increasingly used in learning algorithms, evaluations, and optimization tasks. Recent studies have shown that using LLM-based optimizers to automatically optimize model prompts, demonstrations, predictions…

Computation and Language · Computer Science 2025-10-23 Guowei Xu , Mert Yuksekgonul , Carlos Guestrin , James Zou