English

Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models

Computation and Language 2025-07-28 v3 Artificial Intelligence

Abstract

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms natural language task descriptions into high-quality prompts without requiring manual tuning or domain expertise. Promptomatix supports both a lightweight meta-prompt-based optimizer and a DSPy-powered compiler, with modular design enabling future extension to more advanced frameworks. The system analyzes user intent, generates synthetic training data, selects prompting strategies, and refines prompts using cost-aware objectives. Evaluated across 5 task categories, Promptomatix achieves competitive or superior performance compared to existing libraries, while reducing prompt length and computational overhead making prompt optimization scalable and efficient.

Keywords

Cite

@article{arxiv.2507.14241,
  title  = {Promptomatix: An Automatic Prompt Optimization Framework for Large Language Models},
  author = {Rithesh Murthy and Ming Zhu and Liangwei Yang and Jielin Qiu and Juntao Tan and Shelby Heinecke and Caiming Xiong and Silvio Savarese and Huan Wang},
  journal= {arXiv preprint arXiv:2507.14241},
  year   = {2025}
}
R2 v1 2026-07-01T04:08:31.562Z