English
Related papers

Related papers: CriSPO: Multi-Aspect Critique-Suggestion-guided Au…

200 papers

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

Automatic prompt optimization (APO) has driven significant gains in LLM-based agentic workflows. However, existing methods treat each task's prompt as a monolithic, instance-blind string optimized through global edits, producing brittle…

Artificial Intelligence · Computer Science 2026-05-28 Jyotirmoy Nath , Neeraj Kumar , Brejesh Lall

Momentum-Aided Prompt Optimization (MAPO) enhances the efficiency and efficacy of prompt optimization for Large Language Models (LLMs). Building on ProTeGi, MAPO uses positive natural language "gradients" and a momentum-based extension to…

Computation and Language · Computer Science 2025-06-30 Anthony Cui , Pranav Nandyalam , Andrew Rufail , Ethan Cheung , Aiden Lei , Kevin Zhu , Sean O'Brien

Prompt engineering is crucial for achieving reliable and effective outputs from large language models (LLMs), but its design requires specialized knowledge of prompting techniques and a deep understanding of target tasks. To address this…

Computation and Language · Computer Science 2025-10-22 Yohei Ikenoue , Hitomi Tashiro , Shigeru Kuroyanagi

Group Relative Policy Optimization (GRPO) has proven to be an effective tool for post-training language models (LMs). However, AI systems are increasingly expressed as modular programs that mix together multiple LM calls with distinct…

Most prompt-optimization methods refine a single static template, making them ineffective in complex and dynamic user scenarios. Existing query-dependent approaches rely on unstable textual feedback or black-box reward models, providing…

Artificial Intelligence · Computer Science 2025-11-26 Ke Chen , Yifeng Wang , Hassan Almosapeeh , Haohan Wang

Feedback is crucial for every design process, such as user interface (UI) design, and automating design critiques can significantly improve the efficiency of the design workflow. Although existing multimodal large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-05-26 Peitong Duan , Chin-Yi Cheng , Bjoern Hartmann , Yang Li

Large Language Models utilizing reasoning techniques improve task performance but incur significant latency and token costs due to verbose generation. Existing automatic prompt optimization(APO) frameworks target task accuracy exclusively…

Computation and Language · Computer Science 2026-04-17 Deep Shah , Sanket Badhe , Nehal Kathrotia , Priyanka Tiwari

How emotions are expressed depends on the context and domain. On X (formerly Twitter), for instance, an author might simply use the hashtag #anger, while in a news headline, emotions are typically written in a more polite, indirect manner.…

Computation and Language · Computer Science 2024-12-18 Yarik Menchaca Resendiz , Roman Klinger

Generative AI can now synthesize strikingly realistic images from text, yet output quality remains highly sensitive to how prompts are phrased. Direct Preference Optimization (DPO) offers a lightweight, off-policy alternative to RL for…

Computation and Language · Computer Science 2025-07-30 Anas Mohamed , Azal Ahmad Khan , Xinran Wang , Ahmad Faraz Khan , Shuwen Ge , Saman Bahzad Khan , Ayaan Ahmad , Ali Anwar

While prompt optimization has emerged as a critical technique for enhancing language model performance, existing approaches primarily focus on elicitation-based strategies that search for optimal prompts to activate models' capabilities.…

Computation and Language · Computer Science 2026-03-31 Yunzhe Xu , Zhuosheng Zhang , Zhe Liu

Prompt engineering is crucial for effective interaction with generative artificial intelligence systems, yet existing optimisation methods often operate over an unstructured and vast prompt space, leading to high computational costs and…

Artificial Intelligence · Computer Science 2026-05-15 Devika Prasad , Luke Gerschwitz , Tong Li , Henry Xiao , Anjin Liu , Coco Wu , Anna Leontjeva , Luiz Pizzato

Large Language Models (LLMs) have shown significant capability across various tasks, with their real-world effectiveness often driven by prompt design. While recent research has focused on optimizing prompt content, the role of prompt…

Computation and Language · Computer Science 2025-05-22 Yuanye Liu , Jiahang Xu , Li Lyna Zhang , Qi Chen , Xuan Feng , Yang Chen , Zhongxin Guo , Yuqing Yang , Peng Cheng

Automated prompt optimization (APO) aims to improve large language model performance by refining prompt instructions. However, existing methods are largely constrained by fixed prompt templates, limited search spaces, or single-sided…

Multiagent Systems · Computer Science 2026-05-18 Kewen Zhu , Liping Yi , Zhiming Zhao , Xiang Li , Qinghua Hu

Using personalized explanations to support recommendations has been shown to increase trust and perceived quality. However, to actually obtain better recommendations, there needs to be a means for users to modify the recommendation criteria…

Computation and Language · Computer Science 2022-01-13 Diego Antognini , Claudiu Musat , Boi Faltings

Prompt engineering has proven to be a crucial step in leveraging pretrained large language models (LLMs) in solving various real-world tasks. Numerous solutions have been proposed that seek to automate prompt engineering by using the model…

Recent reasoning-focused language models such as DeepSeek R1 and OpenAI o1 have demonstrated strong performance on structured reasoning benchmarks including GSM8K, MATH, and multi-hop question answering tasks. However, their performance…

Computation and Language · Computer Science 2026-03-31 Rahul Soni

Feature extraction from unstructured text is a critical step in many downstream classification pipelines, yet current approaches largely rely on hand-crafted prompts or fixed feature schemas. We formulate feature discovery as a…

Computation and Language · Computer Science 2026-01-21 Adrian Cosma , Oleg Szehr , David Kletz , Alessandro Antonucci , Olivier Pelletier

Recently, generative pre-training based models have demonstrated remarkable results on Aspect-based Sentiment Analysis (ABSA) task. However, previous works overemphasize crafting various templates to paraphrase training targets for enhanced…

Computation and Language · Computer Science 2024-12-03 Hao Dong , Wei Wei

There is a growing interest in leveraging multiple large language models (LLMs) for automated code optimization. However, industrial platforms deploying multiple LLMs face a critical challenge: prompts optimized for one LLM often fail with…