English
Related papers

Related papers: ProRefine: Inference-Time Prompt Refinement with T…

200 papers

Users often omit essential details in their requests to LLM-based agents, resulting in under-specified inputs for tool use. This poses a fundamental challenge for tool-augmented agents, as API execution typically requires complete…

Computation and Language · Computer Science 2026-04-21 Yejin Yoon , Minseo Kim , Taeuk Kim

The increasing scale of large language models (LLMs) brings emergent abilities to various complex tasks requiring reasoning, such as arithmetic and commonsense reasoning. It is known that the effective design of task-specific prompts is…

Computation and Language · Computer Science 2024-07-23 Shizhe Diao , Pengcheng Wang , Yong Lin , Rui Pan , Xiang Liu , Tong Zhang

As an effective tool for eliciting the power of Large Language Models (LLMs), prompting has recently demonstrated unprecedented abilities across a variety of complex tasks. To further improve the performance, prompt ensemble has attracted…

Computation and Language · Computer Science 2023-08-24 Chenrui Zhang , Lin Liu , Jinpeng Wang , Chuyuan Wang , Xiao Sun , Hongyu Wang , Mingchen Cai

Driven by advances in Large Language Models (LLMs), integrating them into recommendation tasks has gained interest due to their strong semantic understanding and prompt flexibility. Prior work encoded user-item interactions or metadata into…

Information Retrieval · Computer Science 2025-06-10 Keyu Zhao , Fengli Xu , Yong Li

The reasoning abilities of Large Language Models (LLMs) remain a topic of debate. Some methods such as ReAct-based prompting, have gained popularity for claiming to enhance sequential decision-making abilities of agentic LLMs. However, it…

Artificial Intelligence · Computer Science 2024-05-24 Mudit Verma , Siddhant Bhambri , Subbarao Kambhampati

Large language models (LLMs) have achieved remarkable success in a wide range of natural language processing tasks and can be adapted through prompting. However, they remain suboptimal in multi-turn interactions, often relying on incorrect…

Large Language Models' (LLM) reasoning can be improved using test-time aggregation strategies, i.e., generating multiple samples and voting among generated samples. While these improve performance, they often reach a saturation point.…

Computation and Language · Computer Science 2025-09-18 Justin Chih-Yao Chen , Archiki Prasad , Swarnadeep Saha , Elias Stengel-Eskin , Mohit Bansal

Large language models (LLMs) have empowered AI agents to tackle increasingly complex tasks. However, most existing agents remain limited to static planning and brittle interactions, falling short of true collaboration or adaptive reasoning.…

Artificial Intelligence · Computer Science 2025-10-14 William Nguyen , Vinh Luong , Christopher Nguyen

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

Computation and Language · Computer Science 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West

Prompt optimization aims to find the best prompt to a large language model (LLM) for a given task. LLMs have been successfully used to help find and improve prompt candidates for single-step tasks. However, realistic tasks for agents are…

Computation and Language · Computer Science 2024-10-04 Yongchao Chen , Jacob Arkin , Yilun Hao , Yang Zhang , Nicholas Roy , Chuchu Fan

Large Reasoning Models (LRMs) represent a breakthrough in AI problem-solving capabilities, but their effectiveness in interactive environments can be limited. This paper introduces and analyzes overthinking in LRMs. A phenomenon where…

Reinforcement Learning (RL) significantly enhances the reasoning abilities of large language models (LLMs), yet applying it to multi-turn agentic tasks remains challenging due to the long-horizon nature of interactions and the stochasticity…

Artificial Intelligence · Computer Science 2026-04-03 Jingyue Gao , Yanjiang Guo , Xiaoshuai Chen , Jianyu Chen

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms…

Computation and Language · Computer Science 2025-07-28 Rithesh Murthy , Ming Zhu , Liangwei Yang , Jielin Qiu , Juntao Tan , Shelby Heinecke , Caiming Xiong , Silvio Savarese , Huan Wang

Recently, scaling test-time compute on Large Language Models (LLM) has garnered wide attention. However, there has been limited investigation of how various reasoning prompting strategies perform as scaling. In this paper, we focus on a…

Artificial Intelligence · Computer Science 2025-08-18 Yexiang Liu , Zekun Li , Zhi Fang , Nan Xu , Ran He , Tieniu Tan

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Creators struggle to edit long-form, narrative-rich videos not because of UI complexity, but due to the cognitive demands of searching, storyboarding, and sequencing hours of footage. Existing transcript- or embedding-based methods fall…

Artificial Intelligence · Computer Science 2025-09-30 Zihan Ding , Xinyi Wang , Junlong Chen , Per Ola Kristensson , Junxiao Shen

Large language models (LLMs) offer significant potential to accelerate systematic literature reviews (SLRs), yet current approaches often rely on brittle, manually crafted prompts that compromise reliability and reproducibility. This…

Computation and Language · Computer Science 2025-09-03 Teo Susnjak

Assessing the quality of outputs generated by generative models, such as large language models and vision language models, presents notable challenges. Traditional methods for evaluation typically rely on either human assessments, which are…

Computation and Language · Computer Science 2024-10-10 Yaswanth Narsupalli , Abhranil Chandra , Sreevatsa Muppirala , Manish Gupta , Pawan Goyal

In recent research advancements within the community, large language models (LLMs) have sparked great interest in creating autonomous agents. However, current prompt-based agents often heavily rely on large-scale LLMs. Meanwhile, although…

Computation and Language · Computer Science 2025-03-04 Xueyang Feng , Bo Lan , Quanyu Dai , Lei Wang , Jiakai Tang , Xu Chen , Zhenhua Dong , Ji-Rong Wen

Large Language Models (LLMs) often rely on test-time scaling via parallel decoding (for example, 512 samples) to boost reasoning accuracy, but this incurs substantial compute. We introduce CoRefine, a confidence-guided self-refinement…

Artificial Intelligence · Computer Science 2026-02-10 Chen Jin , Ryutaro Tanno , Tom Diethe , Philip Teare