English
Related papers

Related papers: ProRefine: Inference-Time Prompt Refinement with T…

200 papers

Large Language Models (LLMs) have revolutionized various applications by generating outputs based on given prompts. However, achieving the desired output requires iterative prompt refinement. This paper presents a novel approach that draws…

Machine Learning · Computer Science 2025-01-22 Rupesh Raj Karn

Feature extraction from unstructured text is a critical step in many downstream classification pipelines, yet current approaches largely rely on hand-crafted prompts or fixed feature schemas. We formulate feature discovery as a…

Computation and Language · Computer Science 2026-01-21 Adrian Cosma , Oleg Szehr , David Kletz , Alessandro Antonucci , Olivier Pelletier

Large Language Models (LLMs) have shown remarkable capabilities in natural language tasks requiring complex reasoning, yet their application in agentic, multi-step reasoning within interactive environments remains a difficult challenge.…

Artificial Intelligence · Computer Science 2024-08-15 Pranav Putta , Edmund Mills , Naman Garg , Sumeet Motwani , Chelsea Finn , Divyansh Garg , Rafael Rafailov

Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. It enables LLMs to excel in various tasks, such as arithmetic reasoning, question…

Computation and Language · Computer Science 2024-03-29 Fobo Shi , Peijun Qing , Dong Yang , Nan Wang , Youbo Lei , Haonan Lu , Xiaodong Lin , Duantengchuan Li

Prompt engineering is a challenging yet crucial task for optimizing the performance of large language models on customized tasks. It requires complex reasoning to examine the model's errors, hypothesize what is missing or misleading in the…

Computation and Language · Computer Science 2024-07-04 Qinyuan Ye , Maxamed Axmed , Reid Pryzant , Fereshte Khani

Large reasoning models (LRMs) such as Claude 3.7 Sonnet and OpenAI o1 achieve strong performance on mathematical benchmarks using lengthy chain-of-thought (CoT) reasoning, but the resulting traces are often unnecessarily verbose. This…

Computation and Language · Computer Science 2025-06-13 Ye Yu , Yaoning Yu , Haohan Wang

Inspired by the dual-process theory of human cognition from \textit{Thinking, Fast and Slow}, we introduce \textbf{PRIME} (Planning and Retrieval-Integrated Memory for Enhanced Reasoning), a multi-agent reasoning framework that dynamically…

Artificial Intelligence · Computer Science 2025-11-12 Hieu Tran , Zonghai Yao , Nguyen Luong Tran , Zhichao Yang , Feiyun Ouyang , Shuo Han , Razieh Rahimi , Hong Yu

Tool-augmented LLM agents tend to call tools indiscriminately, even when the model can answer directly. Each unnecessary call wastes API fees and latency, yet no existing benchmark systematically studies when a tool call is actually needed.…

Computation and Language · Computer Science 2026-05-22 Chung-En Sun , Linbo Liu , Ge Yan , Zimo Wang , Tsui-Wei Weng

Large Language Models (LLMs) often exhibit significant behavioral shifts when they perceive a change from a real-world deployment context to a controlled evaluation setting, a phenomenon known as "evaluation awareness." This discrepancy…

Computation and Language · Computer Science 2025-12-05 Lang Xiong , Nishant Bhargava , Jianhang Hong , Jeremy Chang , Haihao Liu , Vasu Sharma , Kevin Zhu

The global demand for sustainable protein sources has accelerated the need for intelligent tools that can rapidly process and synthesise domain-specific scientific knowledge. In this study, we present a proof-of-concept multi-agent…

Artificial Intelligence · Computer Science 2025-06-26 Alexander D. Kalian , Jaewook Lee , Stefan P. Johannesson , Lennart Otte , Christer Hogstrand , Miao Guo

Large language models (LLMs) offer substantial promise for text classification in political science, yet their effectiveness often depends on high-quality prompts and exemplars. To address this, we introduce a three-stage framework that…

Computation and Language · Computer Science 2025-04-08 Menglin Liu , Ge Shi

The ReAct (Reasoning + Action) capability in large language models (LLMs) has become the foundation of modern agentic systems. Recent LLMs, such as DeepSeek-R1 and OpenAI o1/o3, exemplify this by emphasizing reasoning through the generation…

Artificial Intelligence · Computer Science 2025-05-20 Mrinal Rawat , Ambuje Gupta , Rushil Goomer , Alessandro Di Bari , Neha Gupta , Roberto Pieraccini

Large Language Models (LLMs) have demonstrated profound impact on Natural Language Processing (NLP) tasks. However, their effective deployment across diverse domains often require domain-specific adaptation strategies, as generic models may…

Artificial Intelligence · Computer Science 2025-10-15 Jingyi Wang , Hongyuan Zhu , Ye Niu , Yunhui Deng

Large Language Models (LLMs) have revolutionized recommendation agents by providing superior reasoning and flexible decision-making capabilities. However, existing methods mainly follow a passive information acquisition paradigm, where…

Information Retrieval · Computer Science 2026-03-11 Haobo Zhang , Yutao Zhu , Kelong Mao , Tianhao Li , Zhicheng Dou

The integration of experimental technologies with large language models (LLMs) is transforming scientific research. It positions AI as a versatile research assistant rather than a mere problem-solving tool. In the field of power systems,…

Computation and Language · Computer Science 2025-05-20 Mengshuo Jia , Zeyu Cui , Gabriela Hug

Reasoning is a fundamental cognitive process that enables logical inference, problem-solving, and decision-making. With the rapid advancement of large language models (LLMs), reasoning has emerged as a key capability that distinguishes…

Most existing prompting methods suffer from the issues of generalizability and consistency, as they often rely on instance-specific solutions that may not be applicable to other instances and lack task-level consistency across the selected…

Computation and Language · Computer Science 2024-11-12 Chang Gao , Haiyun Jiang , Deng Cai , Shuming Shi , Wai Lam

Large Language Models (LLMs) excel at reasoning, traditionally requiring high-quality large-scale data and extensive training. Recent works reveal a very appealing Less-Is-More phenomenon where very small, carefully curated high-quality…

Machine Learning · Computer Science 2026-04-22 Rapheal Huang , Weilong Guo

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

Computation and Language · Computer Science 2024-08-05 Xiangyu Zhao , Chengqian Ma

Despite rapid development, large language models (LLMs) still encounter challenges in multi-turn decision-making tasks (i.e., agent tasks) like web shopping and browser navigation, which require making a sequence of intelligent decisions…

Computation and Language · Computer Science 2025-11-12 Zhiheng Xi , Chenyang Liao , Guanyu Li , Yajie Yang , Wenxiang Chen , Zhihao Zhang , Binghai Wang , Senjie Jin , Yuhao Zhou , Jian Guan , Wei Wu , Tao Ji , Tao Gui , Qi Zhang , Xuanjing Huang