English
Related papers

Related papers: Prompt Segmentation and Annotation Optimisation: C…

200 papers

Large language models (LLMs) have demonstrated remarkable capabilities in code generation and structured reasoning; however, their performance often degrades on complex tasks that require consistent multi-step planning. Recent work has…

Machine Learning · Computer Science 2025-08-11 Fei Xu Yu , Gina Adam , Nathaniel D. Bastian , Tian Lan

Supervised learning relies on high-quality labeled data, but obtaining such data through human annotation is both expensive and time-consuming. Recent work explores using large language models (LLMs) for annotation, but LLM-generated labels…

Machine Learning · Computer Science 2026-03-23 Lequan Lin , Dai Shi , Andi Han , Feng Chen , Qiuzheng Chen , Jiawen Li , Zhaoyang Li , Jiyuan Li , Zhenbang Sun , Junbin Gao

Fine-grained opinion analysis of text provides a detailed understanding of expressed sentiments, including the addressed entity. Although this level of detail is valuable, annotating opinions in datasets for model training requires…

Computation and Language · Computer Science 2026-05-28 Gaurav Negi , MA Waskow , John McCrae , Omnia Zayed , Paul Buitelaar

Large Language Models (LLMs) have gained widespread popularity due to their ability to perform ad-hoc Natural Language Processing (NLP) tasks with a simple natural language prompt. Part of the appeal for LLMs is their approachability to the…

Human-Computer Interaction · Computer Science 2025-02-25 Aditi Mishra , Utkarsh Soni , Anjana Arunkumar , Jinbin Huang , Bum Chul Kwon , Chris Bryan

Search methods based on Pretrained Language Models (PLM) have demonstrated great effectiveness gains compared to statistical and early neural ranking models. However, fine-tuning PLM-based rankers requires a great amount of annotated…

Information Retrieval · Computer Science 2023-09-13 Sophia Althammer , Guido Zuccon , Sebastian Hofstätter , Suzan Verberne , Allan Hanbury

Prompt optimization and fine-tuning are two major approaches to improve the performance of Large Language Models (LLMs). They enhance the capabilities of LLMs from complementary perspectives: the former through explicit natural language,…

Computation and Language · Computer Science 2026-03-03 Xiaohe Bo , Rui Li , Zexu Sun , Quanyu Dai , Zeyu Zhang , Zihang Tian , Xu Chen , Zhenhua Dong

LLM agents in markets present algorithmic collusion risks. While prior work shows LLM agents reach supracompetitive prices through tacit coordination, existing research focuses on hand-crafted prompts. The emerging paradigm of prompt…

Artificial Intelligence · Computer Science 2026-04-21 Yingtao Tian

Human evaluation is increasingly critical for assessing large language models, capturing linguistic nuances, and reflecting user preferences more accurately than traditional automated metrics. However, the resource-intensive nature of this…

Computation and Language · Computer Science 2023-10-24 Meriem Boubdir , Edward Kim , Beyza Ermis , Marzieh Fadaee , Sara Hooker

The remarkable capabilities of the Segment Anything Model (SAM) for tackling image segmentation tasks in an intuitive and interactive manner has sparked interest in the design of effective visual prompts. Such interest has led to the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jorge Quesada , Zoe Fowler , Mohammad Alotaibi , Mohit Prabhushankar , Ghassan AlRegib

Large language models (LLMs) have demonstrated remarkable capabilities across diverse tasks, and LLM-based agents further extend these abilities to various practical workflows. While recent progress shows that multi-agent systems (MAS) can…

Computation and Language · Computer Science 2025-10-10 Zheyuan Zhang , Lin Ge , Hongjiang Li , Weicheng Zhu , Chuxu Zhang , Yanfang Ye

Large Language Models (LLMs) show promise for equation discovery, yet their outputs are highly sensitive to prompt phrasing, a phenomenon we term instruction brittleness. Static prompts cannot adapt to the evolving state of a multi-step…

Machine Learning · Computer Science 2026-01-05 Junqi Qu , Yan Zhang , Shangqian Gao , Shibo Li

The traditional data annotation process is often labor-intensive, time-consuming, and susceptible to human bias, which complicates the management of increasingly complex datasets. This study explores the potential of large language models…

Computation and Language · Computer Science 2024-09-17 Jianfei Wu , Xubin Wang , Weijia Jia

Recent advancements in large language models (LLMs) have highlighted their potential across a variety of tasks, but their performance still heavily relies on the design of effective prompts. Existing methods for automatic prompt…

Computation and Language · Computer Science 2025-06-23 Chenyi Zhou , Zhengyan Shi , Yuan Yao , Lei Liang , Huajun Chen , Qiang Zhang

In this paper, we conduct a comprehensive SWOT analysis of prompt engineering techniques within the realm of Large Language Models (LLMs). Emphasizing linguistic principles, we examine various techniques to identify their strengths,…

Computation and Language · Computer Science 2024-10-18 Aditi Singh , Abul Ehtesham , Gaurav Kumar Gupta , Nikhil Kumar Chatta , Saket Kumar , Tala Talaei Khoei

Research shows that dialogue, the interactive process through which participants articulate their thinking, plays a central role in constructing shared understanding, coordinating action, and shaping learning outcomes in teams. Analysing…

Current Large Language Model (LLM) evaluation frameworks utilize the same static prompt template across all models under evaluation. This differs from the common industry practice of using prompt optimization (PO) techniques to optimize the…

Artificial Intelligence · Computer Science 2026-05-01 Nicholas Sadjoli , Tim Siefken , Atin Ghosh , Yifan Mai , Daniel Dahlmeier

Promptable foundation models, particularly Segment Anything Model (SAM), have emerged as a promising alternative to the traditional task-specific supervised learning for image segmentation. However, many evaluation studies have found that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Rachana Sathish , Rahul Venkataramani , K S Shriram , Prasad Sudhakar

Large language model (LLM) performance depends heavily on prompt design, yet prompt construction is often described and applied inconsistently. Our purpose was to derive a reference framework for structuring LLM prompts. This paper presents…

Computation and Language · Computer Science 2026-04-17 David A. Cook

Prompt engineering is crucial for unlocking the potential of Large Language Models (LLMs). Still, since manual prompt design is often complex, non-intuitive, and time-consuming, automatic prompt optimization has emerged as a research area.…

Computation and Language · Computer Science 2025-10-30 Sara Câmara , Eduardo Luz , Valéria Carvalho , Ivan Meneghini , Gladston Moreira

Segmentation is essential for medical image analysis tasks such as intervention planning, therapy guidance, diagnosis, treatment decisions. Deep learning is becoming increasingly prominent for segmentation, where the lack of annotations,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-19 Firat Ozdemir , Zixuan Peng , Christine Tanner , Philipp Fuernstahl , Orcun Goksel