English

Instructional Prompt Optimization for Few-Shot LLM-Based Recommendations on Cold-Start Users

Artificial Intelligence 2025-09-12 v1

Abstract

The cold-start user issue further compromises the effectiveness of recommender systems in limiting access to the historical behavioral information. It is an effective pipeline to optimize instructional prompts on a few-shot large language model (LLM) used in recommender tasks. We introduce a context-conditioned prompt formulation method P(u,\ Ds)\ \rightarrow\ R\widehat, where u is a cold-start user profile, Ds is a curated support set, and R\widehat is the predicted ranked list of items. Based on systematic experimentation with transformer-based autoregressive LLMs (BioGPT, LLaMA-2, GPT-4), we provide empirical evidence that optimal exemplar injection and instruction structuring can significantly improve the precision@k and NDCG scores of such models in low-data settings. The pipeline uses token-level alignments and embedding space regularization with a greater semantic fidelity. Our findings not only show that timely composition is not merely syntactic but also functional as it is in direct control of attention scales and decoder conduct through inference. This paper shows that prompt-based adaptation may be considered one of the ways to address cold-start recommendation issues in LLM-based pipelines.

Keywords

Cite

@article{arxiv.2509.09066,
  title  = {Instructional Prompt Optimization for Few-Shot LLM-Based Recommendations on Cold-Start Users},
  author = {Haowei Yang and Yushang Zhao and Sitao Min and Bo Su and Chao Yao and Wei Xu},
  journal= {arXiv preprint arXiv:2509.09066},
  year   = {2025}
}
R2 v1 2026-07-01T05:31:11.804Z