English

PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learning

Computer Vision and Pattern Recognition 2026-08-03 v1

Abstract

In-context learning (ICL) has attracted increasing attention for enabling models to perform new tasks using only a few ``input--output'' prompt examples. However, existing approaches suffer from \textbf{shallow task adaptation}, where prompts are primarily used as contextual cues to implicitly infer task intent through semantic representations, while the underlying computational process remains unchanged. This limitation restricts task-specific adaptation and compromises inference interpretability. We argue that prompts should not only condition feature representations but also dynamically regulate the model's computation pathways. To this end, we propose \textbf{PromptPath}, an adaptive ICL framework that enables computation-level adaptation through prompt-conditioned dynamic pathways. Specifically, PromptPath introduces a prompt-driven routing mechanism to selectively activate and compose lightweight low-rank experts, forming task-specific computational pathways tailored to different prompts. By integrating prompt information directly into the inference process, PromptPath dynamically reconfigures model computation to enhance task specialization and interpretability. Extensive experiments on 3D point cloud and 2D visual recognition benchmarks demonstrate that PromptPath consistently outperforms state-of-the-art ICL baselines while exhibiting strong cross-domain and cross-task generalization.

Cite

@article{arxiv.2608.02129,
  title  = {PromptPath: Prompt-Adaptive Computational Pathways for In-Context Learning},
  author = {Hangrui Zhang and Feifei Shao and Yawei Luo and Ping Liu and Jiaxiang Liu and Zuoqi Tang and Zhao Wang and Hongwei Wang and Jun Xiao},
  journal= {arXiv preprint arXiv:2608.02129},
  year   = {2026}
}