English
Related papers

Related papers: Towards Interpretable Soft Prompts

200 papers

With machine learning models being increasingly used to aid decision making even in high-stakes domains, there has been a growing interest in developing interpretable models. Although many supposedly interpretable models have been proposed,…

Artificial Intelligence · Computer Science 2021-08-17 Forough Poursabzi-Sangdeh , Daniel G. Goldstein , Jake M. Hofman , Jennifer Wortman Vaughan , Hanna Wallach

This paper surveys and organizes research works in a new paradigm in natural language processing, which we dub "prompt-based learning". Unlike traditional supervised learning, which trains a model to take in an input x and predict an output…

Computation and Language · Computer Science 2021-07-30 Pengfei Liu , Weizhe Yuan , Jinlan Fu , Zhengbao Jiang , Hiroaki Hayashi , Graham Neubig

The effectiveness of prompt learning has been demonstrated in different pre-trained language models. By formulating suitable template and choosing representative label mapping, prompt learning can be used as an efficient knowledge probe.…

Computation and Language · Computer Science 2022-11-01 Jinta Weng , Yue Hu , Jing Qiu , Heyan Huan

Prompts are the interface for eliciting the capabilities of large language models (LLMs). Understanding their structure and components is critical for analyzing LLM behavior and optimizing performance. However, the field lacks a…

Computation and Language · Computer Science 2026-01-27 Sullam Jeoung , Yueyan Chen , Yi Zhang , Shuai Wang , Haibo Ding , Lin Lee Cheong

Large language models (LLMs) face significant challenges when balancing multiple high-level objectives, such as generating coherent, relevant, and high-quality responses while maintaining efficient task adaptation across diverse tasks. To…

Computation and Language · Computer Science 2025-02-21 Yupeng Chang , Yi Chang , Yuan Wu

The shift toward interacting with frozen, "black-box" Large Language Models (LLMs) has transformed prompt engineering from a heuristic exercise into a critical optimization challenge. We propose a Reinforcement Learning (RL) framework for…

Artificial Intelligence · Computer Science 2026-05-15 Krishna Sayana , Ketan Todi , Ambarish Jash

Prompt engineering is a new paradigm for enhancing the performance of trained neural network models. For optimizing text-style prompts, existing methods usually individually operate small portions of a text step by step, which either breaks…

Computation and Language · Computer Science 2023-10-03 Yujian Betterest Li , Kai Wu

The increasing adoption of machine learning tools has led to calls for accountability via model interpretability. But what does it mean for a machine learning model to be interpretable by humans, and how can this be assessed? We focus on…

Machine Learning · Computer Science 2019-08-06 Dylan Slack , Sorelle A. Friedler , Carlos Scheidegger , Chitradeep Dutta Roy

Evaluating LLMs with a single prompt has proven unreliable, with small changes leading to significant performance differences. However, generating the prompt variations needed for a more robust multi-prompt evaluation is challenging,…

Computation and Language · Computer Science 2026-04-07 Eliya Habba , Noam Dahan , Gili Lior , Gabriel Stanovsky

Aligning LLMs for math tutoring typically requires RL-based training with multi-GPU infrastructure. We investigate whether training-free prompt optimization-evolving only the system prompt via API calls-can serve as a practical alternative.…

Computation and Language · Computer Science 2026-05-27 Unggi Lee , Minchul Shin , Yeil Jeong , Sookbun Lee , Jeongsu Moon , Kyungtae Joo , Eunjoo Lee , Hoilym Kwon

Most large language models (LLMs) are sensitive to prompts, and another synonymous expression or a typo may lead to unexpected results for the model. Composing an optimal prompt for a specific demand lacks theoretical support and relies…

Computation and Language · Computer Science 2024-06-18 Zhenyu Zhang , Bingguang Hao , Jinpeng Li , Zekai Zhang , Dongyan Zhao

Soft prompts have emerged as a powerful alternative to adapters in parameter-efficient fine-tuning (PEFT), enabling large language models (LLMs) to adapt to downstream tasks without architectural changes or parameter updates. While prior…

Computation and Language · Computer Science 2026-01-14 Beso Mikaberidze , Teimuraz Saghinadze , Simon Ostermann , Philipp Muller

Going beyond mere fine-tuning of vision-language models (VLMs), learnable prompt tuning has emerged as a promising, resource-efficient alternative. Despite their potential, effectively learning prompts faces the following challenges: (i)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Hari Chandana Kuchibhotla , Sai Srinivas Kancheti , Abbavaram Gowtham Reddy , Vineeth N Balasubramanian

Vision-language models such as CLIP achieve strong visual-textual alignment, but often suffer from overfitting and limited interpretability when adapted through continuous prompt learning. While discrete prompt optimization improves…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Yating Wang , Yaqi Zhao , Yongshun Gong , Yilong Yin , Haoliang Sun

There has been growing interest in parameter-efficient methods to apply pre-trained language models to downstream tasks. Building on the Prompt Tuning approach of Lester et al. (2021), which learns task-specific soft prompts to condition a…

Computation and Language · Computer Science 2022-03-18 Tu Vu , Brian Lester , Noah Constant , Rami Al-Rfou , Daniel Cer

Parameter-efficient methods are able to use a single frozen pre-trained large language model (LLM) to perform many tasks by learning task-specific soft prompts that modulate model behavior when concatenated to the input text. However, these…

Computation and Language · Computer Science 2022-08-12 Brian Lester , Joshua Yurtsever , Siamak Shakeri , Noah Constant

Although the synthesis of programs encoding policies often carries the promise of interpretability, systematic evaluations were never performed to assess the interpretability of these policies, likely because of the complexity of such an…

Artificial Intelligence · Computer Science 2024-01-23 Zahra Bashir , Michael Bowling , Levi H. S. Lelis

In recent years, there has been a rapid proliferation of AI-generated text, primarily driven by the release of powerful pre-trained language models (PLMs). To address the issue of misuse associated with AI-generated text, various…

Computation and Language · Computer Science 2023-10-10 Tharindu Kumarage , Paras Sheth , Raha Moraffah , Joshua Garland , Huan Liu

Large Language Models (LLMs) excel in complex reasoning tasks but struggle with consistent rule application, exception handling, and explainability, particularly in domains like legal analysis that require both natural language…

Artificial Intelligence · Computer Science 2025-11-11 Albert Sadowski , Jarosław A. Chudziak

Prompt tuning is a technology that tunes a small set of parameters to steer a pre-trained language model (LM) to directly generate the output for downstream tasks. Recently, prompt tuning has demonstrated its storage and computation…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-02 Kai-Wei Chang , Yu-Kai Wang , Hua Shen , Iu-thing Kang , Wei-Cheng Tseng , Shang-Wen Li , Hung-yi Lee