English
Related papers

Related papers: Retrieval-Augmented Dynamic Prompt Tuning for Inco…

200 papers

Multimodal video understanding is crucial for analyzing egocentric videos, where integrating multiple sensory signals significantly enhances action recognition and moment localization. However, practical applications often grapple with…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Merey Ramazanova , Alejandro Pardo , Humam Alwassel , Bernard Ghanem

Fine-grained object retrieval aims to learn discriminative representation to retrieve visually similar objects. However, existing top-performing works usually impose pairwise similarities on the semantic embedding spaces or design a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Shijie Wang , Jianlong Chang , Zhihui Wang , Haojie Li , Wanli Ouyang , Qi Tian

Vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization but remain sensitive to domain shifts at test time. Test-time prompt tuning (TPT) mitigates this issue by adapting prompts with fixed augmentations, which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yuqing Lei , Yingjun Du , Yawen Huang , Xiantong Zhen , Ling Shao

Retrieval-Augmented Generation (RAG) systems face challenges with complex, multihop questions, and agentic frameworks such as Search-R1 (Jin et al., 2025), which operates iteratively, have been proposed to address these complexities.…

Recent prompt-based text-to-speech (TTS) models can clone an unseen speaker using only a short speech prompt. They leverage a strong in-context ability to mimic the speech prompts, including speaker style, prosody, and emotion. Therefore,…

Sound · Computer Science 2024-06-07 Jinlong Xue , Yayue Deng , Yingming Gao , Ya Li

Visual prompt tuning (VPT) is a promising solution incorporating learnable prompt tokens to customize pre-trained models for downstream tasks. However, VPT and its variants often encounter challenges like prompt initialization, prompt…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Yuzhu Wang , Lechao Cheng , Chaowei Fang , Dingwen Zhang , Manni Duan , Meng Wang

Since the launch of ChatGPT at the end of 2022, generative dialogue models represented by ChatGPT have quickly become essential tools in daily life. As user expectations increase, enhancing the capability of generative dialogue models to…

Computation and Language · Computer Science 2024-09-02 Yuetong Zhao , Hongyu Cao , Xianyu Zhao , Zhijian Ou

Soft prompt tuning achieves superior performances across a wide range of few-shot tasks. However, the performances of prompt tuning can be highly sensitive to the initialization of the prompts. We also empirically observe that conventional…

Computation and Language · Computer Science 2023-06-09 Junda Wu , Tong Yu , Rui Wang , Zhao Song , Ruiyi Zhang , Handong Zhao , Chaochao Lu , Shuai Li , Ricardo Henao

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

Artificial Intelligence · Computer Science 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

Large language models (LLMs) struggle to effectively utilize a growing number of external tools, such as those defined by the Model Context Protocol (MCP)\cite{IntroducingMCP}, due to prompt bloat and selection complexity. We introduce…

Artificial Intelligence · Computer Science 2025-05-07 Tiantian Gan , Qiyao Sun

Prompt tuning has emerged as a key technique for adapting large pre-trained Decision Transformers (DTs) in offline Reinforcement Learning (RL), particularly in multi-task and few-shot settings. The Prompting Decision Transformer (PDT)…

Machine Learning · Computer Science 2025-10-02 Finn Rietz , Oleg Smirnov , Sara Karimi , Lele Cao

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by grounding generation in external knowledge, yielding relevance responses that are aligned with factual evidence and evolving corpora. Standard RAG pipelines…

Machine Learning · Computer Science 2026-04-07 Xun Sun , Baiheng Xie , Li Huang , Qiang Gao

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

Artificial Intelligence · Computer Science 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng

Financial analysis relies heavily on the interpretation of earnings reports to assess company performance and guide decision-making. Traditional methods for generating such analyzes require significant financial expertise and are often…

Statistical Finance · Quantitative Finance 2025-12-10 Hai-Thien To , Tien-Cuong Bui , Van-Duc Le

Deep prompt tuning (DPT) has gained great success in most natural language processing~(NLP) tasks. However, it is not well-investigated in dense retrieval where fine-tuning~(FT) still dominates. When deploying multiple retrieval tasks using…

Computation and Language · Computer Science 2022-08-25 Zhengyang Tang , Benyou Wang , Ting Yao

One-on-one tutoring is an effective instructional method for enhancing learning, yet its efficacy hinges on tutor competencies. Novice math tutors often prioritize content-specific guidance, neglecting aspects such as social-emotional…

Prompt tuning is a new, efficient NLP transfer learning paradigm that adds a task-specific prompt in each input instance during the model training stage. It freezes the pre-trained language model and only optimizes a few task-specific…

Computation and Language · Computer Science 2022-04-12 Zhuofeng Wu , Sinong Wang , Jiatao Gu , Rui Hou , Yuxiao Dong , V. G. Vinod Vydiswaran , Hao Ma

Although data-free incremental learning methods are memory-friendly, accurately estimating and counteracting representation shifts is challenging in the absence of historical data. This paper addresses this thorny problem by proposing a…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Zhiheng Ma , Xiaopeng Hong , Beinan Liu , Yabin Wang , Pinyue Guo , Huiyun Li

Advancements in prompt tuning of vision-language models have underscored their potential in enhancing open-world visual concept comprehension. However, prior works only primarily focus on single-mode (only one prompt for each modality) and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Dongsheng Wang , Miaoge Li , Xinyang Liu , MingSheng Xu , Bo Chen , Hanwang Zhang

Missing modalities cause severe failures in multimodal recommender systems. User histories, item text, and visual evidence are frequently absent during cold-start scenarios, exactly when recommendation quality matters most. Existing…

Information Retrieval · Computer Science 2026-05-26 Jinze Wang , Yangchen Zeng , Tiehua Zhang , Lu Zhang , Yuze Liu , Zhishu Shen , Jiong Jin , Zhu Sun