English
Related papers

Related papers: UP-Person: Unified Parameter-Efficient Transfer Le…

200 papers

Fine-tuning of self-supervised models is a powerful transfer learning method in a variety of fields, including speech processing, since it can utilize generic feature representations obtained from large amounts of unlabeled data.…

Multimedia · Computer Science 2022-12-07 Shinta Otake , Rei Kawakami , Nakamasa Inoue

Recent parameter-efficient language model tuning (PELT) methods manage to match the performance of fine-tuning with much fewer trainable parameters and perform especially well when training data is limited. However, different PELT methods…

Computation and Language · Computer Science 2022-09-07 Yuning Mao , Lambert Mathias , Rui Hou , Amjad Almahairi , Hao Ma , Jiawei Han , Wen-tau Yih , Madian Khabsa

Text-based person search is the task of finding person images that are the most relevant to the natural language text description given as query. The main challenge of this task is a large gap between the target images and text queries,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jicheol Park , Boseung Jeong , Dongwon Kim , Suha Kwak

Image captioning bridges the gap between vision and language by automatically generating natural language descriptions for images. Traditional image captioning methods often overlook the preferences and characteristics of users.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Xuan Wang , Guanhong Wang , Wenhao Chai , Jiayu Zhou , Gaoang Wang

Person text-image matching, also known as text based person search, aims to retrieve images of specific pedestrians using text descriptions. Although person text-image matching has made great research progress, existing methods still face…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Fan Li , Hang Zhou , Huafeng Li , Yafei Zhang , Zhengtao Yu

Multi-human parsing is an image segmentation task necessitating both instance-level and fine-grained category-level information. However, prior research has typically processed these two types of information through separate branches and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Jiaming Chu , Lei Jin , Junliang Xing , Jian Zhao

Prompt tuning is a parameter-efficient way to deploy large-scale pre-trained models to downstream tasks by adding task-specific tokens. In terms of vision-language pre-trained (VLP) models, prompt tuning often requires a large number of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Qiong Wu , Shubin Huang , Yiyi Zhou , Pingyang Dai , Annan Shu , Guannan Jiang , Rongrong Ji

Multi-Task Learning (MTL) networks have emerged as a promising method for transferring learned knowledge across different tasks. However, MTL must deal with challenges such as: overfitting to low resource tasks, catastrophic forgetting, and…

Machine Learning · Computer Science 2022-04-22 Jonathan Pilault , Amine Elhattami , Christopher Pal

Table pretrain-then-finetune paradigm has been proposed and employed at a rapid pace after the success of pre-training in the natural language domain. Despite the promising findings in tabular pre-trained language models (TPLMs), there is…

Computation and Language · Computer Science 2023-02-21 Nuo Chen , Linjun Shou , Ming Gong , Jian Pei , Chenyu You , Jianhui Chang , Daxin Jiang , Jia Li

Large foundation models pretrained on raw web-scale data are not readily deployable without additional step of extensive alignment to human preferences. Such alignment is typically done by collecting large amounts of pairwise comparisons…

Machine Learning · Computer Science 2024-06-13 Daiwei Chen , Yi Chen , Aniket Rege , Ramya Korlakai Vinayak

Parameter-efficient fine-tuning (PEFT) has emerged as an effective method for adapting pre-trained language models to various tasks efficiently. Recently, there has been a growing interest in transferring knowledge from one or multiple…

Computation and Language · Computer Science 2024-06-07 Zhisheng Lin , Han Fu , Chenghao Liu , Zhuo Li , Jianling Sun

Text-based person search (TBPS) aims to retrieve the images of the target person from a large image gallery based on a given natural language description. Existing methods are dominated by training models with parallel image-text pairs,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-07 Yang Bai , Jingyao Wang , Min Cao , Chen Chen , Ziqiang Cao , Liqiang Nie , Min Zhang

Prompting and context-based fine-tuning methods, which we call Prefix Learning, have been proposed to enhance the performance of language models on various downstream tasks. They are empirically efficient and effective, matching the…

Machine Learning · Computer Science 2024-10-17 Yingyu Liang , Zhenmei Shi , Zhao Song , Chiwun Yang

Text-based person retrieval aims to find the query person based on a textual description. The key is to learn a common latent space mapping between visual-textual modalities. To achieve this goal, existing works employ segmentation to…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiujun Shu , Wei Wen , Haoqian Wu , Keyu Chen , Yiran Song , Ruizhi Qiao , Bo Ren , Xiao Wang

Fine-tuning is widely used as the default algorithm for transfer learning from pre-trained models. Parameter inefficiency can however arise when, during transfer learning, all the parameters of a large pre-trained model need to be updated…

Computation and Language · Computer Science 2023-03-07 Yingting Li , Ambuj Mehrish , Shuai Zhao , Rishabh Bhardwaj , Amir Zadeh , Navonil Majumder , Rada Mihalcea , Soujanya Poria

Occluded person re-identification (ReID) aims to match occluded person images to holistic ones across dis-joint cameras. In this paper, we propose a novel framework by learning high-order relation and topology information for discriminative…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Guan'an Wang , Shuo Yang , Huanyu Liu , Zhicheng Wang , Yang Yang , Shuliang Wang , Gang Yu , Erjin Zhou , Jian Sun

In recent years, video-based person Re-Identification (ReID) has gained attention for its ability to leverage spatiotemporal cues to match individuals across non-overlapping cameras. However, current methods struggle with high-difficulty…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Shogo Hamano , Shunya Wakasugi , Tatsuhito Sato , Sayaka Nakamura

Parameter-efficient fine-tuning (PEFT) techniques, such as adapter tuning, aim to fine-tune a pre-trained language model (PLM) using a minimal number of parameters for a specific task or profile. Although adapter tuning provides increased…

Machine Learning · Computer Science 2024-01-30 Namju Kwak , Taesup Kim

As multimedia content expands, the demand for unified multimodal retrieval (UMR) in real-world applications increases. Recent work leverages multimodal large language models (MLLMs) to tackle this task. However, their large parameter size…

Multimedia · Computer Science 2025-07-29 Yibo Lyu , Rui Shao , Gongwei Chen , Yijie Zhu , Weili Guan , Liqiang Nie

Person reidentification (re-ID) has been receiving increasing attention in recent years due to its importance for both science and society. Machine learning and particularly Deep Learning (DL) has become the main re-id tool that allowed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-29 Nikita Gabdullin