English
Related papers

Related papers: ToPT: Task-Oriented Prompt Tuning for Urban Region…

200 papers

The auditory system plays a substantial role in shaping the overall human perceptual experience. While prevailing large language models (LLMs) and visual language models (VLMs) have shown their promise in solving a wide variety of language…

Audio and Speech Processing · Electrical Eng. & Systems 2025-02-19 Jinhua Liang , Xubo Liu , Wenwu Wang , Mark D. Plumbley , Huy Phan , Emmanouil Benetos

Prompt learning has emerged as an efficient alternative for fine-tuning foundational models, such as CLIP, for various downstream tasks. Conventionally trained using the task-specific objective, i.e., cross-entropy loss, prompts tend to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Muhammad Uzair Khattak , Syed Talal Wasim , Muzammal Naseer , Salman Khan , Ming-Hsuan Yang , Fahad Shahbaz Khan

This technical report presents our solution for the RoboSense Challenge at IROS 2025, which evaluates Vision-Language Models (VLMs) on autonomous driving scene understanding across perception, prediction, planning, and corruption detection…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Aodi Wu , Xubo Luo

Dynamic graphs have attracted increasing attention due to their ability to model complex and evolving relationships in real-world scenarios. Traditional approaches typically pre-train models using dynamic link prediction and directly apply…

Machine Learning · Computer Science 2026-01-21 Yufei Peng , Cheng Yang , Zhengjie Fan , Chuan Shi

Flow matching models (FMs) have revolutionized text-to-image (T2I) generation, with reinforcement learning (RL) serving as a critical post-training strategy for alignment with reward objectives. In this research, we show that current RL…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Fu-Yun Wang , Han Zhang , Michael Gharbi , Hongsheng Li , Taesung Park

LiDAR semantic segmentation is crucial for autonomous vehicles and mobile robots, requiring high accuracy and real-time processing, especially on resource-constrained embedded systems. Previous state-of-the-art methods often face a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Samir Abou Haidar , Alexandre Chariot , Mehdi Darouich , Cyril Joly , Jean-Emmanuel Deschaud

Pre-trained vision-language models are able to interpret visual concepts and language semantics. Prompt learning, a method of constructing prompts for text encoders or image encoders, elicits the potentials of pre-trained models and readily…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Zhenhan Huang , Tejaswini Pedapati , Pin-Yu Chen , Jianxi Gao

This is the first work to investigate the effectiveness of BERT-based contextual embeddings in active learning (AL) tasks on cold-start scenarios, where traditional fine-tuning is infeasible due to the absence of labeled data. Our primary…

Machine Learning · Computer Science 2024-07-25 Fabiano Belém , Washington Cunha , Celso França , Claudio Andrade , Leonardo Rocha , Marcos André Gonçalves

Parameter-efficient fine-tuning strategies for foundation models in 1D textual and 2D visual analysis have demonstrated remarkable efficacy. However, due to the scarcity of point cloud data, pre-training large 3D models remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Mengke Li , Lihao Chen , Peng Zhang , Yiu-ming Cheung , Hui Huang

Visual prompt tuning offers significant advantages for adapting pre-trained visual foundation models to specific tasks. However, current research provides limited insight into the interpretability of this approach, which is essential for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Yubin Wang , Xinyang Jiang , De Cheng , Xiangqian Zhao , Zilong Wang , Dongsheng Li , Cairong Zhao

BERT (Bidirectional Encoder Representations from Transformers) and related pre-trained Transformers have provided large gains across many language understanding tasks, achieving a new state-of-the-art (SOTA). BERT is pre-trained on two…

Computation and Language · Computer Science 2020-06-22 Michael Glass , Alfio Gliozzo , Rishav Chakravarti , Anthony Ferritto , Lin Pan , G P Shrivatsa Bhargav , Dinesh Garg , Avirup Sil

With the scale of vision Transformer-based models continuing to grow, finetuning these large-scale pretrained models for new tasks has become increasingly parameter-intensive. Visual prompt tuning is introduced as a parameter-efficient…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Runjia Zeng , Cheng Han , Qifan Wang , Chunshu Wu , Tong Geng , Lifu Huang , Ying Nian Wu , Dongfang Liu

Referring understanding is a fundamental task that bridges natural language and visual content by localizing objects described in free-form expressions. However, existing works are constrained by limited language expressiveness, lacking the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Yani Zhang , Dongming Wu , Wencheng Han , Xingping Dong

Federated edge learning (FEEL) is envisioned as a promising paradigm to achieve privacy-preserving distributed learning. However, it consumes excessive learning time due to the existence of straggler devices. In this paper, a novel…

Information Theory · Computer Science 2022-04-04 Shanfeng Huang , Zezhong Zhang , Shuai Wang , Rui Wang , Kaibin Huang

Multi-modal language model has made advanced progress in vision and audio, but still faces significant challenges in dealing with complex reasoning tasks in the time series domain. The reasons are twofold. First, labels for multi-modal time…

Machine Learning · Computer Science 2025-03-10 Haochuan Zhang , Chunhua Yang , Jie Han , Liyang Qin , Xiaoli Wang

Learning effective representations of urban environments requires capturing spatial structure beyond fixed administrative boundaries. Existing geospatial representation learning approaches typically aggregate Points of Interest(POI) into…

Machine Learning · Computer Science 2026-01-23 Mohammad Hashemi , Hossein Amiri , Andreas Zufle

Micro-expression recognition (MER) is crucial in the affective computing field due to its wide application in medical diagnosis, lie detection, and criminal investigation. Despite its significance, obtaining micro-expression (ME)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Jiateng Liu , Hengcan Shi , Feng Chen , Zhiwen Shao , Yaonan Wang , Jianfei Cai , Wenming Zheng

As extended reality (XR) is redefining how users interact with computing devices, research in human action recognition is gaining prominence. Typically, models deployed on immersive computing devices are static and limited to their default…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Prachi Garg , Joseph K J , Vineeth N Balasubramanian , Necati Cihan Camgoz , Chengde Wan , Kenrick Kin , Weiguang Si , Shugao Ma , Fernando De La Torre

Trajectory representation learning (TRL) aims to encode raw trajectory data into low-dimensional embeddings for downstream tasks such as travel time estimation, mobility prediction, and trajectory similarity analysis. From a behavioral…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Ji Cao , Yu Wang , Tongya Zheng , Jie Song , Qinghong Guo , Zujie Ren , Canghong Jin , Gang Chen , Mingli Song

Prompt-based learning has emerged as a parameter-efficient finetuning (PEFT) approach to facilitate Large Language Model (LLM) adaptation to downstream tasks by conditioning generation with task-aware guidance. Despite its successes,…

Computation and Language · Computer Science 2025-10-21 Yiyang Liu , James C. Liang , Heng Fan , Wenhao Yang , Yiming Cui , Xiaotian Han , Lifu Huang , Dongfang Liu , Qifan Wang , Cheng Han