English
Related papers

Related papers: Scale, Don't Fine-tune: Guiding Multimodal LLMs fo…

200 papers

Existing Zero-Shot Composed Image Retrieval (ZS-CIR) methods typically train adapters that convert reference images into pseudo-text tokens, which are concatenated with the modifying text and processed by frozen text encoders in pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Rong-Cheng Tu , Zhao Jin , Jingyi Liao , Xiao Luo , Yingjie Wang , Li Shen , Dacheng Tao

The target of video moment retrieval (VMR) is predicting temporal spans within a video that semantically match a given linguistic query. Existing VMR methods based on multimodal large language models (MLLMs) overly rely on expensive…

Multimedia · Computer Science 2025-01-15 Yifang Xu , Yunzhuo Sun , Benxiang Zhai , Ming Li , Wenxin Liang , Yang Li , Sidan Du

Visual instruction tuning is crucial for improving vision-language large models (VLLMs). However, many samples can be solved via linguistic patterns or common-sense shortcuts, without genuine cross-modal reasoning, limiting the…

Artificial Intelligence · Computer Science 2026-03-11 Peng Sun , Huawen Shen , Yi Ban , Tianfan Fu , Yanbo Wang , Yuqiang Li

Multimodal Large Language Models (MLLMs) have shown strong performance on Video Temporal Grounding (VTG). However, their coarse recognition capabilities are insufficient for fine-grained temporal understanding, making task-specific…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Jiwook Han , Geo Ahn , Youngrae Kim , Jinwoo Choi

Web service administrators must ensure the stability of multiple systems by promptly detecting anomalies in Key Performance Indicators (KPIs). Achieving the goal of "train once, infer across scenarios" remains a fundamental challenge for…

Machine Learning · Computer Science 2025-10-07 Zexin Wang , Changhua Pei , Yang Liu , Hengyue Jiang , Quan Zhou , Haotian Si , Hang Cui , Jianhui Li , Gaogang Xie , Jingjing Li , Dan Pei

Visual Place Recognition (VPR) is a crucial capability for long-term autonomous robots, enabling them to identify previously visited locations using visual information. However, existing methods remain limited in indoor settings due to the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Huaqi Tao , Bingxi Liu , Calvin Chen , Tingjun Huang , He Li , Jinqiang Cui , Hong Zhang

As enthusiasm for scaling computation (data and parameters) in the pretraining era gradually diminished, test-time scaling (TTS), also referred to as ``test-time computing'' has emerged as a prominent research focus. Recent studies…

Computation and Language · Computer Science 2025-05-06 Qiyuan Zhang , Fuyuan Lyu , Zexu Sun , Lei Wang , Weixu Zhang , Wenyue Hua , Haolun Wu , Zhihan Guo , Yufei Wang , Niklas Muennighoff , Irwin King , Xue Liu , Chen Ma

Prompt ensembling of Large Language Model (LLM) generated category-specific prompts has emerged as an effective method to enhance zero-shot recognition ability of Vision-Language Models (VLMs). To obtain these category-specific prompts, the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 M. Jehanzeb Mirza , Leonid Karlinsky , Wei Lin , Sivan Doveh , Jakub Micorek , Mateusz Kozinski , Hilde Kuehne , Horst Possegger

Test-time Scaling (TTS) has been demonstrated to significantly enhance the reasoning capabilities of Large Language Models (LLMs) during the inference phase without altering model parameters. However, existing TTS methods are largely…

Computation and Language · Computer Science 2025-09-30 Guibin Zhang , Fanci Meng , Guancheng Wan , Zherui Li , Kun Wang , Zhenfei Yin , Lei Bai , Shuicheng Yan

Recent trends in Large Vision Language Models (LVLMs) research have been increasingly focusing on advancing beyond general image understanding towards more nuanced, object-level referential comprehension. In this paper, we present and delve…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Tongtian Yue , Jie Cheng , Longteng Guo , Xingyuan Dai , Zijia Zhao , Xingjian He , Gang Xiong , Yisheng Lv , Jing Liu

Recent advances in few-shot adaptation for Vision-Language Models (VLMs) have greatly expanded their ability to generalize across tasks using only a few labeled examples. However, existing approaches primarily build upon the strong…

Computer Vision and Pattern Recognition · Computer Science 2025-06-05 Maxime Zanella , Clément Fuchs , Ismail Ben Ayed , Christophe De Vleeschouwer

The application of Contrastive Language-Image Pre-training (CLIP) in Weakly Supervised Semantic Segmentation (WSSS) research powerful cross-modal semantic understanding capabilities. Existing methods attempt to optimize input text prompts…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Zhongxing Xu , Feilong Tang , Zhe Chen , Yingxue Su , Zhiyi Zhao , Ge Zhang , Jionglong Su , Zongyuan Ge

Vision Large Language Models (VLLMs) exhibit promising potential for multi-modal understanding, yet their application to video-based emotion recognition remains limited by insufficient spatial and contextual awareness. Traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Zhifeng Wang , Qixuan Zhang , Peter Zhang , Wenjia Niu , Kaihao Zhang , Ramesh Sankaranarayana , Sabrina Caldwell , Tom Gedeon

Visual Place Recognition (VPR) is the ability to correctly recall a previously visited place under changing viewpoints and appearances. A large number of handcrafted and deep-learning-based VPR techniques exist, where the former suffer from…

Computer Vision and Pattern Recognition · Computer Science 2020-09-29 Mihnea-Alexandru Tomită , Mubariz Zaffar , Michael Milford , Klaus McDonald-Maier , Shoaib Ehsan

While substantial progress has been made in the absolute performance of localization and Visual Place Recognition (VPR) techniques, it is becoming increasingly clear from translating these systems into applications that other capabilities…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Helen Carson , Jason J. Ford , Michael Milford

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

Test-Time Scaling (TTS) improves the reasoning performance of Large Language Models (LLMs) by allocating additional compute during inference. We conduct a structured survey of TTS methods and categorize them into sampling-based,…

Computation and Language · Computer Science 2025-06-06 Ho-Lam Chung , Teng-Yun Hsiao , Hsiao-Ying Huang , Chunerh Cho , Jian-Ren Lin , Zhang Ziwei , Yun-Nung Chen

Multimodal Large Language Models (MLLMs) inherit the superior text understanding capabilities of LLMs and extend these capabilities to multimodal scenarios. These models achieve excellent results in the general domain of multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Jinlong He , Pengfei Li , Gang Liu , Shenjun Zhong

Scaling model parameters has become the de facto strategy for improving NLP systems, but it comes with substantial computational costs. Test-Time Scaling (TTS) offers an alternative by allocating more computation at inference: generating…

Computation and Language · Computer Science 2025-09-24 Shaomu Tan , Ryosuke Mitani , Ritvik Choudhary , Toshiyuki Sekiya

The development of vision-language models (VLMs) for histo-pathology has shown promising new usages and zero-shot performances. However, current approaches, which decompose large slides into smaller patches, focus solely on inductive…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Maxime Zanella , Fereshteh Shakeri , Yunshi Huang , Houda Bahig , Ismail Ben Ayed