English
Related papers

Related papers: Chain of Visual Perception: Harnessing Multimodal …

200 papers

Referring camouflaged object detection (Ref-COD) aims to identify hidden objects by incorporating reference information such as images and text descriptions. Previous research has transformed reference images with salient objects into…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yu Wen , Shuyong Gao , Shuping Zhang , Miao Huang , Lili Tao , Han Yang , Haozhe Xing , Lihe Zhang , Boxue Hou

Face Recognition Systems (FRS) are increasingly vulnerable to face-morphing attacks, prompting the development of Morphing Attack Detection (MAD) algorithms. However, a key challenge in MAD lies in its limited generalizability to unseen…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Haoyu Zhang , Raghavendra Ramachandra , Kiran Raja , Christoph Busch

Compared with unimodal data, multimodal data can provide more features to help the model analyze the sentiment of data. Previous research works rarely consider token-level feature fusion, and few works explore learning the common features…

Computation and Language · Computer Science 2022-06-15 Zhen Li , Bing Xu , Conghui Zhu , Tiejun Zhao

Effective cross-modal retrieval is essential for applications like information retrieval and recommendation systems, particularly in specialized domains such as manufacturing, where product information often consists of visual samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Francesco Giuliari , Asif Khan Pattan , Mohamed Lamine Mekhalfi , Fabio Poiesi

Multimodal large language models (MLLMs) integrate image features from visual encoders with LLMs, demonstrating advanced comprehension capabilities. However, mainstream MLLMs are solely supervised by the next-token prediction of textual…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Yunnan Wang , Fan Lu , Kecheng Zheng , Ziyuan Huang , Ziqiang Li , Wenjun Zeng , Xin Jin

Multimodal supervision has achieved promising results in many visual language understanding tasks, where the language plays an essential role as a hint or context for recognizing and locating instances. However, due to the defects of the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Weixin Feng , Xingyuan Bu , Chenchen Zhang , Xubin Li

Checks remain a foundational instrument in the financial ecosystem, facilitating substantial transaction volumes across institutions. However, their continued use also renders them a persistent target for fraud, underscoring the importance…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Sourav Halder , Jinjun Tong , Xinyu Wu

Current Large Vision-Language Models (LVLMs) have demonstrated remarkable capabilities in understanding multimodal data, but their potential remains underexplored for deepfake detection due to the misalignment of their knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Peipeng Yu , Jianwei Fei , Hui Gao , Xuan Feng , Zhihua Xia , Chip Hong Chang

To utilize visual information, Multimodal Large Language Model (MLLM) relies on the perception process of its vision encoder. The completeness and accuracy of visual perception significantly influence the precision of spatial reasoning,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Runpeng Yu , Xinyin Ma , Xinchao Wang

Camouflaged Object Detection (COD) aims to identify objects that blend seamlessly into their surroundings. The inherent visual complexity of camouflaged objects, including their low contrast with the background, diverse textures, and subtle…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Chenxi Zhang , Qing Zhang , Jiayun Wu , Youwei Pang

Reasoning Video Object Segmentation is a challenging task, aiming at generating a mask sequence from an input video given a complex and implicit text query. While existing works finetune Multimodal Large Language Models (MLLM) for the task,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Shiu-hong Kao , Yu-Wing Tai , Chi-Keung Tang

Advances in image tampering pose serious security threats, underscoring the need for effective image manipulation localization (IML). While supervised IML achieves strong performance, it depends on costly pixel-level annotations. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Rui Chen , Bin Liu , Changtao Miao , Xinghao Wang , Yi Li , Tao Gong , Qi Chu , Nenghai Yu

Large-scale vision-language models (VLMs) such as CLIP exhibit strong zero-shot generalization, but adapting them to downstream tasks typically requires costly labeled data. Existing unsupervised self-training methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Qian-Wei Wang , Guanghao Meng , Ren Cai , Yaguang Song , Shu-Tao Xia

The remarkable success of Large Language Models (LLMs) and instruction tuning drives the evolution of Vision Language Models (VLMs) towards a versatile general-purpose model. Yet, it remains unexplored whether current VLMs genuinely possess…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Byung-Kwan Lee , Beomchan Park , Chae Won Kim , Yong Man Ro

High-resolution (HR) image perception presents a key bottleneck for multimodal large language models (MLLMs). While visual search offers a promising solution, existing methods struggle with the trade-off between coverage and efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Liupeng Li , Haoqian Kang , Zhenyu Lu , Jinpeng Wang , Bin Chen , Ke Chen , Yaowei Wang

Most Camouflaged Object Detection (COD) methods heavily rely on mask annotations, which are time-consuming and labor-intensive to acquire. Existing weakly-supervised COD approaches exhibit significantly inferior performance compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Huafeng Chen , Pengxu Wei , Guangqian Guo , Shan Gao

Recently, with the emergence of recent Multimodal Large Language Model (MLLM) technology, it has become possible to exploit its video understanding capability on different classification tasks. In practice, we face the difficulty of huge…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Xin Dong , Sen Jia , Ming Rui Wang , Yan Li , Zhenheng Yang , Bingfeng Deng , Hongyu Xiong

Detecting anomalies within point clouds is crucial for various industrial applications, but traditional unsupervised methods face challenges due to data acquisition costs, early-stage production constraints, and limited generalization…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Yuqi Cheng , Yunkang Cao , Guoyang Xie , Zhichao Lu , Weiming Shen

Video Multimodal Large Language Models~(Video-MLLM) have achieved remarkable advancements in video understanding tasks. However, constrained by the context length limitation in the underlying LLMs, existing Video-MLLMs typically exhibit…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Kuo Wang , Quanlong Zheng , Junlin Xie , Yanhao Zhang , Jinguo Luo , Haonan Lu , Liang Lin , Fan Zhou , Guanbin Li

We present a novel problem setting in zero-shot learning, zero-shot object recognition and detection in the context. Contrary to the traditional zero-shot learning methods, which simply infers unseen categories by transferring knowledge…

Computer Vision and Pattern Recognition · Computer Science 2019-04-25 Ruotian Luo , Ning Zhang , Bohyung Han , Linjie Yang