English
Related papers

Related papers: Zero-Shot Action Recognition in Surveillance Video…

200 papers

In this paper, we introduce ResNetVLLM (ResNet Vision LLM), a novel cross-modal framework for zero-shot video understanding that integrates a ResNet-based visual encoder with a Large Language Model (LLM. ResNetVLLM addresses the challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Ahmad Khalil , Mahmoud Khalil , Alioune Ngom

Zero-Shot Action Recognition has attracted attention in the last years and many approaches have been proposed for recognition of objects, events and actions in images and videos. There is a demand for methods that can classify instances…

Computer Vision and Pattern Recognition · Computer Science 2021-12-17 Valter Estevam , Helio Pedrini , David Menotti

Recent advancements in Vision-Language Models (VLMs) have demonstrated strong capabilities in general visual reasoning, yet their applicability to rigorous biometric tasks remains unexplored. This work presents an exploratory study…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Marta Robledo-Moreno , Ruben Vera-Rodriguez , Ruben Tolosana , Javier Ortega-Garcia

While deep learning, including Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs), has significantly advanced classification performance, its typical reliance on extensive annotated datasets presents a major obstacle in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Matheus Vinícius Todescato , Joel Luís Carbonera

In the video-language domain, recent works in leveraging zero-shot Large Language Model-based reasoning for video understanding have become competitive challengers to previous end-to-end models. However, long video understanding presents…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Ruotong Liao , Max Erler , Huiyu Wang , Guangyao Zhai , Gengyuan Zhang , Yunpu Ma , Volker Tresp

The explosive growth of video data intensified the need for flexible user-controllable summarization tools that operate without training data. Existing methods either rely on domain-specific datasets, limiting generalization, or cannot…

Computer Vision and Pattern Recognition · Computer Science 2026-02-18 Mario Barbara , Alaa Maalouf

Large vision-language models (VLMs) have advanced multimodal tasks such as video question answering (QA). However, VLMs face the challenge of selecting frames effectively and efficiently, as standard uniform sampling is expensive and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Martin Q. Ma , Willis Guo , Aditya Agrawal , Ankit Gupta , Paul Pu Liang , Ruslan Salakhutdinov , Louis-Philippe Morency

Contextual cues related to a person's pose and interactions with objects and other people in the scene can provide valuable information for gaze following. While existing methods have focused on dedicated cue extraction methods, in this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Anshul Gupta , Pierre Vuillecard , Arya Farkhondeh , Jean-Marc Odobez

Pre-trained vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot performance on a wide range of downstream computer vision tasks. However, there still exists a considerable performance gap between these models and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Bardia Safaei , Vishal M. Patel

Multimodal Large Language Models (MLLMs) have recently achieved promising zero-shot accuracy on visual question answering (VQA) -- a fundamental task affecting various downstream applications and domains. Given the great potential for the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Jiarui Zhang , Mahyar Khayatkhoei , Prateek Chhikara , Filip Ilievski

Video action localization aims to find the timings of specific actions from a long video. Although existing learning-based approaches have been successful, they require annotating videos, which comes with a considerable labor cost. This…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Naoki Wake , Atsushi Kanehira , Kazuhiro Sasabuchi , Jun Takamatsu , Katsushi Ikeuchi

Effectively understanding urban scenes requires fine-grained spatial reasoning about objects, layouts, and depth cues. However, how well current vision-language models (VLMs), pretrained on general scenes, transfer these abilities to urban…

Computer Vision and Pattern Recognition · Computer Science 2025-09-01 Juneyoung Ro , Namwoo Kim , Yoonjin Yoon

Multimodal large language models (MLLMs) have demonstrated impressive general competence in video understanding, yet their reliability for real-world Video Anomaly Detection (VAD) remains largely unexplored. Unlike conventional pipelines…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Shanle Yao , Armin Danesh Pazho , Narges Rashvand , Hamed Tabkhi

Pre-trained multi-modal vision-language models (VLMs) are becoming increasingly popular due to their exceptional performance on downstream vision applications, particularly in the few- and zero-shot settings. However, selecting the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Orr Zohar , Shih-Cheng Huang , Kuan-Chieh Wang , Serena Yeung

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Human age estimation from facial images represents a challenging computer vision task with significant applications in biometrics, healthcare, and human-computer interaction. While traditional deep learning approaches require extensive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Rakib Hossain Sajib , Md Kishor Morol , Rajan Das Gupta , Mohammad Sakib Mahmood , Shuvra Smaran Das

Long video question answering is a challenging task that involves recognizing short-term activities and reasoning about their fine-grained relationships. State-of-the-art video Large Language Models (vLLMs) hold promise as a viable solution…

Computer Vision and Pattern Recognition · Computer Science 2024-05-07 Reuben Tan , Ximeng Sun , Ping Hu , Jui-hsien Wang , Hanieh Deilamsalehy , Bryan A. Plummer , Bryan Russell , Kate Saenko

This paper proposes a Short-Window Sliding Learning framework for real-time violence detection in CCTV footages. Unlike conventional long-video training approaches, the proposed method divides videos into 1-2 second clips and applies Large…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Seoik Jung , Taekyung Song , Yangro Lee , Sungjun Lee

Effective cross-modal retrieval is essential for applications like information retrieval and recommendation systems, particularly in specialized domains such as manufacturing, where product information often consists of visual samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Francesco Giuliari , Asif Khan Pattan , Mohamed Lamine Mekhalfi , Fabio Poiesi

Large Vision Language Models (LVLMs) have shown strong capabilities in understanding and analyzing visual scenes across various domains. However, in the context of autonomous driving, their limited comprehension of 3D environments restricts…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Jannik Lübberstedt , Esteban Rivera , Nico Uhlemann , Markus Lienkamp