English
Related papers

Related papers: When Language Model Guides Vision: Grounding DINO …

200 papers

Multimodal large language models (MLLMs) can enrich industrial anomaly detection with semantic descriptions and anomaly reasoning, but they still lag specialist anomaly detectors in binary detection accuracy. Existing approaches address…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Xiaomeng Peng , Xilang Huang , Seon Han Choi

Vision-language models (VLMs) like CLIP have demonstrated impressive zero-shot ability in image classification tasks by aligning text and images but suffer inferior performance compared with task-specific expert models. On the contrary,…

Artificial Intelligence · Computer Science 2025-02-04 Jia Zhang , Zhi Zhou , Lan-Zhe Guo , Yu-Feng Li

Robust behaviour recognition in real-world farm environments remains challenging due to several data-related limitations, including the scarcity of well-annotated livestock video datasets and the substantial domain gap between large-scale…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Huimin Liu , Jing Gao , Daria Baran , AxelX Montout , Neill W Campbell , Andrew W Dowsey

The detection and classification of bacterial colonies in images of agar-plates is important in microbiology, but is hindered by the lack of labeled datasets. Therefore, we propose Colony Grounded SAM2, a zero-shot inference pipeline to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Daan Korporaal , Patrick de Kruijf , Ralph H. G. M. Litjens , Bas H. M. van der Velden

Large Vision-Language Models (VLMs) enable strong multimodal reasoning but incur heavy inference costs from redundant visual tokens. Token pruning alleviates this issue, yet existing approaches face limitations. Attention-based methods rely…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Youngeun Kim , Youjia Zhang , Huiling Liu , Aecheon Jung , Sunwoo Lee , Sungeun Hong

Effective cross-modal retrieval is essential for applications like information retrieval and recommendation systems, particularly in specialized domains such as manufacturing, where product information often consists of visual samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Francesco Giuliari , Asif Khan Pattan , Mohamed Lamine Mekhalfi , Fabio Poiesi

Large foundation models trained on large-scale vision-language data can boost Open-Vocabulary Object Detection (OVD) via synthetic training data, yet the hand-crafted pipelines often introduce bias and overfit to specific prompts. We…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yang Zhou , Shiyu Zhao , Yuxiao Chen , Zhenting Wang , Can Jin , Dimitris N. Metaxas

In livestock farming, animal health directly influences productivity. For dairy cows, many health conditions can be evaluated by trained observers based on visual appearance and movement. However, to manually evaluate every cow in a…

Image and Video Processing · Electrical Eng. & Systems 2021-03-01 He Liu , Amy R. Reibman , Jacquelyn P. Boerman

Automated wildlife surveys based on drone imagery and object detection technology are a powerful and increasingly popular tool in conservation biology. Most detectors require training images with annotated bounding boxes, which are tedious,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Giacomo May , Emanuele Dalsasso , Benjamin Kellenberger , Devis Tuia

We present DINO-Tracker -- a new framework for long-term dense tracking in video. The pillar of our approach is combining test-time training on a single video, with the powerful localized semantic features learned by a pre-trained DINO-ViT…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Narek Tumanyan , Assaf Singer , Shai Bagon , Tali Dekel

Although visual foundation models like DINOv2 provide state-of-the-art performance as feature extractors, their complex, high-dimensional representations create substantial hurdles for interpretability. This work proposes DINO-QPM, which…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Robert Zimmermann , Thomas Norrenbrock , Bodo Rosenhahn

In the Detection and Multi-Object Tracking of Sweet Peppers Challenge, we present Track Any Peppers (TAP) - a weakly supervised ensemble technique for sweet peppers tracking. TAP leverages the zero-shot detection capabilities of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Jia Syuen Lim , Yadan Luo , Zhi Chen , Tianqi Wei , Scott Chapman , Zi Huang

Foundation object detectors such as GLIP and Grounding DINO excel on general-domain data but often degrade in specialized and data-scarce settings like underwater imagery or industrial defects. Typical cross-domain few-shot approaches rely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Xu Zhang , Zhe Chen , Jing Zhang , Dacheng Tao

Monitoring leftover products provides valuable insights that can be used to optimize future production. This is especially important for German bakeries because freshly baked goods have a very short shelf life. Automating this process can…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Thomas H. Schmitt , Maximilian Bundscherer , Tobias Bocklet

Zero-shot learning (ZSL) aims to transfer knowledge from seen classes to semantically related unseen classes, which are absent during training. The promising strategies for ZSL are to synthesize visual features of unseen classes conditioned…

Artificial Intelligence · Computer Science 2021-12-30 Yun Li , Zhe Liu , Lina Yao , Xiaojun Chang

Cognitively inspired Natural Language Pro-cessing uses human-derived behavioral datalike eye-tracking data, which reflect the seman-tic representations of language in the humanbrain to augment the neural nets to solve arange of tasks…

Computation and Language · Computer Science 2021-10-12 Varun Madhavan , Aditya Girish Pawate , Shraman Pal , Abhranil Chandra

Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which primarily involves collaborative 3D detection and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xunjie He , Christina Dao Wen Lee , Meiling Wang , Chengran Yuan , Zefan Huang , Yufeng Yue , Marcelo H. Ang

3D object detection is fundamental for spatial understanding. Real-world environments demand models capable of recognizing diverse, previously unseen objects, which remains a major limitation of closed-set methods. Existing open-vocabulary…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Andrey Lemeshko , Bulat Gabdullin , Nikita Drozdov , Anton Konushin , Danila Rukhovich , Maksim Kolodiazhnyi

When it comes to deploying deep vision models, the behavior of these systems must be explicable to ensure confidence in their reliability and fairness. A common approach to evaluate deep learning models is to build a labeled test set with…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jinqi Luo , Zhaoning Wang , Chen Henry Wu , Dong Huang , Fernando De la Torre

Most of the existing algorithms for zero-shot classification problems typically rely on the attribute-based semantic relations among categories to realize the classification of novel categories without observing any of their instances.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Yu-Hsuan Li , Tzu-Yin Chao , Ching-Chun Huang , Pin-Yu Chen , Wei-Chen Chiu