English
Related papers

Related papers: Divert More Attention to Vision-Language Tracking

200 papers

Vision-based target tracking is crucial for unmanned surface vehicles (USVs) to perform tasks such as inspection, monitoring, and surveillance. However, real-time tracking in complex maritime environments is challenging due to dynamic…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Muhayy Ud Din , Ahsan B. Bakht , Waseem Akram , Yihao Dong , Lakmal Seneviratne , Irfan Hussain

The "Roaring 20s" of visual recognition began with the introduction of Vision Transformers (ViTs), which quickly superseded ConvNets as the state-of-the-art image classification model. A vanilla ViT, on the other hand, faces difficulties…

Computer Vision and Pattern Recognition · Computer Science 2022-03-03 Zhuang Liu , Hanzi Mao , Chao-Yuan Wu , Christoph Feichtenhofer , Trevor Darrell , Saining Xie

Visual Object tracking research has undergone significant improvement in the past few years. The emergence of tracking by detection approach in tracking paradigm has been quite successful in many ways. Recently, deep convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2017-11-23 Litu Rout , Sidhartha , Gorthi R. K. S. S. Manyam , Deepak Mishra

Single object tracking (SOT) heavily relies on the representation of the target object as a bounding box. However, due to the potential deformation and rotation experienced by the tracked targets, the genuine bounding box fails to capture…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Guotian Zeng , Bi Zeng , Hong Zhang , Jianqi Liu , Qingmao Wei

The hybrid architecture of convolutional neural networks (CNNs) and Transformer are very popular for medical image segmentation. However, it suffers from two challenges. First, although a CNNs branch can capture the local image features…

Image and Video Processing · Electrical Eng. & Systems 2023-12-21 Tao Lei , Rui Sun , Xuan Wang , Yingbo Wang , Xi He , Asoke Nandi

Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yahui Liu , Enver Sangineto , Wei Bi , Nicu Sebe , Bruno Lepri , Marco De Nadai

Multi-object tracking (MOT) is an important and practical task related to both surveillance systems and moving camera applications, such as autonomous driving and robotic vision. However, due to unreliable detection, occlusion and fast…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Gaoang Wang , Yizhou Wang , Haotian Zhang , Renshu Gu , Jenq-Neng Hwang

Camouflaged object detection (COD) and salient object detection (SOD) are two distinct yet closely-related computer vision tasks widely studied during the past decades. Though sharing the same purpose of segmenting an image into binary…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Chao Hao , Zitong Yu , Xin Liu , Jun Xu , Huanjing Yue , Jingyu Yang

We present in this paper a new architecture, named Convolutional vision Transformer (CvT), that improves Vision Transformer (ViT) in performance and efficiency by introducing convolutions into ViT to yield the best of both designs. This is…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Haiping Wu , Bin Xiao , Noel Codella , Mengchen Liu , Xiyang Dai , Lu Yuan , Lei Zhang

For medical image semantic segmentation (MISS), Vision Transformers have emerged as strong alternatives to convolutional neural networks thanks to their inherent ability to capture long-range correlations. However, existing research uses…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Qianying Liu , Chaitanya Kaul , Jun Wang , Christos Anagnostopoulos , Roderick Murray-Smith , Fani Deligianni

This paper investigates the effectiveness of self-supervised pre-trained vision transformers (ViTs) compared to supervised pre-trained ViTs and conventional neural networks (ConvNets) for detecting facial deepfake images and videos. It…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

For specialized and dense downstream tasks such as object detection, labeling data requires expertise and can be very expensive, making few-shot and semi-supervised models much more attractive alternatives. While in the few-shot setup we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-01 Quentin Bouniot , Angélique Loesch , Romaric Audigier , Amaury Habrard

The ability to detect and track objects in the visual world is a crucial skill for any intelligent agent, as it is a necessary precursor to any object-level reasoning process. Moreover, it is important that agents learn to track objects…

Machine Learning · Computer Science 2019-11-21 Eric Crawford , Joelle Pineau

Previous video salient object detection (VSOD) approaches have mainly focused on designing fancy networks to achieve their performance improvements. However, with the slow-down in development of deep learning techniques recently, it may…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Chenglizhao Chen , Jia Song , Chong Peng , Guodong Wang , Yuming Fang

Vision-Language-Action (VLA) models have demonstrated strong performance across a wide range of robotic manipulation tasks. Despite the success, extending large pretrained Vision-Language Models (VLMs) to the action space can induce…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Yiye Chen , Yanan Jian , Xiaoyi Dong , Shuxin Cao , Jing Wu , Patricio Vela , Benjamin E. Lundell , Dongdong Chen

We present the Object Language Video Transformer (OLViT) - a novel model for video dialog operating over a multi-modal attention-based dialog state tracker. Existing video dialog models struggle with questions requiring both spatial and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-21 Adnen Abdessaied , Manuel von Hochmeister , Andreas Bulling

Visual relationship detection aims to reason over relationships among salient objects in images, which has drawn increasing attention over the past few years. Inspired by human reasoning mechanisms, it is believed that external visual…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Meng-Jiun Chiou , Roger Zimmermann , Jiashi Feng

Convolutional neural networks (CNN) based tracking approaches have shown favorable performance in recent benchmarks. Nonetheless, the chosen CNN features are always pre-trained in different tasks and individual components in tracking…

Robotics · Computer Science 2019-08-27 Zheng Zhu , Wei Zou , Guan Huang , Dalong Du , Chang Huang

Unmanned aerial vehicle (UAV) tracking is critical for applications like surveillance, search-and-rescue, and autonomous navigation. However, the high-speed movement of UAVs and targets introduces unique challenges, including real-time…

Computer Vision and Pattern Recognition · Computer Science 2025-08-22 You Wu , Xucheng Wang , Dan Zeng , Hengzhou Ye , Xiaolan Xie , Qijun Zhao , Shuiwang Li

In video object tracking, there exist rich temporal contexts among successive frames, which have been largely overlooked in existing trackers. In this work, we bridge the individual video frames and explore the temporal contexts across them…

Computer Vision and Pattern Recognition · Computer Science 2021-03-25 Ning Wang , Wengang Zhou , Jie Wang , Houqaing Li