English
Related papers

Related papers: Scaling up sign spotting through sign language dic…

200 papers

Weakly supervised person search aims to jointly detect and match persons with only bounding box annotations. Existing approaches typically focus on improving the features by exploring relations of persons. However, scale variation problem…

Computer Vision and Pattern Recognition · Computer Science 2024-01-04 Benzhi Wang , Yang Yang , Jinlin Wu , Guo-jun Qi , Zhen Lei

Beyond the text detection and recognition tasks in image text spotting, video text spotting presents an augmented challenge with the inclusion of tracking. While advanced end-to-end trainable methods have shown commendable performance, the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Haibin He , Maoyuan Ye , Jing Zhang , Juhua Liu , Bo Du , Dacheng Tao

We study the problem of recognizing video sequences of fingerspelled letters in American Sign Language (ASL). Fingerspelling comprises a significant but relatively understudied part of ASL. Recognizing fingerspelling is challenging for a…

Computation and Language · Computer Science 2016-09-27 Taehwan Kim , Jonathan Keane , Weiran Wang , Hao Tang , Jason Riggle , Gregory Shakhnarovich , Diane Brentari , Karen Livescu

Today's sign language recognition models require large training corpora of laboratory-like videos, whose collection involves an extensive workforce and financial resources. As a result, only a handful of such systems are publicly available,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-11 Matyáš Boháček , Marek Hrúz

Self-supervised methods have shown remarkable progress in learning high-level semantics and low-level temporal correspondence. Building on these results, we take one step further and explore the possibility of integrating these two features…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Rui Qian , Shuangrui Ding , Xian Liu , Dahua Lin

Robust detection of moving vehicles is a critical task for any autonomously operating outdoor robot or self-driving vehicle. Most modern approaches for solving this task rely on training image-based detectors using large-scale vehicle…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Jannik Zürn , Wolfram Burgard

Supervised visual captioning models typically require a large scale of images or videos paired with descriptions in a specific language (i.e., the vision-caption pairs) for training. However, collecting and labeling large-scale datasets is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Bang Yang , Fenglin Liu , Xian Wu , Yaowei Wang , Xu Sun , Yuexian Zou

Text detection is frequently used in vision-based mobile robots when they need to interpret texts in their surroundings to perform a given task. For instance, delivery robots in multilingual cities need to be capable of doing multilingual…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hsin-Ju Lin , Tsu-Chun Chung , Ching-Chun Hsiao , Pin-Yu Chen , Wei-Chen Chiu , Ching-Chun Huang

Visual object localization is the key step in a series of object detection tasks. In the literature, high localization accuracy is achieved with the mainstream strongly supervised frameworks. However, such methods require object-level…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Yi-Geng Hong , Hui-Chu Xiao , Wan-Lei Zhao

Multimodal supervision has achieved promising results in many visual language understanding tasks, where the language plays an essential role as a hint or context for recognizing and locating instances. However, due to the defects of the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Weixin Feng , Xingyuan Bu , Chenchen Zhang , Xubin Li

The eye-tracking video saliency prediction (VSP) task and video salient object detection (VSOD) task both focus on the most attractive objects in video and show the result in the form of predictive heatmaps and pixel-level saliency masks,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Qi Qin , Runmin Cong , Gen Zhan , Yiting Liao , Sam Kwong

The unsupervised pretraining of object detectors has recently become a key component of object detector training, as it leads to improved performance and faster convergence during the supervised fine-tuning stage. Existing unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Ioannis Maniadis Metaxas , Adrian Bulat , Ioannis Patras , Brais Martinez , Georgios Tzimiropoulos

In this paper, we present our solution to the Cross-View Isolated Sign Language Recognition (CV-ISLR) challenge held at WWW 2025. CV-ISLR addresses a critical issue in traditional Isolated Sign Language Recognition (ISLR), where existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Fei Wang , Kun Li , Yiqi Nie , Zhangling Duan , Peng Zou , Zhiliang Wu , Yuwei Wang , Yanyan Wei

This paper studies the problem of learning semantic segmentation from image-level supervision only. Current popular solutions leverage object localization maps from classifiers as supervision signals, and struggle to make the localization…

Computer Vision and Pattern Recognition · Computer Science 2020-07-09 Guolei Sun , Wenguan Wang , Jifeng Dai , Luc Van Gool

Many computer vision tasks address the problem of scene understanding and are naturally interrelated e.g. object classification, detection, scene segmentation, depth estimation, etc. We show that we can leverage the inherent relationships…

Computer Vision and Pattern Recognition · Computer Science 2021-03-18 Yao Lu , Sören Pirk , Jan Dlabal , Anthony Brohan , Ankita Pasad , Zhao Chen , Vincent Casser , Anelia Angelova , Ariel Gordon

Despite the remarkable accuracy of deep neural networks in object detection, they are costly to train and scale due to supervision requirements. Particularly, learning more object categories typically requires proportionally more bounding…

Computer Vision and Pattern Recognition · Computer Science 2021-03-16 Alireza Zareian , Kevin Dela Rosa , Derek Hao Hu , Shih-Fu Chang

Most existing scene text detectors require large-scale training data which cannot scale well due to two major factors: 1) scene text images often have domain-specific distributions; 2) collecting large-scale annotated scene text images is…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Zichen Tian , Chuhui Xue , Jingyi Zhang , Shijian Lu

We introduce a unified framework to jointly model images, text, and human attention traces. Our work is built on top of the recent Localized Narratives annotation framework [30], where each word of a given caption is paired with a mouse…

Computer Vision and Pattern Recognition · Computer Science 2021-05-14 Zihang Meng , Licheng Yu , Ning Zhang , Tamara Berg , Babak Damavandi , Vikas Singh , Amy Bearman

Solving text classification in a weakly supervised manner is important for real-world applications where human annotations are scarce. In this paper, we propose to query a masked language model with cloze style prompts to obtain supervision…

Computation and Language · Computer Science 2022-05-16 Ziqian Zeng , Weimin Ni , Tianqing Fang , Xiang Li , Xinran Zhao , Yangqiu Song

This paper proposes a novel paradigm for the unsupervised learning of object landmark detectors. Contrary to existing methods that build on auxiliary tasks such as image generation or equivariance, we propose a self-training approach where,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Dimitrios Mallis , Enrique Sanchez , Matt Bell , Georgios Tzimiropoulos