English
Related papers

Related papers: CoLA: Weakly-Supervised Temporal Action Localizati…

200 papers

The goal of weakly-supervised video moment retrieval is to localize the video segment most relevant to the given natural language query without access to temporal annotations during training. Prior strongly- and weakly-supervised approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Reuben Tan , Huijuan Xu , Kate Saenko , Bryan A. Plummer

Weakly supervised object detection aims at reducing the amount of supervision required to train detection models. Such models are traditionally learned from images/videos labelled only with the object class and not the object bounding box.…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Zhenheng Yang , Dhruv Mahajan , Deepti Ghadiyaram , Ram Nevatia , Vignesh Ramanathan

Weakly supervised temporal action localization aims at learning the instance-level action pattern from the video-level labels, where a significant challenge is action-context confusion. To overcome this challenge, one recent work builds an…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Le Yang , Junwei Han , Tao Zhao , Tianwei Lin , Dingwen Zhang , Jianxin Chen

Weakly Supervised Object Localization (WSOL) methodsusually rely on fully convolutional networks in order to ob-tain class activation maps(CAMs) of targeted labels. How-ever, these networks always highlight the most discriminativeparts to…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Ziyi Kou , Wentian Zhao , Guofeng Cui , Shaojie Wang

Weakly supervised temporal action detection is a Herculean task in understanding untrimmed videos, since no supervisory signal except the video-level category label is available on training data. Under the supervision of category labels,…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Jia-Xing Zhong , Nannan Li , Weijie Kong , Tao Zhang , Thomas H. Li , Ge Li

Semantic segmentation is a complex task that relies heavily on large amounts of annotated image data. However, annotating such data can be time-consuming and resource-intensive, especially in the medical domain. Active Learning (AL) is a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Fei Wu , Pablo Marquez-Neila , Mingyi Zheng , Hedyeh Rafii-Tari , Raphael Sznitman

In minimally invasive surgery, surgical instrument localization is a crucial task for endoscopic videos, which enables various applications for improving surgical outcomes. However, annotating the instrument localization in endoscopic…

Image and Video Processing · Electrical Eng. & Systems 2024-06-24 Rongfeng Wei , Jinlin Wu , Xuexue Bai , Ming Feng , Zhen Lei , Hongbin Liu , Zhen Chen

Weakly supervised video anomaly detection (WS-VAD) is a challenging problem that aims to learn VAD models only with video-level annotations. In this work, we propose a Long-Short Temporal Co-teaching (LSTC) method to address the WS-VAD…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Shengyang Sun , Xiaojin Gong

We introduce count-guided weakly supervised localization (C-WSL), an approach that uses per-class object count as a new form of supervision to improve weakly supervised localization (WSL). C-WSL uses a simple count-based region selection…

Computer Vision and Pattern Recognition · Computer Science 2018-07-26 Mingfei Gao , Ang Li , Ruichi Yu , Vlad I. Morariu , Larry S. Davis

Localizing actions in video is a core task in computer vision. The weakly supervised temporal localization problem investigates whether this task can be adequately solved with only video-level labels, significantly reducing the amount of…

Computer Vision and Pattern Recognition · Computer Science 2021-05-07 Junwei Ma , Satya Krishna Gorti , Maksims Volkovs , Guangwei Yu

Recently, Weakly-supervised Temporal Action Localization (WTAL) has been densely studied but there is still a large gap between weakly-supervised models and fully-supervised models. It is practical and intuitive to annotate temporal…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Xudong Lin , Zheng Shou , Shih-Fu Chang

Weakly-supervised temporal action localization aims to localize action instances in videos with only video-level action labels. Existing methods mainly embrace a localization-by-classification pipeline that optimizes the snippet-level…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Qinying Liu , Zilei Wang , Shenghai Rong , Junjie Li , Yixin Zhang

Class activation maps (CAMs) are commonly employed in weakly supervised semantic segmentation (WSSS) to produce pseudo-labels. Due to incomplete or excessive class activation, existing studies often resort to offline CAM refinement,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Xinyu Yang , Hossein Rahmani , Sue Black , Bryan M. Williams

Video Correlation Learning (VCL), which aims to analyze the relationships between videos, has been widely studied and applied in various general video tasks. However, applying VCL to instructional videos is still quite challenging due to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Tianyao He , Huabin Liu , Yuxi Li , Xiao Ma , Cheng Zhong , Yang Zhang , Weiyao Lin

We address temporal action localization in untrimmed long videos. This is important because videos in real applications are usually unconstrained and contain multiple action instances plus video content of background scenes or other…

Computer Vision and Pattern Recognition · Computer Science 2016-04-25 Zheng Shou , Dongang Wang , Shih-Fu Chang

Existing camouflage object detection (COD) methods typically rely on fully-supervised learning guided by mask annotations. However, obtaining mask annotations is time-consuming and labor-intensive. Compared to fully-supervised methods,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Jingchen Ni , Quan Zhang , Dan Jiang , Keyu Lv , Ke Zhang , Chun Yuan

Long-form video understanding requires designing approaches that are able to temporally localize activities or language. End-to-end training for such tasks is limited by the compute device memory constraints and lack of temporal annotations…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Mengmeng Xu , Erhan Gundogdu , Maksim Lapin , Bernard Ghanem , Michael Donoser , Loris Bazzani

Temporal action localization (TAL) is a fundamental yet challenging task in video understanding. Existing TAL methods rely on pre-training a video encoder through action classification supervision. This results in a task discrepancy problem…

Computer Vision and Pattern Recognition · Computer Science 2021-11-01 Mengmeng Xu , Juan-Manuel Perez-Rua , Xiatian Zhu , Bernard Ghanem , Brais Martinez

Weakly supervised object localization (WSOL) aims at predicting object locations in an image using only image-level category labels. Common challenges that image classification models encounter when localizing objects are, (a) they tend to…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Saurav Gupta , Sourav Lakhotia , Abhay Rawat , Rahul Tallamraju

Automatic estimation of pain intensity from facial expressions in videos has an immense potential in health care applications. However, domain adaptation (DA) is needed to alleviate the problem of domain shifts that typically occurs between…

Computer Vision and Pattern Recognition · Computer Science 2023-09-13 Gnana Praveen R , Eric Granger , Patrick Cardinal