English
Related papers

Related papers: Turning to a Teacher for Timestamp Supervised Temp…

200 papers

In recent years, there has been remarkable progress in supervised image segmentation. Video segmentation is less explored, despite the temporal dimension being highly informative. Semantic labels, e.g. that cannot be accurately detected in…

Computer Vision and Pattern Recognition · Computer Science 2019-08-30 Radu Sibechi , Olaf Booij , Nora Baka , Peter Bloem

The teacher-student framework, prevalent in semi-supervised semantic segmentation, mainly employs the exponential moving average (EMA) to update a single teacher's weights based on the student's. However, EMA updates raise a problem in that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Jaemin Na , Jung-Woo Ha , Hyung Jin Chang , Dongyoon Han , Wonjun Hwang

In this paper, we introduce a novel knowledge distillation approach for the semantic segmentation task. Unlike previous methods that rely on power-trained teachers or other modalities to provide additional knowledge, our approach does not…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Shoumeng Qiu , Jie Chen , Xinrun Li , Ru Wan , Xiangyang Xue , Jian Pu

Purpose: Segmentation of surgical instruments in endoscopic videos is essential for automated surgical scene understanding and process modeling. However, relying on fully supervised deep learning for this task is challenging because manual…

Computer Vision and Pattern Recognition · Computer Science 2021-03-03 Manish Sahu , Anirban Mukhopadhyay , Stefan Zachow

Recent temporal action segmentation approaches need frame annotations during training to be effective. These annotations are very expensive and time-consuming to obtain. This limits their performances when only limited annotated data is…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Sovan Biswas , Anthony Rhodes , Ramesh Manuvinakurike , Giuseppe Raffa , Richard Beckwith

Self-supervised learning presents a remarkable performance to utilize unlabeled data for various video tasks. In this paper, we focus on applying the power of self-supervised methods to improve semi-supervised action proposal generation.…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Xiang Wang , Shiwei Zhang , Zhiwu Qing , Yuanjie Shao , Changxin Gao , Nong Sang

Semi-supervised learning has emerged as a widely adopted technique in the field of medical image segmentation. The existing works either focuses on the construction of consistency constraints or the generation of pseudo labels to provide…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Ning Gao , Sanping Zhou , Le Wang , Nanning Zheng

Active learning generally involves querying the most representative samples for human labeling, which has been widely studied in many fields such as image classification and object detection. However, its potential has not been explored in…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Jun Wang , Shaoguo Wen , Kaixing Chen , Jianghua Yu , Xin Zhou , Peng Gao , Changsheng Li , Guotong Xie

Temporal Action Localization (TAL) aims to predict both action category and temporal boundary of action instances in untrimmed videos, i.e., start and end time. Fully-supervised solutions are usually adopted in most existing works, and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Ding Li , Xuebing Yang , Yongqiang Tang , Chenyang Zhang , Wensheng Zhang

We introduce a novel approach for temporal activity segmentation with timestamp supervision. Our main contribution is a graph convolutional network, which is learned in an end-to-end manner to exploit both frame features and connections…

Computer Vision and Pattern Recognition · Computer Science 2022-08-03 Hamza Khan , Sanjay Haresh , Awais Ahmed , Shakeeb Siddiqui , Andrey Konin , M. Zeeshan Zia , Quoc-Huy Tran

Temporal action segmentation is a task to classify each frame in the video with an action label. However, it is quite expensive to annotate every frame in a large corpus of videos to construct a comprehensive supervised training dataset.…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhe Wang , Hao Chen , Xinyu Li , Chunhui Liu , Yuanjun Xiong , Joseph Tighe , Charless Fowlkes

Temporal action segmentation (TAS) divides untrimmed videos into labeled action segments. While fully supervised methods have advanced the field, challenges such as action variability, ambiguous boundaries, and high annotation costs remain,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yeo Keat Ee , Debaditya Roy , Chen Li , Hao Zhang , Basura Fernando

Audio-Visual Video Parsing is a task to predict the events that occur in video segments for each modality. It often performs in a weakly supervised manner, where only video event labels are provided, i.e., the modalities and the timestamps…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Jinxing Zhou , Dan Guo , Yiran Zhong , Meng Wang

Purpose: Automating tasks such as lung tumor localization and segmentation in radiological images can free valuable time for radiologists and other clinical personnel. Convolutional neural networks may be suited for such tasks, but require…

Image and Video Processing · Electrical Eng. & Systems 2021-12-23 Vemund Fredriksen , Svein Ole M. Svele , André Pedersen , Thomas Langø , Gabriel Kiss , Frank Lindseth

Spatio-temporal action detection in videos is typically addressed in a fully-supervised setup with manual annotation of training videos required at every frame. Since such annotation is extremely tedious and prohibits scalability, there is…

Computer Vision and Pattern Recognition · Computer Science 2018-11-29 Guilhem Chéron , Jean-Baptiste Alayrac , Ivan Laptev , Cordelia Schmid

In this paper, we consider a new low-quality label learning problem: learning time series detection models from temporally imprecise labels. In this problem, the data consist of a set of input time series, and supervision is provided by a…

Machine Learning · Statistics 2017-04-14 Roy J. Adams , Benjamin M. Marlin

Recognizing human actions from untrimmed videos is an important task in activity understanding, and poses unique challenges in modeling long-range temporal relations. Recent works adopt a predict-and-refine strategy which converts an…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Zhichao Liu , Leshan Wang , Desen Zhou , Jian Wang , Songyang Zhang , Yang Bai , Errui Ding , Rui Fan

Recently proposed techniques for semi-supervised learning such as Temporal Ensembling and Mean Teacher have achieved state-of-the-art results in many important classification benchmarks. In this work, we expand the Mean Teacher approach to…

Computer Vision and Pattern Recognition · Computer Science 2018-10-02 Christian S. Perone , Julien Cohen-Adad

We tackle the problem of localizing temporal intervals of actions with only a single frame label for each action instance for training. Owing to label sparsity, existing work fails to learn action completeness, resulting in fragmentary…

Computer Vision and Pattern Recognition · Computer Science 2021-08-12 Pilhyeon Lee , Hyeran Byun

Temporal segmentation of long videos is an important problem, that has largely been tackled through supervised learning, often requiring large amounts of annotated training data. In this paper, we tackle the problem of self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Sathyanarayanan N. Aakur , Sudeep Sarkar