English
Related papers

Related papers: Turning to a Teacher for Timestamp Supervised Temp…

200 papers

We apply a generative segmental model of task structure, guided by narration, to action segmentation in video. We focus on unsupervised and weakly-supervised settings where no action labels are known during training. Despite its simplicity,…

Computation and Language · Computer Science 2020-08-13 Daniel Fried , Jean-Baptiste Alayrac , Phil Blunsom , Chris Dyer , Stephen Clark , Aida Nematzadeh

Automatic pseudo-labeling is a powerful tool to tap into large amounts of sequential unlabeled data. It is specially appealing in safety-critical applications of autonomous driving, where performance requirements are extreme, datasets are…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Awet Haileslassie Gebrehiwot , Patrik Vacek , David Hurych , Karel Zimmermann , Patrick Perez , Tomáš Svoboda

Unsupervised word segmentation in audio utterances is challenging as, in speech, there is typically no gap between words. In a preliminary experiment, we show that recent deep self-supervised features are very effective for word…

Audio and Speech Processing · Electrical Eng. & Systems 2023-04-04 Tzeviya Sylvia Fuchs , Yedid Hoshen

In this work, we focus on semi-supervised learning for video action detection which utilizes both labeled as well as unlabeled data. We propose a simple end-to-end consistency based approach which effectively utilizes the unlabeled data.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-04 Akash Kumar , Yogesh Singh Rawat

Deep convolutional neural networks have shown outstanding performance in medical image segmentation tasks. The usual problem when training supervised deep learning methods is the lack of labeled data which is time-consuming and costly to…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Suman Sedai , Bhavna Antony , Ravneet Rai , Katie Jones , Hiroshi Ishikawa , Joel Schuman , Wollstein Gadi , Rahil Garnavi

Using offline training schemes, researchers have tackled the event segmentation problem by providing full or weak-supervision through manually annotated labels or self-supervised epoch-based training. Most works consider videos that are at…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ramy Mounir , Roman Gula , Jörn Theuerkauf , Sudeep Sarkar

Weakly-supervised action segmentation is a task of learning to partition a long video into several action segments, where training videos are only accompanied by transcripts (ordered list of actions). Most of existing methods need to infer…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Angchi Xu , Wei-Shi Zheng

Training temporal action detection in videos requires large amounts of labeled data, yet such annotation is expensive to collect. Incorporating unlabeled or weakly-labeled data to train action detection model could help reduce annotation…

Computer Vision and Pattern Recognition · Computer Science 2021-02-19 Baifeng Shi , Qi Dai , Judy Hoffman , Kate Saenko , Trevor Darrell , Huijuan Xu

Recognising actions in videos relies on labelled supervision during training, typically the start and end times of each action instance. This supervision is not only subjective, but also expensive to acquire. Weak video-level supervision…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Davide Moltisanti , Sanja Fidler , Dima Damen

Recently, segmentation neural networks have been significantly improved by demonstrating very promising accuracies on public benchmarks. However, these models are very heavy and generally suffer from low inference speed, which limits their…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Jiafeng Xie , Bing Shuai , Jian-Fang Hu , Jingyang Lin , Wei-Shi Zheng

In medical image analysis, semi-supervised learning is an effective method to extract knowledge from a small amount of labeled data and a large amount of unlabeled data. This paper focuses on a popular pipeline known as self learning, and…

Computer Vision and Pattern Recognition · Computer Science 2020-08-10 Xinyue Huo , Lingxi Xie , Jianzhong He , Zijie Yang , Qi Tian

Semi-supervised learning has attracted much attention due to its less dependence on acquiring abundant annotations from experts compared to fully supervised methods, which is especially important for medical image segmentation which…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Yichi Zhang , Jin Yang , Yuchen Liu , Yuan Cheng , Yuan Qi

Existing datasets for manually labelled query-based video summarization are costly and thus small, limiting the performance of supervised deep video summarization models. Self-supervision can address the data sparsity challenge by using a…

Computer Vision and Pattern Recognition · Computer Science 2023-07-06 Jia-Hong Huang , Luka Murn , Marta Mrak , Marcel Worring

Temporal action segmentation in untrimmed procedural videos aims to densely label frames into action classes. These videos inherently exhibit long-tailed distributions, where actions vary widely in frequency and duration. In temporal action…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Zhanzhong Pang , Fadime Sener , Shrinivas Ramasubramanian , Angela Yao

Semantic segmentation is a crucial task in medical imaging. Although supervised learning techniques have proven to be effective in performing this task, they heavily depend on large amounts of annotated training data. The recently…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Ron Keuth , Lasse Hansen , Maren Balks , Ronja Jäger , Anne-Nele Schröder , Ludger Tüshaus , Mattias Heinrich

Semi-supervised object detection has made significant progress with the development of mean teacher driven self-training. Despite the promising results, the label mismatch problem is not yet fully explored in the previous works, leading to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Binbin Chen , Weijie Chen , Shicai Yang , Yunyi Xuan , Jie Song , Di Xie , Shiliang Pu , Mingli Song , Yueting Zhuang

This paper introduces a unified framework for video action segmentation via sequence to sequence (seq2seq) translation in a fully and timestamp supervised setup. In contrast to current state-of-the-art frame-level prediction methods, we…

Computer Vision and Pattern Recognition · Computer Science 2022-10-12 Nadine Behrmann , S. Alireza Golestaneh , Zico Kolter , Juergen Gall , Mehdi Noroozi

Semantic segmentation is a fundamental task in medical image analysis and autonomous driving and has a problem with the high cost of annotating the labels required in training. To address this problem, semantic segmentation methods based on…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Nagito Saito , Shintaro Ito , Koichi Ito , Takafumi Aoki

In the context of label-efficient learning on video data, the distillation method and the structural design of the teacher-student architecture have a significant impact on knowledge distillation. However, the relationship between these…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Chao Wang , Zheng Tang

Anomaly action detection and localization play an essential role in security and advanced surveillance systems. However, due to the tremendous amount of surveillance videos, most of the available data for the task is unlabeled or…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Nada Osman , Marwan Torki