English
Related papers

Related papers: WSLLN: Weakly Supervised Natural Language Localiza…

200 papers

We propose a novel model for temporal detection and localization which allows the training of deep neural networks using only counts of event occurrences as training labels. This powerful weakly-supervised framework alleviates the burden of…

Machine Learning · Computer Science 2019-05-20 Julien Schroeter , Kirill Sidorov , David Marshall

Thanks to the advantages of the friendly annotations and the satisfactory performance, Weakly-Supervised Semantic Segmentation (WSSS) approaches have been extensively studied. Recently, the single-stage WSSS was awakened to alleviate…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Chunyan Wang , Dong Zhang , Liyan Zhang , Jinhui Tang

In this paper, we address the problem of weakly supervised object localization (WSL), which trains a detection network on the dataset with only image-level annotations. The proposed approach is built on the observation that the proposal set…

Computer Vision and Pattern Recognition · Computer Science 2019-10-22 Wenju Xu , Yuanwei Wu , Wenchi Ma , Guanghui Wang

This work tackles Weakly Supervised Anomaly detection, in which a predictor is allowed to learn not only from normal examples but also from a few labeled anomalies made available during training. In particular, we deal with the localization…

Computer Vision and Pattern Recognition · Computer Science 2022-08-11 Aniello Panariello , Angelo Porrello , Simone Calderara , Rita Cucchiara

Weakly supervised object detection (WSOD) aims at learning precise object detectors with only image-level tags. In spite of intensive research on deep learning (DL) approaches over the past few years, there is still a significant…

Computer Vision and Pattern Recognition · Computer Science 2023-05-08 Qi Lai , ChiMan Vong

Recently, deep neural networks have achieved remarkable performance on the task of object detection and recognition. The reason for this success is mainly grounded in the availability of large scale, fully annotated datasets, but the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Christian Bartz , Haojin Yang , Joseph Bethge , Christoph Meinel

Using offline training schemes, researchers have tackled the event segmentation problem by providing full or weak-supervision through manually annotated labels or self-supervised epoch-based training. Most works consider videos that are at…

Computer Vision and Pattern Recognition · Computer Science 2021-07-20 Ramy Mounir , Roman Gula , Jörn Theuerkauf , Sudeep Sarkar

Weakly supervised video anomaly detection (WS-VAD) is a challenging problem that aims to learn VAD models only with video-level annotations. In this work, we propose a Long-Short Temporal Co-teaching (LSTC) method to address the WS-VAD…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Shengyang Sun , Xiaojin Gong

For weakly supervised anomaly detection, most existing work is limited to the problem of inadequate video representation due to the inability of modeling long-term contextual information. To solve this, we propose a novel weakly supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-12-28 Congqi Cao , Xin Zhang , Shizhou Zhang , Peng Wang , Yanning Zhang

Current weakly supervised video anomaly detection (WSVAD) task aims to achieve frame-level anomalous event detection with only coarse video-level annotations available. Existing works typically involve extracting global features from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Peng Wu , Xuerong Zhou , Guansong Pang , Zhiwei Yang , Qingsen Yan , Peng Wang , Yanning Zhang

Enabling computational systems with the ability to localize actions in video-based content has manifold applications. Traditionally, such a problem is approached in a fully-supervised setting where video-clips with complete frame-by-frame…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Kurt Degiorgio , Fabio Cuzzolin

A system capturing the association between video frames and textual queries offer great potential for better video analysis. However, training such a system in a fully supervised way inevitably demands a meticulously curated video dataset…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Zhiyuan Fang , Shu Kong , Zhe Wang , Charless Fowlkes , Yezhou Yang

Given an untrimmed video and a text query, natural language video localization (NLVL) is to locate a matching span from the video that semantically corresponds to the query. Existing solutions formulate NLVL either as a ranking task and…

Computation and Language · Computer Science 2020-06-16 Hao Zhang , Aixin Sun , Wei Jing , Joey Tianyi Zhou

Video activity localisation has recently attained increasing attention due to its practical values in automatically localising the most salient visual segments corresponding to their language descriptions (sentences) from untrimmed and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Jiabo Huang , Yang Liu , Shaogang Gong , Hailin Jin

Detecting temporal extents of human actions in videos is a challenging computer vision problem that requires detailed manual supervision including frame-level labels. This expensive annotation process limits deploying action detectors to a…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Basura Fernando , Cheston Tan Yin Chet , Hakan Bilen

Weakly-supervised temporal action localization aims to identify and localize the action instances in the untrimmed videos with only video-level action labels. When humans watch videos, we can adapt our abstract-level knowledge about actions…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Xijun Wang , Aggelos K. Katsaggelos

Semantic segmentation with limited annotations, such as weakly supervised semantic segmentation (WSSS) and semi-supervised semantic segmentation (SSSS), is a challenging task that has attracted much attention recently. Most leading WSSS…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Junwen Pan , Pengfei Zhu , Kaihua Zhang , Bing Cao , Yu Wang , Dingwen Zhang , Junwei Han , Qinghua Hu

Acquiring sufficient ground-truth supervision to train deep visual models has been a bottleneck over the years due to the data-hungry nature of deep learning. This is exacerbated in some structured prediction tasks, such as semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-12-10 Xueyi Li , Tianfei Zhou , Jianwu Li , Yi Zhou , Zhaoxiang Zhang

Video-language modeling has attracted much attention with the rapid growth of web videos. Most existing methods assume that the video frames and text description are semantically correlated, and focus on video-language modeling at video…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Haoyu Lu , Mingyu Ding , Nanyi Fei , Yuqi Huo , Zhiwu Lu

Most existing word alignment methods rely on manual alignment datasets or parallel corpora, which limits their usefulness. Here, to mitigate the dependence on manual data, we broaden the source of supervision by relaxing the requirement for…

Computation and Language · Computer Science 2023-10-20 Qiyu Wu , Masaaki Nagata , Yoshimasa Tsuruoka