English
Related papers

Related papers: Spatiotemporal Knowledge Distillation for Efficien…

200 papers

Recently, dataset distillation has paved the way towards efficient machine learning, especially for image datasets. However, the distillation for videos, characterized by an exclusive temporal dimension, remains an underexplored domain. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ziyu Wang , Yue Xu , Cewu Lu , Yong-Lu Li

Identifying the regions of a learning resource that a learner pays attention to is crucial for assessing the material's impact and improving its design and related support systems. Saliency detection in videos addresses the automatic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Evelyn Navarrete , Ralph Ewerth , Anett Hoppe

Deep learning approaches have been established as the main methodology for video classification and recognition. Recently, 3-dimensional convolutions have been used to achieve state-of-the-art performance in many challenging video datasets.…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Alexandros Stergiou , Georgios Kapidis , Grigorios Kalliatakis , Christos Chrysoulas , Remco Veltkamp , Ronald Poppe

We introduce a saliency-based distortion layer for convolutional neural networks that helps to improve the spatial sampling of input data for a given task. Our differentiable layer can be added as a preprocessing block to existing task…

Computer Vision and Pattern Recognition · Computer Science 2018-09-11 Adrià Recasens , Petr Kellnhofer , Simon Stent , Wojciech Matusik , Antonio Torralba

Computational modeling of visual saliency has become an important research problem in recent years, with applications in video quality estimation, video compression, object tracking, retargeting, summarization, and so on. While most visual…

Multimedia · Computer Science 2016-04-26 Sayed Hossein Khatoonabadi , Ivan V. Bajic , Yufeng Shan

Automatically describing audio-visual content with texts, namely video captioning, has received significant attention due to its potential applications across diverse fields. Deep neural networks are the dominant methods, offering…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-19 Özkan Çaylı , Xubo Liu , Volkan Kılıç , Wenwu Wang

Previous methods based on 3DCNN, convLSTM, or optical flow have achieved great success in video salient object detection (VSOD). However, they still suffer from high computational costs or poor quality of the generated saliency maps. To…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Xing Zhao , Haoran Liang , Peipei Li , Guodao Sun , Dongdong Zhao , Ronghua Liang , Xiaofei He

In recent years, the rapid expansion of dataset sizes and the increasing complexity of deep learning models have significantly escalated the demand for computational resources, both for data storage and model training. Dataset distillation…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Zhe Li , Hadrien Reynaud , Mischa Dombrowski , Sarah Cechnicka , Franciskus Xaverius Erick , Bernhard Kainz

We present a learning algorithm for human activity recognition in videos. Our approach is designed for UAV videos, which are mainly acquired from obliquely placed dynamic cameras that contain a human actor along with background motion.…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Divya Kothandaraman , Ming Lin , Dinesh Manocha

As an important and challenging problem in computer vision, video saliency detection is typically cast as a spatiotemporal context modeling problem over consecutive frames. As a result, a key issue in video saliency detection is how to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-26 Lina Wei , Fangfang Wang , Xi Li , Fei Wu , Jun Xiao

High-quality computer vision models typically address the problem of understanding the general distribution of real-world images. However, most cameras observe only a very small fraction of this distribution. This offers the possibility of…

Computer Vision and Pattern Recognition · Computer Science 2020-01-29 Ravi Teja Mullapudi , Steven Chen , Keyi Zhang , Deva Ramanan , Kayvon Fatahalian

With the rapid development of multimedia processing and deep learning technologies, especially in the field of video understanding, video quality assessment (VQA) has achieved significant progress. Although researchers have moved from…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Jiebin Yan , Lei Wu , Yuming Fang , Xuelin Liu , Xue Xia , Weide Liu

With the rapid development of deep learning techniques, image saliency deep models trained solely by spatial information have occasionally achieved detection performance for video data comparable to that of the models trained by both…

Computer Vision and Pattern Recognition · Computer Science 2020-08-21 Yunxiao Li , Shuai Li , Chenglizhao Chen , Aimin Hao , Hong Qin

3D convolutional neural networks have achieved promising results for video tasks in computer vision, including video saliency prediction that is explored in this paper. However, 3D convolution encodes visual representation merely on fixed…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Ziqiang Wang , Zhi Liu , Gongyang Li , Yang Wang , Tianhong Zhang , Lihua Xu , Jijun Wang

Accuracy of depth estimation from static images has been significantly improved recently, by exploiting hierarchical features from deep convolutional neural networks (CNNs). Compared with static images, vast information exists among video…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Haokui Zhang , Chunhua Shen , Ying Li , Yuanzhouhan Cao , Yu Liu , Youliang Yan

Video captioning is a challenging task that requires a deep understanding of visual scenes. State-of-the-art methods generate captions using either scene-level or object-level information but without explicitly modeling object interactions.…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Boxiao Pan , Haoye Cai , De-An Huang , Kuan-Hui Lee , Adrien Gaidon , Ehsan Adeli , Juan Carlos Niebles

Recently, there have been significant improvements in the accuracy of CNN models for semantic segmentation. However, these models are often heavy and suffer from low inference speed, which limits their practical application. To address this…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Minglong Li , Lianlei Shan , Weiqiang Wang , Ke Lv , Bin Luo , Si-Bao Chen

Video classification is productive in many practical applications, and the recent deep learning has greatly improved its accuracy. However, existing works often model video frames indiscriminately, but from the view of motion, video frames…

Computer Vision and Pattern Recognition · Computer Science 2017-03-28 Yunzhen Zhao , Yuxin Peng

High level understanding of sequential visual input is important for safe and stable autonomy, especially in localization and object detection. While traditional object classification and tracking approaches are specifically designed to…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Mo Shan , Nikolay Atanasov

RGB-D salient object detection (SOD) demonstrates its superiority on detecting in complex environments due to the additional depth information introduced in the data. Inevitably, an independent stream is introduced to extract features from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-03 Guangyu Ren , Yinxiao Yu , Hengyan Liu , Tania Stathaki