中文
相关论文

相关论文: Learning Efficient Video Representation with Video…

200 篇论文

Recently, deep neural networks have achieved excellent performance on low-light raw video enhancement. However, they often come with high computational complexity and large memory costs, which hinder their applications on resource-limited…

计算机视觉与模式识别 · 计算机科学 2024-04-01 Gengchen Zhang , Yulun Zhang , Xin Yuan , Ying Fu

Self-supervised video representation learning aimed at maximizing similarity between different temporal segments of one video, in order to enforce feature persistence over time. This leads to loss of pertinent information related to…

计算机视觉与模式识别 · 计算机科学 2023-05-12 Di Yang , Yaohui Wang , Quan Kong , Antitza Dantcheva , Lorenzo Garattoni , Gianpiero Francesca , Francois Bremond

Silent Speech Interfaces aim to reconstruct the acoustic signal from a sequence of ultrasound tongue images that records the articulatory movement. The extraction of information about the tongue movement requires us to efficiently process…

人机交互 · 计算机科学 2022-06-28 Amin Honarmandi Shandiz , Laszlo Toth

A key challenge in video enhancement and action recognition is to fuse useful information from neighboring frames. Recent works suggest establishing accurate correspondences between neighboring frames before fusing temporal information.…

计算机视觉与模式识别 · 计算机科学 2020-11-24 Shuyang Gu , Jianmin Bao , Dong Chen

We introduce a novel self-supervised learning approach to learn representations of videos that are responsive to changes in the motion dynamics. Our representations can be learned from data without human annotation and provide a substantial…

计算机视觉与模式识别 · 计算机科学 2020-07-22 Simon Jenni , Givi Meishvili , Paolo Favaro

We observed that recent state-of-the-art results on single image human pose estimation were achieved by multi-stage Convolution Neural Networks (CNN). Notwithstanding the superior performance on static images, the application of these…

计算机视觉与模式识别 · 计算机科学 2018-03-12 Yue Luo , Jimmy Ren , Zhouxia Wang , Wenxiu Sun , Jinshan Pan , Jianbo Liu , Jiahao Pang , Liang Lin

Deep convolutional neutral networks have achieved great success on image recognition tasks. Yet, it is non-trivial to transfer the state-of-the-art image recognition networks to videos as per-frame evaluation is too slow and unaffordable.…

计算机视觉与模式识别 · 计算机科学 2017-06-06 Xizhou Zhu , Yuwen Xiong , Jifeng Dai , Lu Yuan , Yichen Wei

We propose a new method to create compact convolutional neural networks (CNNs) by exploiting sparse convolutions. Different from previous works that learn sparsity in models, we directly employ hand-crafted kernels with regular sparse…

计算机视觉与模式识别 · 计算机科学 2018-09-12 Chun-Fu Chen , Quanfu Fan , Marco Pistoia , Gwo Giun Lee

By converting low-frame-rate, low-resolution videos into high-frame-rate, high-resolution ones, space-time video super-resolution techniques can enhance visual experiences and facilitate more efficient information dissemination. We propose…

图像与视频处理 · 电气工程与系统科学 2024-07-12 Congrui Fu , Hui Yuan , Shiqi Jiang , Guanghui Zhang , Liquan Shen , Raouf Hamzaoui

The drastic variation of motion in spatial and temporal dimensions makes the video prediction task extremely challenging. Existing RNN models obtain higher performance by deepening or widening the model. They obtain the multi-scale features…

计算机视觉与模式识别 · 计算机科学 2024-02-19 Zhifeng Ma , Hao Zhang , Jie Liu

Convolutional Neural Networks (CNNs) have shown impressive performance in computer vision tasks such as image classification, detection, and segmentation. Moreover, recent work in Generative Adversarial Networks (GANs) has highlighted the…

机器学习 · 计算机科学 2021-01-06 Samarth Sinha , Animesh Garg , Hugo Larochelle

Spatial convolutions are widely used in numerous deep video models. It fundamentally assumes spatio-temporal invariance, i.e., using shared weights for every location in different frames. This work presents Temporally-Adaptive Convolutions…

计算机视觉与模式识别 · 计算机科学 2022-03-18 Ziyuan Huang , Shiwei Zhang , Liang Pan , Zhiwu Qing , Mingqian Tang , Ziwei Liu , Marcelo H. Ang

This study introduces a method for efficiently detecting objects within 3D point clouds using convolutional neural networks (CNNs). Our approach adopts a unique feature-centric voting mechanism to construct convolutional layers that…

计算机视觉与模式识别 · 计算机科学 2024-12-05 Tianyi Lyu , Dian Gu , Peiyuan Chen , Yaoting Jiang , Zhenhong Zhang , Huadong Pang , Li Zhou , Yiping Dong

For action recognition learning, 2D CNN-based methods are efficient but may yield redundant features due to applying the same 2D convolution kernel to each frame. Recent efforts attempt to capture motion information by establishing…

计算机视觉与模式识别 · 计算机科学 2021-03-24 Mingyu Wu , Boyuan Jiang , Donghao Luo , Junchi Yan , Yabiao Wang , Ying Tai , Chengjie Wang , Jilin Li , Feiyue Huang , Xiaokang Yang

Self-supervised tasks such as colorization, inpainting and zigsaw puzzle have been utilized for visual representation learning for still images, when the number of labeled images is limited or absent at all. Recently, this worthwhile stream…

计算机视觉与模式识别 · 计算机科学 2018-11-27 Dahun Kim , Donghyeon Cho , In So Kweon

The dominant paradigm for video-based action segmentation is composed of two steps: first, for each frame, compute low-level features using Dense Trajectories or a Convolutional Neural Network that encode spatiotemporal information locally,…

计算机视觉与模式识别 · 计算机科学 2016-08-31 Colin Lea , Rene Vidal , Austin Reiter , Gregory D. Hager

Visual Transformers (VTs) are emerging as an architectural paradigm alternative to Convolutional networks (CNNs). Differently from CNNs, VTs can capture global relations between image elements and they potentially have a larger…

计算机视觉与模式识别 · 计算机科学 2021-11-16 Yahui Liu , Enver Sangineto , Wei Bi , Nicu Sebe , Bruno Lepri , Marco De Nadai

Human action recognition in videos is a critical task with significant implications for numerous applications, including surveillance, sports analytics, and healthcare. The challenge lies in creating models that are both precise in their…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Yufei Xie

The video and action classification have extremely evolved by deep neural networks specially with two stream CNN using RGB and optical flow as inputs and they present outstanding performance in terms of video analysis. One of the…

计算机视觉与模式识别 · 计算机科学 2016-09-05 Ali Diba , Ali Mohammad Pazandeh , Luc Van Gool

Convolutional Neural Networks with 3D kernels (3D-CNNs) currently achieve state-of-the-art results in video recognition tasks due to their supremacy in extracting spatiotemporal features within video frames. There have been many successful…

计算机视觉与模式识别 · 计算机科学 2021-10-19 Okan Köpüklü , Stefan Hörmann , Fabian Herzog , Hakan Cevikalp , Gerhard Rigoll