English
Related papers

Related papers: Frequency Domain Transformer Networks for Video Pr…

200 papers

Adapting image-pretrained backbones to video typically relies on time-domain adapters tuned to a single temporal scale. Our experiments show that these modules pick up static image cues and very fast flicker changes, while overlooking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Thinesh Thiyakesan Ponbagavathi , Constantin Seibold , Alina Roitberg

Time series forecasting is important across various domains for decision-making. In particular, financial time series such as stock prices can be hard to predict as it is difficult to model short-term and long-term temporal dependencies…

Machine Learning · Computer Science 2023-04-12 Zhen Zeng , Rachneet Kaur , Suchetha Siddagangappa , Saba Rahimi , Tucker Balch , Manuela Veloso

Due to a variety of motions across different frames, it is highly challenging to learn an effective spatiotemporal representation for accurate video saliency prediction (VSP). To address this issue, we develop an effective spatiotemporal…

Computer Vision and Pattern Recognition · Computer Science 2020-01-03 Jin Chen , Huihui Song , Kaihua Zhang , Bo Liu , Qingshan Liu

Multi-target tracking (MTT) is a classical signal processing task, where the goal is to estimate the states of an unknown number of moving targets from noisy sensor measurements. In this paper, we revisit MTT from a deep learning…

Signal Processing · Electrical Eng. & Systems 2024-05-15 Damian Owerko , Charilaos I. Kanatsoulis , Jennifer Bondarchuk , Donald J. Bucci , Alejandro Ribeiro

Various convolutional neural networks (CNNs) were developed recently that achieved accuracy comparable with that of human beings in computer vision tasks such as image recognition, object detection and tracking, etc. Most of these networks,…

Computer Vision and Pattern Recognition · Computer Science 2019-03-20 Tianchen Wang , Jinjun Xiong , Xiaowei Xu , Yiyu Shi

Graph neural networks (GNNs) have been proven to be effective in various network-related tasks. Most existing GNNs usually exploit the low-frequency signals of node features, which gives rise to one fundamental question: is the…

Machine Learning · Computer Science 2021-01-05 Deyu Bo , Xiao Wang , Chuan Shi , Huawei Shen

A common approach for moving objects segmentation in a scene is to perform a background subtraction. Several methods have been proposed in this domain. However, they lack the ability of handling various difficult scenarios such as…

Computer Vision and Pattern Recognition · Computer Science 2018-08-06 Long Ang Lim , Hacer Yalim Keles

High-quality video inpainting that completes missing regions in video frames is a promising yet challenging task. State-of-the-art approaches adopt attention models to complete a frame by searching missing contents from reference frames,…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Yanhong Zeng , Jianlong Fu , Hongyang Chao

Although various image-based domain adaptation (DA) techniques have been proposed in recent years, domain shift in videos is still not well-explored. Most previous works only evaluate performance on small-scale datasets which are saturated.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-10 Min-Hung Chen , Zsolt Kira , Ghassan AlRegib

Recent progress in research on Deep Graph Networks (DGNs) has led to a maturation of the domain of learning on graphs. Despite the growth of this research field, there are still important challenges that are yet unsolved. Specifically,…

Machine Learning · Computer Science 2024-04-10 Alessio Gravina , Davide Bacciu

Video understanding requires reasoning at multiple spatiotemporal resolutions -- from short fine-grained motions to events taking place over longer durations. Although transformer architectures have recently advanced the state-of-the-art,…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Shen Yan , Xuehan Xiong , Anurag Arnab , Zhichao Lu , Mi Zhang , Chen Sun , Cordelia Schmid

The dynamics of power grids are governed by a large number of nonlinear differential and algebraic equations (DAEs). To safely operate the system, operators need to check that the states described by these DAEs stay within prescribed limits…

Systems and Control · Electrical Eng. & Systems 2023-02-01 Wenqi Cui , Weiwei Yang , Baosen Zhang

Despite the steady progress in video analysis led by the adoption of convolutional neural networks (CNNs), the relative improvement has been less drastic as that in 2D static image classification. Three main challenges exist including…

Computer Vision and Pattern Recognition · Computer Science 2018-07-30 Saining Xie , Chen Sun , Jonathan Huang , Zhuowen Tu , Kevin Murphy

Convolutional Neural Networks (CNNs) are widely used in fault diagnosis of mechanical systems due to their powerful feature extraction and classification capabilities. However, the CNN is a typical black-box model, and the mechanism of…

Artificial Intelligence · Computer Science 2024-03-12 Qian Chen , Xingjian Dong , Guowei Tu , Dong Wang , Baoxuan Zhao , Zhike Peng

Deep convolutional networks have achieved great success for visual recognition in still images. However, for action recognition in videos, the advantage over traditional methods is not so evident. This paper aims to discover the principles…

Computer Vision and Pattern Recognition · Computer Science 2016-08-03 Limin Wang , Yuanjun Xiong , Zhe Wang , Yu Qiao , Dahua Lin , Xiaoou Tang , Luc Van Gool

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy than traditional hand-crafted feature-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qiang Wang , Shaohuai Shi , Shizhen Zheng , Kaiyong Zhao , Xiaowen Chu

In recent years, deep learning techniques have outperformed traditional models in many machine learning tasks. Deep neural networks have successfully been applied to address time series forecasting problems, which is a very important topic…

Machine Learning · Computer Science 2021-04-09 Pedro Lara-Benítez , Manuel Carranza-García , José C. Riquelme

Spatial-temporal data forecasting of traffic flow is a challenging task because of complicated spatial dependencies and dynamical trends of temporal pattern between different roads. Existing frameworks typically utilize given spatial…

Machine Learning · Computer Science 2021-03-09 Mengzhang Li , Zhanxing Zhu

Research on long-term time series prediction has primarily relied on Transformer and MLP models, while the potential of convolutional networks in this domain remains underexplored. To address this, we propose a novel multi-scale time series…

Machine Learning · Computer Science 2025-10-03 Chenghan Li , Mingchen Li , Yipu Liao , Ruisheng Diao

We consider the problem of image-to-video translation, where an input image is translated into an output video containing motions of a single object. Recent methods for such problems typically train transformation networks to generate…

Computer Vision and Pattern Recognition · Computer Science 2018-07-27 Long Zhao , Xi Peng , Yu Tian , Mubbasir Kapadia , Dimitris Metaxas