English
Related papers

Related papers: Space-Time Attention with Shifted Non-Local Search

200 papers

The task of semi-supervised video object segmentation (VOS) has been greatly advanced and state-of-the-art performance has been made by dense matching-based methods. The recent methods leverage space-time memory (STM) networks and learn to…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Jiadai Sun , Yuxin Mao , Yuchao Dai , Yiran Zhong , Jianyuan Wang

Local search has recently been applied to SMT problems over various arithmetic theories. Among these, nonlinear real arithmetic poses special challenges due to its uncountable solution space and potential need to solve higher-degree…

Symbolic Computation · Computer Science 2023-11-27 Zhonghan Wang , Bohua Zhan , Bohan Li , Shaowei Cai

The attention mechanism provides a sequential prediction framework for learning spatial models with enhanced implicit temporal consistency. In this work, we show a systematic design (from 2D to 3D) for how conventional networks and other…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Ruixu Liu , Ju Shen , He Wang , Chen Chen , Sen-ching Cheung , Vijayan K. Asari

Recently, several Space-Time Memory based networks have shown that the object cues (e.g. video frames as well as the segmented object masks) from the past frames are useful for segmenting objects in the current frame. However, these methods…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Haozhe Xie , Hongxun Yao , Shangchen Zhou , Shengping Zhang , Wenxiu Sun

The prediction step is a very important part of hybrid video codecs. In this contribution, a novel spatio-temporal prediction algorithm is introduced. For this, the prediction is carried out in two steps. Firstly, a preliminary temporal…

Image and Video Processing · Electrical Eng. & Systems 2022-07-21 Jürgen Seiler , Thomas Richter , André Kaup

Video transformers have recently emerged as an effective alternative to convolutional networks for action classification. However, most prior video transformers adopt either global space-time attention or hand-defined strategies to compare…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Jue Wang , Lorenzo Torresani

Previous deep learning-based event denoising methods mostly suffer from poor interpretability and difficulty in real-time processing due to their complex architecture designs. In this paper, we propose window-based event denoising, which…

Computer Vision and Pattern Recognition · Computer Science 2024-02-15 Huachen Fang , Jinjian Wu , Qibin Hou , Weisheng Dong , Guangming Shi

In this paper, we introduce spatial attention for refining the information in multi-direction neural beamformer for far-field automatic speech recognition. Previous approaches of neural beamformers with multiple look directions, such as the…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Weipeng He , Lu Lu , Biqiao Zhang , Jay Mahadeokar , Kaustubh Kalgaonkar , Christian Fuegen

Existing state-of-the-art disparity estimation works mostly leverage the 4D concatenation volume and construct a very deep 3D convolution neural network (CNN) for disparity regression, which is inefficient due to the high memory consumption…

Computer Vision and Pattern Recognition · Computer Science 2021-03-05 Songyan Zhang , Zhicheng Wang , Qiang Wang , Jinshuo Zhang , Gang Wei , Xiaowen Chu

The captured images under low light conditions often suffer insufficient brightness and notorious noise. Hence, low-light image enhancement is a key challenging task in computer vision. A variety of methods have been proposed for this task,…

Image and Video Processing · Electrical Eng. & Systems 2020-05-22 Cheng Zhang , Qingsen Yan , Yu zhu , Xianjun Li , Jinqiu Sun , Yanning Zhang

Precise boundary annotations of image regions can be crucial for downstream applications which rely on region-class semantics. Some document collections contain densely laid out, highly irregular and overlapping multi-class region instances…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Abhishek Trivedi , Ravi Kiran Sarvadevabhatla

We propose a novel attention model that can accurately attends to target objects of various scales and shapes in images. The model is trained to gradually suppress irrelevant regions in an input image via a progressive attentive process…

Computer Vision and Pattern Recognition · Computer Science 2018-08-08 Paul Hongsuck Seo , Zhe Lin , Scott Cohen , Xiaohui Shen , Bohyung Han

3D point cloud segmentation has a wide range of applications in areas such as autonomous driving, augmented reality, virtual reality and digital twins. The point cloud data collected in real scenes often contain small objects and categories…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Chade Li , Pengju Zhang , Jiaming Zhang , Yihong Wu

Video Denoising is one of the fundamental tasks of any videoprocessing pipeline. It is different from image denoising due to the tem-poral aspects of video frames, and any image denoising approach appliedto videos will result in flickering.…

Image and Video Processing · Electrical Eng. & Systems 2020-08-28 Aryansh Omray , Samyak Jain , Utsav Krishnan , Pratik Chattopadhyay

Many localization algorithms use a spatiotemporal window of sensory information in order to recognize spatial locations, and the length of this window is often a sensitive parameter that must be tuned to the specifics of the application.…

Robotics · Computer Science 2017-07-25 Jake Bruce , Adam Jacobson , Michael Milford

We propose a novel solution for semi-supervised video object segmentation. By the nature of the problem, available cues (e.g. video frame(s) with object masks) become richer with the intermediate predictions. However, the existing methods…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Seoung Wug Oh , Joon-Young Lee , Ning Xu , Seon Joo Kim

Video compression artifact reduction aims to recover high-quality videos from low-quality compressed videos. Most existing approaches use a single neighboring frame or a pair of neighboring frames (preceding and/or following the target…

Image and Video Processing · Electrical Eng. & Systems 2019-10-29 Yi Xu , Longwen Gao , Kai Tian , Shuigeng Zhou , Huyang Sun

This study addresses the challenge of performing visual localization in demanding conditions such as night-time scenarios, adverse weather, and seasonal changes. While many prior studies have focused on improving image-matching performance…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Khang Truong Giang , Soohwan Song , Sungho Jo

Modern Search Engine Results Pages (SERPs) present complex layouts where multiple elements compete for visibility. Attention modelling is crucial for optimising web design and computational advertising, whereas attention metrics can inform…

Information Retrieval · Computer Science 2025-05-08 Mario Villaizán-Vallelado , Matteo Salvatori , Kayhan Latifzadeh , Antonio Penta , Luis A. Leiva , Ioannis Arapakis

Despite the success of deep learning for static image understanding, it remains unclear what are the most effective network architectures for the spatial-temporal modeling in videos. In this paper, in contrast to the existing CNN+RNN or…

Computer Vision and Pattern Recognition · Computer Science 2018-12-12 Dongliang He , Zhichao Zhou , Chuang Gan , Fu Li , Xiao Liu , Yandong Li , Limin Wang , Shilei Wen