English
Related papers

Related papers: Learning Omnidirectional Flow in 360-degree Video …

200 papers

This paper presents FluxMem, a training-free framework for efficient streaming video understanding. FluxMem adaptively compresses redundant visual memory through a hierarchical, two-stage design: (1) a Temporal Adjacency Selection (TAS)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Yiweng Xie , Bo He , Junke Wang , Xiangyu Zheng , Ziyi Ye , Zuxuan Wu

LiDAR scene flow is the task of estimating per-point 3D motion between consecutive point clouds. Recent methods achieve centimeter-level accuracy on popular autonomous vehicle (AV) datasets, but are typically only trained and evaluated on a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Siyi Li , Qingwen Zhang , Ishan Khatri , Kyle Vedder , Eric Eaton , Deva Ramanan , Neehar Peri

We introduce a novel training strategy for stereo matching and optical flow estimation that utilizes image-to-image translation between synthetic and real image domains. Our approach enables the training of models that excel in real image…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zhexiao Xiong , Feng Qiao , Yu Zhang , Nathan Jacobs

Learning accurate scene reconstruction without pose priors in neural radiance fields is challenging due to inherent geometric ambiguity. Recent development either relies on correspondence priors for regularization or uses off-the-shelf flow…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Xunzhi Zheng , Dan Xu

Accurate perception of dynamic traffic scenes is crucial for high-level autonomous driving systems, requiring robust object motion estimation and instance segmentation. However, traditional methods often treat them as separate tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yinqi Chen , Meiying Zhang , Qi Hao , Guang Zhou

Despite tremendous recent progress, Flow Matching methods still suffer from exposure bias due to discrepancies in training and inference. This paper investigates the root causes of exposure bias in Flow Matching, including: (1) the model…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Guanbo Huang , Jingjia Mao , Fanding Huang , Fengkai Liu , Xiangyang Luo , Yaoyuan Liang , Jiasheng Lu , Xiaoe Wang , Pei Liu , Ruiliu Fu , Shao-Lun Huang

Explicitly disentangling style and content in vision models remains challenging due to their semantic overlap and the subjectivity of human perception. Existing methods propose separation through generative or discriminative objectives, but…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Pingchuan Ma , Xiaopei Yang , Yusong Li , Ming Gui , Felix Krause , Johannes Schusterbauer , Björn Ommer

Strong semantic representations improve the convergence and generation quality of diffusion and flow models. Existing approaches largely rely on external models, which require separate training, operate on misaligned objectives, and exhibit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Hila Chefer , Patrick Esser , Dominik Lorenz , Dustin Podell , Vikash Raja , Vinh Tong , Antonio Torralba , Robin Rombach

Autonomous driving has attracted much attention over the years but turns out to be harder than expected, probably due to the difficulty of labeled data collection for model training. Self-supervised learning (SSL), which leverages unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Kai Chen , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

The growing interest in omnidirectional videos (ODVs) that capture the full field-of-view (FOV) has gained 360-degree saliency prediction importance in computer vision. However, predicting where humans look in 360-degree scenes presents…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Mert Cokelek , Nevrez Imamoglu , Cagri Ozcinar , Erkut Erdem , Aykut Erdem

Optical flow estimation with convolutional neural networks (CNNs) has recently solved various tasks of computer vision successfully. In this paper we adapt a state-of-the-art approach for optical flow estimation to omnidirectional images.…

Computer Vision and Pattern Recognition · Computer Science 2018-12-07 André Apitzsch , Roman Seidel , Gangolf Hirtz

Reconstructing High Dynamic Range (HDR) video from image sequences captured with alternating exposures is challenging, especially in the presence of large camera or object motion. Existing methods typically align low dynamic range sequences…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Gangwei Xu , Yujin Wang , Jinwei Gu , Tianfan Xue , Xin Yang

The perceptive models of autonomous driving require fast inference within a low latency for safety. While existing works ignore the inevitable environmental changes after processing, streaming perception jointly evaluates the latency and…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Jinrong Yang , Songtao Liu , Zeming Li , Xiaoping Li , Jian Sun

We tackle the problem of estimating flow between two images with large lighting variations. Recent learning-based flow estimation frameworks have shown remarkable performance on image pairs with small displacement and constant…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Zhaoyang Huang , Xiaokun Pan , Runsen Xu , Yan Xu , Ka chun Cheung , Guofeng Zhang , Hongsheng Li

Diffusion models have transformed the image-to-image (I2I) synthesis and are now permeating into videos. However, the advancement of video-to-video (V2V) synthesis has been hampered by the challenge of maintaining temporal consistency…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Feng Liang , Bichen Wu , Jialiang Wang , Licheng Yu , Kunpeng Li , Yinan Zhao , Ishan Misra , Jia-Bin Huang , Peizhao Zhang , Peter Vajda , Diana Marculescu

Scene flow is a challenging task aimed at jointly estimating the 3D structure and motion of the sensed environment. Although deep learning solutions achieve outstanding performance in terms of accuracy, these approaches divide the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Filippo Aleotti , Matteo Poggi , Fabio Tosi , Stefano Mattoccia

3D single object tracking (SOT) is a crucial task in fields of mobile robotics and autonomous driving. Traditional motion-based approaches achieve target tracking by estimating the relative movement of target between two consecutive frames.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Shuo Li , Yubo Cui , Zhiheng Li , Zheng Fang

Recent advances in optical flow estimation have prioritized accuracy at the cost of growing GPU memory consumption, particularly for high-resolution (FullHD) inputs. We introduce MEMFOF, a memory-efficient multi-frame optical flow method…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Vladislav Bargatin , Egor Chistov , Alexander Yakovenko , Dmitriy Vatolin

Urban traffic optimization using traffic cameras as sensors is driving the need to advance state-of-the-art multi-target multi-camera (MTMC) tracking. This work introduces CityFlow, a city-scale traffic camera dataset consisting of more…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zheng Tang , Milind Naphade , Ming-Yu Liu , Xiaodong Yang , Stan Birchfield , Shuo Wang , Ratnesh Kumar , David Anastasiu , Jenq-Neng Hwang

Flow Matching has limited ability in achieving one-step generation due to its reliance on learned curved trajectories. Previous studies have attempted to address this limitation by either modifying the coupling distribution to prevent…

Machine Learning · Computer Science 2025-11-25 Chenrui Ma , Xi Xiao , Tianyang Wang , Xiao Wang , Yanning Shen