English
Related papers

Related papers: FlowFormer: A Transformer Architecture for Optical…

200 papers

Morphing is a long-standing problem in vision and computer graphics, requiring a time-dependent warping for feature alignment and a blending for smooth interpolation. Recently, multilayer perceptrons (MLPs) have been explored as implicit…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Arthur Bizzi , Matias Grynberg , Vitor Matias , Daniel Perazzo , João Paulo Lima , Luiz Velho , Nuno Gonçalves , João Pereira , Guilherme Schardong , Tiago Novello

Spiking Neural Networks (SNNs) offer notable advantages in biological plausibility and energy efficiency, making them promising candidates for building low-power Transformers. However, existing Spiking Transformers largely adhere to a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zequan Xie , Weiming Zeng , Yunhua Chen , Sichang Ling , Tongyang Chen , Jinsheng Xiao

Optical flow estimation in omnidirectional videos faces two significant issues: the lack of benchmark datasets and the challenge of adapting perspective video-based methods to accommodate the omnidirectional nature. This paper proposes the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Keshav Bhandari , Bin Duan , Gaowen Liu , Hugo Latapie , Ziliang Zong , Yan Yan

Recent advances in text-to-3D generation have made significant progress. In particular, with the pretrained diffusion models, existing methods predominantly use Score Distillation Sampling (SDS) to train 3D models such as Neural RaRecent…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hangyu Li , Xiangxiang Chu , Dingyuan Shi , Wang Lin

Flow-based methods have achieved significant success in various generative modeling tasks, capturing nuanced details within complex data distributions. However, few existing works have exploited this unique capability to resolve…

Machine Learning · Statistics 2026-02-03 Yakun Wang , Leyang Wang , Song Liu , Taiji Suzuki

We learn to compute optical flow by combining a classical spatial-pyramid formulation with deep learning. This estimates large motions in a coarse-to-fine approach by warping one image of a pair at each pyramid level by the current flow…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Anurag Ranjan , Michael J. Black

Scene flow estimation is a foundational task for many robotic applications, including robust dynamic object detection, automatic labeling, and sensor synchronization. Two types of approaches to the problem have evolved: 1) Supervised and 2)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 David T. Hoffmann , Syed Haseeb Raza , Hanqiu Jiang , Denis Tananaev , Steffen Klingenhoefer , Martin Meinke

Entropy estimation is essential for the performance of learned image compression. It has been demonstrated that a transformer-based entropy model is of critical importance for achieving a high compression ratio, however, at the expense of a…

Image and Video Processing · Electrical Eng. & Systems 2024-02-28 A. Burakhan Koyuncu , Panqi Jia , Atanas Boev , Elena Alshina , Eckehard Steinbach

Deep learning surrogates for CFD flow-field prediction often rely on large, complex models, which can be slow and fragile when data are noisy or incomplete. We introduce FlowForge, a staged local rollout engine that predicts future flow…

Machine Learning · Computer Science 2026-04-27 Xiaowen Zhang , Ziming Zhou , Fengnian Zhao , David L. S. Hung

Supervised training of optical flow predictors generally yields better accuracy than unsupervised training. However, the improved performance comes at an often high annotation cost. Semi-supervised training trades off accuracy against…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Shuai Yuan , Xian Sun , Hannah Kim , Shuzhi Yu , Carlo Tomasi

Event cameras offer promising properties, such as high temporal resolution and high dynamic range. These benefits have been utilized into many machine vision tasks, especially optical flow estimation. Currently, most existing event-based…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Hao Zhuang , Xinjie Huang , Kuanxu Hou , Delei Kong , Chenming Hu , Zheng Fang

Reinforcement learning has emerged as a promising paradigm for aligning diffusion and flow-matching models with human preferences, yet practitioners face fragmented codebases, model-specific implementations, and engineering complexity. We…

Machine Learning · Computer Science 2026-03-17 Bowen Ping , Chengyou Jia , Minnan Luo , Hangwei Qian , Ivor Tsang

Optical flow estimation is an important yet challenging problem in the field of video analytics. The features of different semantics levels/layers of a convolutional neural network can provide information of different granularity. To…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Xiaolin Song , Yuyang Zhao , Jingyu Yang , Cuiling Lan , Wenjun Zeng

Chip placement plays an important role in physical design. While generative models like diffusion models offer promising learning-based solutions, current methods have the following limitations: they use random synthetic data for…

Hardware Architecture · Computer Science 2026-04-28 Peng Xie , Ke Xue , Yunqi Shi , Ruo-Tong Chen , Chengrui Gao , Siyuan Xu , Chenjian Ding , Mingxuan Yuan , Chao Qian

State-of-the-art rehearsal-free continual learning methods exploit the peculiarities of Vision Transformers to learn task-specific prompts, drastically reducing catastrophic forgetting. However, there is a tradeoff between the number of…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Thomas De Min , Massimiliano Mancini , Karteek Alahari , Xavier Alameda-Pineda , Elisa Ricci

End-to-end object detectors offer a promising NMS-free paradigm for real-time applications, yet their high computational cost remains a significant barrier, particularly for complex scenarios like intersection traffic monitoring. To address…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Zixing Wang , Yuhang Zhao

Transformers have excelled in many tasks including vision. However, efficient deployment of transformer models in low-latency or high-throughput applications is hindered by the computation in the attention mechanism which involves expensive…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 John Yang , Le An , Su Inn Park

Learning-based optical flow estimation has been dominated with the pipeline of cost volume with convolutions for flow regression, which is inherently limited to local correlations and thus is hard to address the long-standing challenge of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Haofei Xu , Jing Zhang , Jianfei Cai , Hamid Rezatofighi , Dacheng Tao

Generative models have excelled in audio tasks using approaches such as language models, diffusion, and flow matching. However, existing generative approaches for speech enhancement (SE) face notable challenges: language model-based methods…

Audio and Speech Processing · Electrical Eng. & Systems 2025-05-28 Ziqian Wang , Zikai Liu , Xinfa Zhu , Yike Zhu , Mingshuai Liu , Jun Chen , Longshuai Xiao , Chao Weng , Lei Xie

The Extract, Transform, Load (ETL) workflow is fundamental for populating and maintaining data warehouses and other data stores accessed by analysts for downstream tasks. A major shortcoming of modern ETL solutions is the extensive need for…

Software Engineering · Computer Science 2025-08-01 Mattia Di Profio , Mingjun Zhong , Yaji Sripada , Marcel Jaspars