English
Related papers

Related papers: FlowFormer: A Transformer Architecture for Optical…

200 papers

Recent advances in fMRI-based visual decoding have enabled compelling reconstructions of perceived images. However, most approaches rely on subject-specific training, limiting scalability and practical deployment. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-09-12 Chenqian Le , Yilin Zhao , Nikasadat Emami , Kushagra Yadav , Xujin "Chris" Liu , Xupeng Chen , Yao Wang

We present FractalPINN-Flow, an unsupervised deep learning framework for dense optical flow estimation that learns directly from consecutive grayscale frames without requiring ground truth. The architecture centers on the Fractal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Sara Behnamian , Rasoul Khaksarinezhad , Andreas Langer

Recent advances in multimodal foundation models unifying image understanding and generation have opened exciting avenues for tackling a wide range of vision-language tasks within a single framework. Despite progress, existing unified models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ying Shen , Zhiyang Xu , Jiuhai Chen , Shizhe Diao , Jiaxin Zhang , Yuguang Yao , Joy Rimchala , Ismini Lourentzou , Lifu Huang

Transformer-based deep neural networks have achieved remarkable success across various computer vision tasks, largely attributed to their long-range self-attention mechanism and scalability. However, most transformer architectures embed…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Muyi Bao , Changyu Zeng , Yifan Wang , Zhengni Yang , Zimu Wang , Guangliang Cheng , Jun Qi , Wei Wang

Efficient execution of deep learning workloads on dataflow architectures is crucial for overcoming memory bottlenecks and maximizing performance. While streaming intermediate results between computation kernels can significantly improve…

Hardware Architecture · Computer Science 2025-09-24 Hanchen Ye , Deming Chen

Flow matching has recently emerged as a principled framework for learning continuous-time transport maps, enabling efficient ODE-based sampling without relying on stochastic diffusion processes. While generative modeling has shown promise…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zhi Chen , Runze Hu , Le Zhang

Accurate and computationally efficient 3D medical image segmentation remains a critical challenge in clinical workflows. Transformer-based architectures often demonstrate superior global contextual modeling but at the expense of excessive…

Image and Video Processing · Electrical Eng. & Systems 2026-02-19 Kavyansh Tyagi , Vishwas Rathi , Puneet Goyal

The design choices in Transformer feed-forward neural networks have resulted in significant computational and parameter overhead. In this work, we emphasize the importance of hidden dimensions in designing lightweight FFNs, a factor often…

Computation and Language · Computer Science 2024-06-06 Tong Zheng , Bei Li , Huiwen Bao , Jiale Wang , Weiqiao Shan , Tong Xiao , Jingbo Zhu

Transformer-based language models utilize the attention mechanism for substantial performance improvements in almost all natural language processing (NLP) tasks. Similar attention structures are also extensively studied in several other…

Computation and Language · Computer Science 2023-05-17 Nurullah Sevim , Ege Ozan Özyedek , Furkan Şahinuç , Aykut Koç

Topology optimization enables the design of highly efficient and complex structures, but conventional iterative methods, such as SIMP-based approaches, often suffer from high computational costs and sensitivity to initial conditions.…

Computational Engineering, Finance, and Science · Computer Science 2025-09-18 Aaron Lutheran , Srijan Das , Alireza Tabarraei

End-to-end trained convolutional neural networks have led to a breakthrough in optical flow estimation. The most recent advances focus on improving the optical flow estimation by improving the architecture and setting a new benchmark on the…

Computer Vision and Pattern Recognition · Computer Science 2021-06-03 D. B. de Jong , F. Paredes-Vallés , G. C. H. E. de Croon

Transformer, as an alternative to CNN, has been proven effective in many modalities (e.g., texts and images). For 3D point cloud transformers, existing efforts focus primarily on pushing their accuracy to the state-of-the-art level.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhijian Liu , Xinyu Yang , Haotian Tang , Shang Yang , Song Han

Due to the high price and heavy energy consumption of GPUs, deploying deep models on IoT devices such as microcontrollers makes significant contributions for ecological AI. Conventional methods successfully enable convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Yinan Liang , Ziwei Wang , Xiuwei Xu , Yansong Tang , Jie Zhou , Jiwen Lu

In this paper, we focus on designing effective method for fast and accurate scene parsing. A common practice to improve the performance is to attain high resolution feature maps with strong semantic representation. Two strategies are widely…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Xiangtai Li , Ansheng You , Zhen Zhu , Houlong Zhao , Maoke Yang , Kuiyuan Yang , Yunhai Tong

Existing unsupervised visual odometry (VO) methods either match pairwise images or integrate the temporal information using recurrent neural networks over a long sequence of images. They are either not accurate, time-consuming in training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Xiangyu Li , Yonghong Hou , Pichao Wang , Zhimin Gao , Mingliang Xu , Wanqing Li

Real-time high-accuracy optical flow estimation is a crucial component in various applications, including localization and mapping in robotics, object tracking, and activity recognition in computer vision. While recent learning-based…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Zhiyong Zhang , Huaizu Jiang , Hanumant Singh

We introduce a unified, end-to-end framework that seamlessly integrates object detection and pose estimation with a versatile onboarding process. Our pipeline begins with an onboarding stage that generates object representations from either…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Artem Moroz , Vít Zeman , Martin Mikšík , Elizaveta Isianova , Miroslav David , Pavel Burget , Varun Burde

In continual learning, solving the catastrophic forgetting problem may make the models fall into the stability-plasticity dilemma. Moreover, inter-task confusion will also occur due to the lack of knowledge exchanges between different…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Sheng-Kai Huang , Jiun-Feng Chang , Chun-Rong Huang

Flow Matching (FM) has recently emerged as a leading approach for high-fidelity visual generation, offering a robust continuous-time alternative to ordinary differential equation (ODE) based models. However, despite their success, FM models…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Dayu Wang , Jiaye Yang , Weikang Li , Jiahui Liang , Yang Li

Recent advances in end-to-end autonomous driving leverage multi-view images to construct BEV representations for motion planning. In motion planning, autonomous vehicles need considering both hard constraints imposed by geometrically…