English
Related papers

Related papers: Exploiting Optical Flow Guidance for Transformer-B…

200 papers

Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the…

Machine Learning · Computer Science 2023-12-19 Vijay Prakash Dwivedi , Yozen Liu , Anh Tuan Luu , Xavier Bresson , Neil Shah , Tong Zhao

Transformer-based language models have achieved impressive success in various natural language processing tasks due to their ability to capture complex dependencies and contextual information using self-attention mechanisms. However, they…

Computation and Language · Computer Science 2023-06-26 Kaushik Roy , Yuxin Zi , Vignesh Narayanan , Manas Gaur , Amit Sheth

Recent advancements in video restoration have focused on recovering high-quality video frames from low-quality inputs. Compared with static images, the performance of video restoration significantly depends on efficient exploitation of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Ranjith Merugu , Mohammad Sameer Suhail , Akshay P Sarashetti , Venkata Bharath Reddy Reddem , Pankaj Kumar Bajpai , Amit Satish Unde

We introduce TransformerFusion, a transformer-based 3D scene reconstruction approach. From an input monocular RGB video, the video frames are processed by a transformer network that fuses the observations into a volumetric feature grid…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Aljaž Božič , Pablo Palafox , Justus Thies , Angela Dai , Matthias Nießner

Image inpainting is an underdetermined inverse problem, which naturally allows diverse contents to fill up the missing or corrupted regions realistically. Prevalent approaches using convolutional neural networks (CNNs) can synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-06-02 Yingchen Yu , Fangneng Zhan , Rongliang Wu , Jianxiong Pan , Kaiwen Cui , Shijian Lu , Feiying Ma , Xuansong Xie , Chunyan Miao

Transparent object perception remains a major challenge in computer vision research, as transparency confounds both depth estimation and semantic segmentation. Recent work has explored multi-task learning frameworks to improve robustness,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Gbenga Omotara , Ramy Farag , Seyed Mohamad Ali Tousi , G. N. DeSouza

Opaque objects reconstructed by 3DGS often exhibit a falsely transparent surface, leading to inconsistent background and internal patterns under camera motion in interactive viewing. This issue stems from the ill-posed optimization in 3DGS.…

Graphics · Computer Science 2025-10-20 Aly El Hakie , Yiren Lu , Yu Yin , Michael Jenkins , Yehe Liu

The emergence of attention-based transformer models has led to their extensive use in various tasks, due to their superior generalization and transfer properties. Recent research has demonstrated that such models, when prompted…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Mir Rayat Imtiaz Hossain , Mennatullah Siam , Leonid Sigal , James J. Little

Monocular scene flow estimation aims to recover dense 3D motion from image sequences, yet most existing methods are limited to two-frame inputs, restricting temporal modeling and robustness to occlusions. We propose RAFT-MSF++, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Xunpei Sun , Zuoxun Hou , Yi Chang , Gang Chen , Wei-Shi Zheng

Recent developments in Transformers have achieved notable strides in enhancing video comprehension. Nonetheless, the O($N^2$) computation complexity associated with attention mechanisms presents substantial computational hurdles when…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Yukun Feng , Yangming Shi , Fengze Liu , Tan Yan

Semi-supervised video object segmentation (VOS) aims to segment a few moving objects in a video sequence, where these objects are specified by annotation of first frame. The optical flow has been considered in many existing semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Ziyang Liu , Jingmeng Liu , Weihai Chen , Xingming Wu , Zhengguo Li

Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this…

Computer Vision and Pattern Recognition · Computer Science 2021-03-23 Zachary Seymour , Kowshik Thopalli , Niluthpol Mithun , Han-Pang Chiu , Supun Samarasekera , Rakesh Kumar

The great potential of unsupervised monocular depth estimation has been demonstrated by many works due to low annotation cost and impressive accuracy comparable to supervised methods. To further improve the performance, recent works mainly…

Computer Vision and Pattern Recognition · Computer Science 2023-02-08 Junyu Zhu , Lina Liu , Yong Liu , Wanlong Li , Feng Wen , Hongbo Zhang

Attention mechanisms are widely used in salient object detection models based on deep learning, which can effectively promote the extraction and utilization of useful information by neural networks. However, most of the existing attention…

Computer Vision and Pattern Recognition · Computer Science 2019-07-18 Shiping Zhu , Lanyun Zhu

Utilizing well-trained representations in transfer learning often results in superior performance and faster convergence compared to training from scratch. However, even if such good representations are transferred, a model can easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 SeokHyun Seo , Jinwoo Hong , JungWoo Chae , Kyungyul Kim , Sangheum Hwang

Image editing in rectified flow models remains challenging due to the fundamental trade-off between reconstruction fidelity and editing flexibility. While inversion-based methods suffer from trajectory deviation, recent inversion-free…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Marian Lupascu , Mihai-Sorin Stupariu

Feature transformation plays a critical role in enhancing machine learning model performance by optimizing data representations. Recent state-of-the-art approaches address this task as a continuous embedding optimization problem, converting…

Machine Learning · Computer Science 2025-08-29 Yang Gao , Dongjie Wang , Scott Piersall , Ye Zhang , Liqiang Wang

Diffusion models can learn rich representations during data generation, showing potential for Self-Supervised Learning (SSL), but they face a trade-off between generative quality and discriminative performance. Their iterative sampling also…

Machine Learning · Computer Science 2025-12-24 Kosuke Ukita , Tsuyoshi Okita

Generative Adversarial Network (GAN) inversion have demonstrated excellent performance in image inpainting that aims to restore lost or damaged image texture using its unmasked content. Previous GAN inversion-based methods usually utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Libo Zhang , Yongsheng Yu , Jiali Yao , Heng Fan

Transformer-based models have recently shown success in representation learning on graph-structured data beyond natural language processing and computer vision. However, the success is limited to small-scale graphs due to the drawbacks of…

Machine Learning · Computer Science 2022-10-05 Jinyoung Park , Seongjun Yun , Hyeonjin Park , Jaewoo Kang , Jisu Jeong , Kyung-Min Kim , Jung-woo Ha , Hyunwoo J. Kim