English
Related papers

Related papers: MUT3R: Motion-aware Updating Transformer for Dynam…

200 papers

In the domain of single-view 3D reconstruction, traditional techniques have frequently relied on expensive and time-intensive 3D annotation data. Facing the challenge of annotation acquisition, semi-supervised learning strategies offer an…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Wei Zhoua , Xinzhe Shia , Yunfeng Shea , Kunlong Liua , Yongqin Zhanga

The field of neural rendering has witnessed significant progress with advancements in generative models and differentiable rendering techniques. Though 2D diffusion has achieved success, a unified 3D diffusion pipeline remains unsettled.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Yushi Lan , Fangzhou Hong , Shangchen Zhou , Shuai Yang , Xuyi Meng , Yongwei Chen , Zhaoyang Lyu , Bo Dai , Xingang Pan , Chen Change Loy

Generalizable neural surface reconstruction techniques have attracted great attention in recent years. However, they encounter limitations of low confidence depth distribution and inaccurate surface reasoning due to the oversimplified…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Yixun Liang , Hao He , Ying-cong Chen

Temporal sentence grounding aims to localize a target segment in an untrimmed video semantically according to a given sentence query. Most previous works focus on learning frame-level features of each whole frame in the entire video, and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Daizong Liu , Xiang Fang , Wei Hu , Pan Zhou

Self-attention networks have revolutionized natural language processing and are making impressive strides in image analysis tasks such as image classification and object detection. Inspired by this success, we investigate the application of…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 Hengshuang Zhao , Li Jiang , Jiaya Jia , Philip Torr , Vladlen Koltun

Multimode optical fibres are hair-thin strands of glass that efficiently transport light. They promise next-generation medical endoscopes that provide unprecedented sub-cellular image resolution deep inside the body. However, confining…

Machine Learning · Computer Science 2024-06-13 Yijie Zheng , Robert J. Kilpatrick , David B. Phillips , George S. D. Gordon

Surface reconstruction is a fundamental problem in 3D graphics. In this paper, we propose a learning-based approach for implicit surface reconstruction from raw point clouds without normals. Our method is inspired by Gauss Lemma in…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Dong Xiao , Siyou Lin , Zuoqiang Shi , Bin Wang

Transformers have emerged as viable alternatives to convolutional neural networks owing to their ability to learn non-local region relationships in the spatial domain. The self-attention mechanism of the transformer enables transformers to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-09 Rahul G. S. , Sriprabha Ramnarayanan , Mohammad Al Fahim , Keerthi Ram , Preejith S. P , Mohanasankar Sivaprakasam

Reconstructing dynamic radiance fields from video clips is challenging, especially when entertainment videos like TV shows are given. Many challenges make the reconstruction difficult due to (1) actors occluding with each other and having…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Sangmin Kim , Seunguk Do , Daeun Lee , Jaesik Park

We propose a transformer-based neural network architecture for multi-object 3D reconstruction from RGB videos. It relies on two alternative ways to represent its knowledge: as a global 3D grid of features and an array of view-specific 2D…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Michał J. Tyszkiewicz , Kevis-Kokitsi Maninis , Stefan Popov , Vittorio Ferrari

Multi-view 3D reconstruction remains a core challenge in computer vision, particularly in applications requiring accurate and scalable representations across diverse perspectives. Current leading methods such as DUSt3R employ a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Jianing Yang , Alexander Sax , Kevin J. Liang , Mikael Henaff , Hao Tang , Ang Cao , Joyce Chai , Franziska Meier , Matt Feiszli

Unsupervised domain adaptation (UDA) in videos is a challenging task that remains not well explored compared to image-based UDA techniques. Although vision transformers (ViT) achieve state-of-the-art performance in many computer vision…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 André Sacilotti , Samuel Felipe dos Santos , Nicu Sebe , Jurandy Almeida

Monocular 3D human pose estimation technologies have the potential to greatly increase the availability of human movement data. The best-performing models for single-image 2D-3D lifting use graph convolutional networks (GCNs) that typically…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Sebastian Lutz , Richard Blythman , Koustav Ghosal , Matthew Moynihan , Ciaran Simms , Aljosa Smolic

Micro-expressions are subtle facial movements that occur spontaneously when people try to conceal real emotions. Micro-expression recognition is crucial in many fields, including criminal analysis and psychotherapy. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Guanghao Zhu , Lin Liu , Yuhao Hu , Haixin Sun , Fang Liu , Xiaohui Du , Ruqian Hao , Juanxiu Liu , Yong Liu , Hao Deng , Jing Zhang

Identifying changes in a pair of 3D aerial LiDAR point clouds, obtained during two distinct time periods over the same geographic region presents a significant challenge due to the disparities in spatial coverage and the presence of noise…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Peter Naylor , Diego Di Carlo , Arianna Traviglia , Makoto Yamada , Marco Fiorucci

Transformer models have recently garnered significant attention in image restoration due to their ability to capture long-range pixel dependencies. However, long-range attention often results in computational overhead without practical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qifan Li , Tianyi Liang , Xingtao Wang , Xiaopeng Fan

Outdoor images often suffer from severe degradation due to rain, haze, and noise, impairing image quality and challenging high-level tasks. Current image restoration methods struggle to handle complex degradation while maintaining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Huan Zhang , Xu Zhang , Nian Cai , Jianglei Di , Yun Zhang

Motion during acquisition of a set of projections can lead to significant motion artifacts in computed tomography reconstructions despite fast acquisition of individual views. In cases such as cardiac imaging, motion may be unavoidable and…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Kunal Gupta , Brendan Colvert , Francisco Contijoch

Image Matching is a core component of all best-performing algorithms and pipelines in 3D vision. Yet despite matching being fundamentally a 3D problem, intrinsically linked to camera pose and scene geometry, it is typically treated as a 2D…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Vincent Leroy , Yohann Cabon , Jérôme Revaud

Vision Transformer (ViT) has gained increasing attention in the computer vision community in recent years. However, the core component of ViT, Self-Attention, lacks explicit spatial priors and bears a quadratic computational complexity,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Qihang Fan , Huaibo Huang , Mingrui Chen , Hongmin Liu , Ran He