English
Related papers

Related papers: Flow-Aware Diffusion for Real-Time VR Restoration:…

200 papers

Real-time multi-view point cloud reconstruction is a core problem in 3D vision and immersive perception, with wide applications in VR, AR, robotic navigation, digital twins, and computer interaction. Despite advances in multi-camera systems…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Chentian Sun

Volumetric video represents a transformative advancement in visual media, enabling users to freely navigate immersive virtual experiences and narrowing the gap between digital and real worlds. However, the need for extensive manual…

Graphics · Computer Science 2024-09-16 Yuheng Jiang , Zhehao Shen , Yu Hong , Chengcheng Guo , Yize Wu , Yingliang Zhang , Jingyi Yu , Lan Xu

Full-stack multimodal interaction in real-time is a central goal in building intelligent embodied agents capable of natural, dynamic communication. However, existing systems are either limited to unimodal generation or suffer from degraded…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Xiang Deng , Feng Gao , Yong Zhang , Youxin Pang , Xu Xiaoming , Zhuoliang Kang , Xiaoming Wei , Yebin Liu

Real objects that inhabit the physical world follow physical laws and thus behave plausibly during interaction with other physical objects. However, current methods that perform 3D reconstructions of real-world scenes from multi-view 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Yuqiu Liu , Jialin Song , Marissa Ramirez de Chanlatte , Rochishnu Chowdhury , Rushil Paresh Desai , Wuyang Chen , Daniel Martin , Michael W. Mahoney

Optical flow estimation has achieved promising results in conventional scenes but faces challenges in high-speed and low-light scenes, which suffer from motion blur and insufficient illumination. These conditions lead to weakened texture…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Haonan Wang , Hanyu Zhou , Haoyue Liu , Luxin Yan

Visual SLAM is particularly challenging in environments affected by noise, varying lighting conditions, and darkness. Learning-based optical flow algorithms can leverage multiple modalities to address these challenges, but traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Youjie Zhou , Guofeng Mei , Yiming Wang , Yi Wan , Fabio Poiesi

Recent advances in 3D content generation have amplified demand for dynamic models that are both visually realistic and physically consistent. However, state-of-the-art video diffusion models frequently produce implausible results such as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Siwei Meng , Yawei Luo , Ping Liu

Background: Given that VR is applied in multiple domains, understanding the effects of cyber-sickness on human cognition and motor skills and the factors contributing to cybersickness gains urgency. This study aimed to explore the…

Human-Computer Interaction · Computer Science 2024-02-05 Panagiotis Kourtesis , Agapi Papadopoulou , Petros Roussos

Virtual Reality (VR) has the potential of becoming the next ubiquitous computing platform. Continued progress in the burgeoning field of VR depends critically on an efficient computing substrate. In particular, DRAM access energy is known…

Graphics · Computer Science 2023-10-03 Nisarg Ujjainkar , Ethan Shahan , Kenneth Chen , Budmonde Duinkharjav , Qi Sun , Yuhao Zhu

We report the first systematic evidence of hallucination in AI models of fluid dynamics, demonstrated in the canonical problem of hydrodynamically unstable transport known as viscous fingering. AI-based modeling of flow with instabilities…

Fluid Dynamics · Physics 2026-04-23 Ramdhan Wibawa , Birendra Jha

While tremendous advances in visual and auditory realism have been made for virtual and augmented reality (VR/AR), introducing a plausible sense of physicality into the virtual world remains challenging. Closing the gap between real-world…

Human-Computer Interaction · Computer Science 2022-10-05 Yunxiang Zhang , Benjamin Liang , Boyuan Chen , Paul Torrens , S. Farokh Atashzar , Dahua Lin , Qi Sun

Visually-guided underwater robots are deployed alongside human divers for cooperative exploration, inspection, and monitoring tasks in numerous shallow-water and coastal-water applications. The most essential capability of such companion…

Robotics · Computer Science 2021-07-30 Md Jahidul Islam

Although autonomous vehicles (AVs) are expected to revolutionize transportation, robust perception across a wide range of driving contexts remains a significant challenge. Techniques to fuse sensor data from camera, radar, and lidar sensors…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Arnav Vaibhav Malawade , Trier Mortlock , Mohammad Abdullah Al Faruque

3D Gaussian Splatting (3DGS) has become an emerging tool for dynamic scene reconstruction. However, existing methods focus mainly on extending static 3DGS into a time-variant representation, while overlooking the rich motion information…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhiyang Guo , Wengang Zhou , Li Li , Min Wang , Houqiang Li

Real-time moving object detection in unconstrained scenes is a difficult task due to dynamic background, changing foreground appearance and limited computational resource. In this paper, an optical flow based moving object detection…

Computer Vision and Pattern Recognition · Computer Science 2018-07-16 Junjie Huang , Wei Zou , Jiagang Zhu , Zheng Zhu

Imitation from videos often fails when expert demonstrations and learner environments exhibit domain shifts, such as discrepancies in lighting, color, or texture. While visual randomization partially addresses this problem by augmenting…

Computer Vision and Pattern Recognition · Computer Science 2025-05-27 Andrea Ramazzina , Vittorio Giammarino , Matteo El-Hariry , Mario Bijelic

Viewing omnidirectional images (ODIs) in virtual reality (VR) represents a novel form of media that provides immersive experiences for users to navigate and interact with digital content. Nonetheless, this sense of immersion can be greatly…

Human-Computer Interaction · Computer Science 2024-05-02 Zidong Cao , Zhan Wang , Yexin Liu , Yan-Pei Cao , Ying Shan , Wei Zeng , Lin Wang

As generative artificial intelligence technologies like Stable Diffusion advance, visual content becomes more vulnerable to misuse, raising concerns about copyright infringement. Visual watermarks serve as effective protection mechanisms,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 Junxian Duan , Jiyang Guan , Wenkui Yang , Ran He

In this paper, we consider the task of unsupervised object discovery in videos. Previous works have shown promising results via processing optical flows to segment objects. However, taking flow as input brings about two drawbacks. First,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Shuangrui Ding , Weidi Xie , Yabo Chen , Rui Qian , Xiaopeng Zhang , Hongkai Xiong , Qi Tian

Optical flow and disparity are two informative visual features for autonomous driving perception. They have been used for a variety of applications, such as obstacle and lane detection. The concept of "U-V-Disparity" has been widely…

Robotics · Computer Science 2023-08-04 Yi Feng , Ruge Zhang , Jiayuan Du , Qijun Chen , Rui Fan