English
Related papers

Related papers: RenderFlow: Single-Step Neural Rendering via Flow …

200 papers

Image inpainting techniques have shown significant improvements by using deep neural networks recently. However, most of them may either fail to reconstruct reasonable structures or restore fine-grained textures. In order to solve this…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Yurui Ren , Xiaoming Yu , Ruonan Zhang , Thomas H. Li , Shan Liu , Ge Li

Deep learning has shown great potential for modeling the physical dynamics of complex particle systems such as fluids. Existing approaches, however, require the supervision of consecutive particle properties, including positions and…

Machine Learning · Computer Science 2022-06-22 Shanyan Guan , Huayu Deng , Yunbo Wang , Xiaokang Yang

Neural radiance fields (NeRFs) are able to synthesize realistic novel views from multi-view images captured from distinct positions and perspectives. In NeRF's rendering pipeline, neural networks are used to represent a scene independently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Kang Han , Wei Xiang , Lu Yu

Rendering and inverse rendering are pivotal tasks in both computer vision and graphics. The rendering equation is the core of the two tasks, as an ideal conditional distribution transfer function from intrinsic properties to RGB images.…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Zhifei Chen , Tianshuo Xu , Wenhang Ge , Leyi Wu , Dongyu Yan , Jing He , Luozhou Wang , Lu Zeng , Shunsi Zhang , Yingcong Chen

Bokeh rendering simulates the shallow depth-of-field effect in photography, enhancing visual aesthetics and guiding viewer attention to regions of interest. Although recent approaches perform well, rendering controllable bokeh without…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yachuan Huang , Xianrui Luo , Qiwen Wang , Liao Shen , Jiaqi Li , Huiqiang Sun , Zihao Huang , Wei Jiang , Zhiguo Cao

Existing rectified flow models are based on linear trajectories between data and noise distributions. This linearity enforces zero curvature, which can inadvertently force the image generation process through low-probability regions of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yan Luo , Drake Du , Hao Huang , Yi Fang , Mengyu Wang

We propose pixelNeRF, a learning framework that predicts a continuous neural scene representation conditioned on one or few input images. The existing approach for constructing neural radiance fields involves optimizing the representation…

Computer Vision and Pattern Recognition · Computer Science 2021-06-01 Alex Yu , Vickie Ye , Matthew Tancik , Angjoo Kanazawa

There has recently been great interest in neural rendering methods. Some approaches use 3D geometry reconstructed with Multi-View Stereo (MVS) but cannot recover from the errors of this process, while others directly learn a volumetric…

Computer Vision and Pattern Recognition · Computer Science 2021-09-09 Georgios Kopanas , Julien Philip , Thomas Leimkühler , George Drettakis

Modeling the mechanics of fluid in complex scenes is vital to applications in design, graphics, and robotics. Learning-based methods provide fast and differentiable fluid simulators, however most prior work is unable to accurately model how…

Machine Learning · Computer Science 2023-09-12 Arjun Mani , Ishaan Preetam Chandratreya , Elliot Creager , Carl Vondrick , Richard Zemel

Flow-matching models have enabled high-quality text-to-speech synthesis, but their iterative sampling process during inference incurs substantial computational cost. Although distillation is widely used to reduce the number of inference…

Sound · Computer Science 2026-02-11 Bin Lin , Peng Yang , Chao Yan , Xiaochen Liu , Wei Wang , Boyong Wu , Pengfei Tan , Xuerui Yang

Scene flow is a challenging task aimed at jointly estimating the 3D structure and motion of the sensed environment. Although deep learning solutions achieve outstanding performance in terms of accuracy, these approaches divide the whole…

Computer Vision and Pattern Recognition · Computer Science 2019-11-25 Filippo Aleotti , Matteo Poggi , Fabio Tosi , Stefano Mattoccia

Finding a suitable layout represents a crucial task for diverse applications in graphic design. Motivated by simpler and smoother sampling trajectories, we explore the use of Flow Matching as an alternative to current diffusion-based layout…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Julian Jorge Andrade Guerreiro , Naoto Inoue , Kento Masui , Mayu Otani , Hideki Nakayama

Scene flow estimation is an extremely important task in computer vision to support the perception of dynamic changes in the scene. For robust scene flow, learning-based approaches have recently achieved impressive results using either…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Rajai Alhimdiat , Ramy Battrawy , René Schuster , Didier Stricker , Wesam Ashour

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

Scene flow estimation, which aims to predict per-point 3D displacements of dynamic scenes, is a fundamental task in the computer vision field. However, previous works commonly suffer from unreliable correlation caused by locally constrained…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Jiuming Liu , Guangming Wang , Weicai Ye , Chaokang Jiang , Jinru Han , Zhe Liu , Guofeng Zhang , Dalong Du , Hesheng Wang

Optical flow estimation is a crucial subfield of computer vision, serving as a foundation for video tasks. However, the real-world robustness is limited by animated synthetic datasets for training. This introduces domain gaps when applied…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yingping Liang , Ying Fu , Yutao Hu , Wenqi Shao , Jiaming Liu , Debing Zhang

Despite the progress of learning-based methods for 6D object pose estimation, the trade-off between accuracy and scalability for novel objects still exists. Specifically, previous methods for novel objects do not make good use of the target…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Sungphill Moon , Hyeontae Son , Dongcheol Hur , Sangwook Kim

Human action-reaction synthesis, a fundamental challenge in modeling causal human interactions, plays a critical role in applications ranging from virtual reality to social robotics. While diffusion-based models have demonstrated promising…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Wentao Jiang , Jingya Wang , Kaiyang Ji , Baoxiong Jia , Siyuan Huang , Ye Shi

Recent text-to-image diffusion models achieve impressive visual quality through extensive scaling of training data and model parameters, yet they often struggle with complex scenes and fine-grained details. Inspired by the self-reflection…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Le Zhuo , Liangbing Zhao , Sayak Paul , Yue Liao , Renrui Zhang , Yi Xin , Peng Gao , Mohamed Elhoseiny , Hongsheng Li

Diffusion- and flow-based models have emerged as state-of-the-art generative modeling approaches, but they require many sampling steps. Consistency models can distill these models into efficient one-step generators; however, unlike flow-…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Amirmojtaba Sabour , Sanja Fidler , Karsten Kreis