English
Related papers

Related papers: Controllable Satellite-to-Street-View Synthesis wi…

200 papers

Image harmonization aims to adjust the foreground illumination in a composite image to make it harmonious. The existing harmonization methods can only produce one deterministic result for a composite image, ignoring that a composite image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Xinhao Tao , Tianyuan Qiu , Junyan Cao , Li Niu

The advancements in the state of the art of generative Artificial Intelligence (AI) brought by diffusion models can be highly beneficial in novel contexts involving Earth observation data. After introducing this new family of generative…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Fulvio Sanguigni , Mikolaj Czerkawski , Lorenzo Papa , Irene Amerini , Bertrand Le Saux

Deep models trained using synthetic data require domain adaptation to bridge the gap between the simulation and target environments. State-of-the-art domain adaptation methods often demand sufficient amounts of (unlabelled) data from the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Mohsi Jawaid , Ethan Elms , Yasir Latif , Tat-Jun Chin

Heatwaves pose a significant threat to public health, especially as global warming intensifies. However, current routing systems (e.g., online maps) fail to incorporate shade information due to the difficulty of estimating shades directly…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Longchao Da , Xiangrui Liu , Mithun Shivakoti , Thirulogasankar Pranav Kutralingam , Yezhou Yang , Hua Wei

Image composition targets at synthesizing a realistic composite image from a pair of foreground and background images. Recently, generative composition methods are built on large pretrained diffusion models to generate composite images,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Bo Zhang , Yuxuan Duan , Jun Lan , Yan Hong , Huijia Zhu , Weiqiang Wang , Li Niu

Material reconstruction from a photograph is a key component of 3D content creation democratization. We propose to formulate this ill-posed problem as a controlled synthesis one, leveraging the recent progress in generative deep networks.…

Computer Vision and Pattern Recognition · Computer Science 2024-08-28 Giuseppe Vecchio , Rosalie Martin , Arthur Roullier , Adrien Kaiser , Romain Rouffet , Valentin Deschaintre , Tamy Boubekeur

Novel view synthesis from a sparse set of input images is a challenging problem of great practical interest, especially when camera poses are absent or inaccurate. Direct optimization of camera poses and usage of estimated depths in neural…

Computer Vision and Pattern Recognition · Computer Science 2024-06-12 Kaiwen Jiang , Yang Fu , Mukund Varma T , Yash Belhe , Xiaolong Wang , Hao Su , Ravi Ramamoorthi

View synthesis is usually done by an autoencoder, in which the encoder maps a source view image into a latent content code, and the decoder transforms it into a target view image according to the condition. However, the source contents are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Mingyu Yin , Li Sun , Qingli Li

We describe a novel learning-by-synthesis method for estimating gaze direction of an automated intelligent surveillance system. Recently, progress in learning-by-synthesis has proposed training models on synthetic images, which can…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Tongtong Zhao , Yuxiao Yan , Jinjia Peng , Zetian Mi , Xianping Fu

Novel View Synthesis (NVS) for street scenes play a critical role in the autonomous driving simulation. The current mainstream technique to achieve it is neural rendering, such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Zhongrui Yu , Haoran Wang , Jinze Yang , Hanzhang Wang , Zeke Xie , Yunfeng Cai , Jiale Cao , Zhong Ji , Mingming Sun

Estimating camera poses is a fundamental task for 3D reconstruction and remains challenging given sparsely sampled views (<10). In contrast to existing approaches that pursue top-down prediction of global parametrizations of camera…

Computer Vision and Pattern Recognition · Computer Science 2024-04-05 Jason Y. Zhang , Amy Lin , Moneish Kumar , Tzu-Hsuan Yang , Deva Ramanan , Shubham Tulsiani

Monitoring space objects is crucial for space situational awareness, yet reconstructing 3D satellite models from ground-based telescope images is challenging due to atmospheric turbulence, long observation distances, limited viewpoints, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-18 Zhiming Chang , Boyang Liu , Yifei Xia , Youming Guo , Boxin Shi , He Sun

Estimating the pose of objects through vision is essential to make robotic platforms interact with the environment. Yet, it presents many challenges, often related to the lack of flexibility and generalizability of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Francesco Di Felice , Alberto Remus , Stefano Gasperini , Benjamin Busam , Lionel Ott , Federico Tombari , Roland Siegwart , Carlo Alberto Avizzano

Diffusion models have achieved state-of-the-art results on many modalities including images, speech, and video. However, existing models are not tailored to support remote sensing data, which is widely used in important applications…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Samar Khanna , Patrick Liu , Linqi Zhou , Chenlin Meng , Robin Rombach , Marshall Burke , David Lobell , Stefano Ermon

We present a new method for lightweight novel-view synthesis that generalizes to an arbitrary forward-facing scene. Recent approaches are computationally expensive, require per-scene optimization, or produce a memory-expensive…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Pavel Solovev , Taras Khakhulin , Denis Korzhenkov

We introduce an approach to enhance the novel view synthesis from images taken from a freely moving camera. The introduced approach focuses on outdoor scenes where recovering accurate geometric scaffold and camera pose is challenging,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Nishant Jain , Suryansh Kumar , Luc Van Gool

The field of portrait image animation, driven by speech audio input, has experienced significant advancements in the generation of realistic and dynamic portraits. This research delves into the complexities of synchronizing facial movements…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Mingwang Xu , Hui Li , Qingkun Su , Hanlin Shang , Liwei Zhang , Ce Liu , Jingdong Wang , Yao Yao , Siyu Zhu

Visual servoing, the method of controlling robot motion through feedback from visual sensors, has seen significant advancements with the integration of optical flow-based methods. However, its application remains limited by inherent…

Recent advances in deep-learning based methods for image matching have demonstrated their superiority over traditional algorithms, enabling correspondence estimation in challenging scenes with significant differences in viewing angles,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Rahul Deshmukh , Avinash Kak

Most raw data download from satellites are useless, resulting in transmission waste, one solution is to process data directly on satellites, then only transmit the processed results to the ground. Image processing is the main data…

Image and Video Processing · Electrical Eng. & Systems 2019-12-11 Ling Li , Junxing Hu , Fengge Wu , Junsuo Zhao