English
Related papers

Related papers: Leveraging Synthetic Data to Learn Video Stabiliza…

200 papers

Single image rain removal is a typical inverse problem in computer vision. The deep learning technique has been verified to be effective for this task and achieved state-of-the-art performance. However, previous deep learning methods need…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Wei Wei , Deyu Meng , Qian Zhao , Zongben Xu , Ying Wu

In recent years, convolutional neural network-based single image adverse weather removal methods have achieved significant performance improvements on many benchmark datasets. However, these methods require large amounts of clean-weather…

Computer Vision and Pattern Recognition · Computer Science 2022-03-18 Rajeev Yasarla , Carey E. Priebe , Vishal Patel

In the realm of deploying Machine Learning-based Advanced Driver Assistance Systems (ML-ADAS) into real-world scenarios, adverse weather conditions pose a significant challenge. Conventional ML models trained on clear weather data falter…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Muhammad Zaeem Shahzad , Muhammad Abdullah Hanif , Muhammad Shafique

Autonomous Driving (AD) systems exhibit markedly degraded performance under adverse environmental conditions, such as low illumination and precipitation. The underrepresentation of adverse conditions in AD datasets makes it challenging to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Yoel Shapiro , Yahia Showgan , Koustav Mullick

We investigate how to enhance the physical fidelity of video generation models by leveraging synthetic videos derived from computer graphics pipelines. These rendered videos respect real-world physics, such as maintaining 3D consistency,…

Image and Video Processing · Electrical Eng. & Systems 2025-03-28 Qi Zhao , Xingyu Ni , Ziyu Wang , Feng Cheng , Ziyan Yang , Lu Jiang , Bohan Wang

This paper extensively investigates the effectiveness of synthetic training data to improve the capabilities of vision-and-language models for grounding textual descriptions to image regions. We explore various strategies to best generate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Ruozhen He , Ziyan Yang , Paola Cascante-Bonilla , Alexander C. Berg , Vicente Ordonez

Videos shot by laymen using hand-held cameras contain undesirable shaky motion. Estimating the global motion between successive frames, in a manner not influenced by moving objects, is central to many video stabilization techniques, but…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Jerin Geo James , Devansh Jain , Ajit Rajwade

Computer vision tasks such as semantic segmentation perform very well in good weather conditions, but if the weather turns bad, they have problems to achieve this performance in these conditions. One possibility to obtain more robust and…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Andreas Pfeuffer , Klaus Dietmayer

Event cameras are novel sensors that output brightness changes in the form of a stream of asynchronous "events" instead of intensity frames. They offer significant advantages with respect to conventional cameras: high dynamic range (HDR),…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Daniel Gehrig , Mathias Gehrig , Javier Hidalgo-Carrió , Davide Scaramuzza

Automated vehicles require an accurate perception of their surroundings for safe and efficient driving. Lidar-based object detection is a widely used method for environment perception, but its performance is significantly affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raphael van Kempen , Tim Rehbronn , Abin Jose , Johannes Stegmaier , Bastian Lampe , Timo Woopen , Lutz Eckstein

Autonomous driving simulators provide an effective and low-cost alternative for evaluating or enhancing visual perception models. However, the reliability of evaluation depends on the diversity and realism of the generated scenes. Extreme…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Kaibin Zhou , Kaifeng Huang , Hao Deng , Zelin Tao , Ziniu Liu , Lin Zhang , Shengjie Zhao

Snow degradations present formidable challenges to the advancement of computer vision tasks by the undesirable corruption in outdoor scenarios. While current deep learning-based desnowing approaches achieve success on synthetic benchmark…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Hongtao Wu , Yijun Yang , Angelica I Aviles-Rivero , Jingjing Ren , Sixiang Chen , Haoyu Chen , Lei Zhu

Learning to synthesize high frame rate videos via interpolation requires large quantities of high frame rate training videos, which, however, are scarce, especially at high resolutions. Here, we propose unsupervised techniques to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Fitsum A. Reda , Deqing Sun , Aysegul Dundar , Mohammad Shoeybi , Guilin Liu , Kevin J. Shih , Andrew Tao , Jan Kautz , Bryan Catanzaro

Training a deep network to perform semantic segmentation requires large amounts of labeled data. To alleviate the manual effort of annotating real images, researchers have investigated the use of synthetic data, which can be labeled…

Computer Vision and Pattern Recognition · Computer Science 2018-07-18 Fatemeh Sadat Saleh , Mohammad Sadegh Aliakbarian , Mathieu Salzmann , Lars Petersson , Jose M. Alvarez

Automatically detecting vital signs in videos, such as the estimation of heart and respiration rates, is a challenging research problem in computer vision with important applications in the medical field. One of the key difficulties in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-27 Florin Condrea , Victor-Andrei Ivan , Marius Leordeanu

Robust SLAM is a crucial enabler for autonomous navigation in natural, semi-structured environments such as parks and gardens. However, these environments present unique challenges for SLAM due to frequent seasonal changes, varying light…

Removing adverse weather conditions such as rain, raindrop, and snow from images is critical for various real-world applications, including autonomous driving, surveillance, and remote sensing. However, existing multi-task approaches…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Jilong Guo , Haobo Yang , Mo Zhou , Xinyu Zhang

Human visual systems are robust to a wide range of image transformations that are challenging for artificial networks. We present the first study of image model robustness to the minute transformations found across video frames, which we…

Computer Vision and Pattern Recognition · Computer Science 2019-09-02 Keren Gu , Brandon Yang , Jiquan Ngiam , Quoc Le , Jonathon Shlens

Learning-based stereo matching models struggle in adverse weather conditions due to the scarcity of corresponding training data and the challenges in extracting discriminative features from degraded images. These limitations significantly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Yuran Wang , Yingping Liang , Yutao Hu , Ying Fu

We introduce an adaptive method with formal quality guarantees for weak supervision in a non-stationary setting. Our goal is to infer the unknown labels of a sequence of data by using weak supervision sources that provide independent noisy…

Machine Learning · Computer Science 2025-05-05 Alessio Mazzetto , Reza Esfandiarpoor , Akash Singirikonda , Eli Upfal , Stephen H. Bach