English
Related papers

Related papers: Knowledge Distillation for Feature Extraction in U…

200 papers

Camera-based temporal 3D object detection has shown impressive results in autonomous driving, with offline models improving accuracy by using future frames. Knowledge distillation (KD) can be an appealing framework for transferring rich…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Haowen Zheng , Hu Zhu , Lu Deng , Weihao Gu , Yang Yang , Yanyan Liang

Underwater salient object detection (USOD) has attracted increasing attention for underwater visual scene understanding and vision-guided robotic applications. However, existing USOD methods still struggle with underwater image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Lin Hong , Chenhui Wang , Linan Deng , Yuning Cui , Yu Zhang , Xin Wang , Bojian Zhang , Wenqi Ren , Xingchen Yang , Fumin Zhang

We study data-free knowledge distillation (KD) for monocular depth estimation (MDE), which learns a lightweight model for real-world depth perception tasks by compressing it from a trained teacher model while lacking training data in the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-11 Junjie Hu , Chenyou Fan , Mete Ozay , Hualie Jiang , Tin Lun Lam

The model reduction problem that eases the computation costs and latency of complex deep learning architectures has received an increasing number of investigations owing to its importance in model deployment. One promising method is…

Machine Learning · Computer Science 2018-12-04 Wei-Chun Chen , Chia-Che Chang , Chien-Yu Lu , Che-Rung Lee

In general, underwater images suffer from color distortion and low contrast, because light is attenuated and backscattered as it propagates through water (differently depending on wavelength and on the properties of the water body). An…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Tanmoy Mondal , Ricardo Mendoza , Lucas Drumetz

Deep Learning has emerged as a promising approach for skin lesion analysis. However, existing methods mostly rely on fully supervised learning, requiring extensive labeled data, which is challenging and costly to obtain. To alleviate this…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Siyamalan Manivannan

Traditionally, training neural networks to perform semantic segmentation required expensive human-made annotations. But more recently, advances in the field of unsupervised learning have made significant progress on this issue and towards…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Leon Sick , Dominik Engel , Pedro Hermosilla , Timo Ropinski

We present a novel underwater image enhancement method termed SCNet to improve the image quality meanwhile cope with the degradation diversity caused by the water. SCNet is based on normalization schemes across both spatial and channel…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Zhenqi Fu , Xiaopeng Lin , Wu Wang , Yue Huang , Xinghao Ding

With the rapid development of gravitational wave astronomy, the increasing number of detected events necessitates efficient methods for parameter estimation and model updates. This study presents a novel approach using knowledge…

General Relativity and Quantum Cosmology · Physics 2024-12-19 Xihua Zhu , Yiqian Yang , Fan Zhang

The determination of accurate bathymetric information is a key element for near offshore activities, hydrological studies such as coastal engineering applications, sedimentary processes, hydrographic surveying as well as archaeological…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Panagiotis Agrafiotis , Dimitrios Skarlatos , Andreas Georgopoulos , Konstantinos Karantzalos

This paper presents a collaborative implicit neural simultaneous localization and mapping (SLAM) system with RGB-D image sequences, which consists of complete front-end and back-end modules including odometry, loop detection, sub-map…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Jiarui Hu , Mao Mao , Hujun Bao , Guofeng Zhang , Zhaopeng Cui

Knowledge Distillation has been established as a highly promising approach for training compact and faster models by transferring knowledge from heavyweight and powerful models. However, KD in its conventional version constitutes an…

Computer Vision and Pattern Recognition · Computer Science 2021-08-27 Maria Tzelepi , Anastasios Tefas

The concept of waterbody style transfer remains largely unexplored in the underwater imaging and vision literature. Traditional image style transfer (STx) methods primarily focus on artistic and photorealistic blending, often failing to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Md Abu Bakr Siddique , Vaishnav Ramesh , Junliang Liu , Piyush Singh , Md Jahidul Islam

Side-scan sonar (SSS) is a lightweight acoustic sensor that is frequently deployed on autonomous underwater vehicles (AUVs) to provide high-resolution seafloor images. However, using side-scan images to perform simultaneous localization and…

Robotics · Computer Science 2023-12-22 Jun Zhang , Yiping Xie , Li Ling , John Folkesson

This paper reports on WaterGAN, a generative adversarial network (GAN) for generating realistic underwater images from in-air image and depth pairings in an unsupervised pipeline used for color correction of monocular underwater images.…

Computer Vision and Pattern Recognition · Computer Science 2017-10-27 Jie Li , Katherine A. Skinner , Ryan M. Eustice , Matthew Johnson-Roberson

Underwater object detection suffers from low detection performance because the distance and wavelength dependent imaging process yield evident image quality degradations such as haze-like effects, low visibility, and color distortions.…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Chenping Fu , Xin Fan , Jiewen Xiao , Wanqi Yuan , Risheng Liu , Zhongxuan Luo

This work proposes a self-supervised learning system for segmenting rigid objects in RGB images. The proposed pipeline is trained on unlabeled RGB-D videos of static objects, which can be captured with a camera carried by a mobile robot. A…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Shiyang Lu , Yunfu Deng , Abdeslam Boularias , Kostas Bekris

Underwater degraded images greatly challenge existing algorithms to detect objects of interest. Recently, researchers attempt to adopt attention mechanisms or composite connections for improving the feature representation of detectors.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Chenping Fu , Wanqi Yuan , Jiewen Xiao , Risheng Liu , Xin Fan

Underwater object detection (UOD), aiming to identify and localise the objects in underwater images or videos, presents significant challenges due to the optical distortion, water turbidity, and changing illumination in underwater scenes.…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Long Chen , Yuzhi Huang , Junyu Dong , Qi Xu , Sam Kwong , Huimin Lu , Huchuan Lu , Chongyi Li

Optimizing neural networks with noisy labels is a challenging task, especially if the label set contains real-world noise. Networks tend to generalize to reasonable patterns in the early training stages and overfit to specific details of…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Timo Kaiser , Lukas Ehmann , Christoph Reinders , Bodo Rosenhahn