English
Related papers

Related papers: Knowledge Distillation for Feature Extraction in U…

200 papers

Detecting 3D objects from multi-view images is a fundamental problem in 3D computer vision. Recently, significant breakthrough has been made in multi-view 3D detection tasks. However, the unprecedented detection performance of these vision…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Linfeng Zhang , Yukang Shi , Hung-Shuo Tai , Zhipeng Zhang , Yuan He , Ke Wang , Kaisheng Ma

We present DistillFlow, a knowledge distillation approach to learning optical flow. DistillFlow trains multiple teacher models and a student model, where challenging transformations are applied to the input of the student model to generate…

Computer Vision and Pattern Recognition · Computer Science 2021-06-09 Pengpeng Liu , Michael R. Lyu , Irwin King , Jia Xu

Visual Simultaneous Localization and Mapping (vSLAM) is a widely used technique in robotics and computer vision that enables a robot to create a map of an unfamiliar environment using a camera sensor while simultaneously tracking its…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Yasaman Haghighi , Suryansh Kumar , Jean-Philippe Thiran , Luc Van Gool

Both accuracy and efficiency are of significant importance to the task of semantic segmentation. Existing deep FCNs suffer from heavy computations due to a series of high-resolution feature maps for preserving the detailed knowledge in…

Computer Vision and Pattern Recognition · Computer Science 2019-03-13 Tong He , Chunhua Shen , Zhi Tian , Dong Gong , Changming Sun , Youliang Yan

Owing to refraction, absorption, and scattering of light by suspended particles in water, raw underwater images suffer from low contrast, blurred details, and color distortion. These characteristics can significantly interfere with the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-24 Yuan Zhou , Kangming Yan

Underwater diving assistance and safety support robots acquire real-time diver information through onboard underwater cameras. This study introduces a breath bubble detection algorithm that utilizes unsupervised K-means clustering, thereby…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Mingyu Jeon , Yeonji Paeng , Sejin Lee

Researchers have long tried to minimize training costs in deep learning while maintaining strong generalization across diverse datasets. Emerging research on dataset distillation aims to reduce training costs by creating a small synthetic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Ahmad Sajedi , Samir Khaki , Ehsan Amjadian , Lucy Z. Liu , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Autonomous Underwater Vehicles (AUVs) and Remotely Operated Vehicles (ROVs) demand robust spatial perception capabilities, including Simultaneous Localization and Mapping (SLAM), to support both remote and autonomous tasks. Vision-based…

Robotics · Computer Science 2025-06-10 Pushyami Kaveti , Ambjorn Grimsrud Waldum , Hanumant Singh , Martin Ludvigsen

Background: Underwater images, in general, suffer from low contrast and high color distortions due to the non-uniform attenuation of the light as it propagates through the water. In addition, the degree of attenuation varies with the…

Image and Video Processing · Electrical Eng. & Systems 2022-01-20 Prasen Kumar Sharma , Ira Bisht , Arijit Sur

Classic vision-based navigation solutions, which are utilized in algorithms such as Simultaneous Localization and Mapping (SLAM), usually fail to work underwater when the water is murky and the quality of the recorded images is low. That is…

Image and Video Processing · Electrical Eng. & Systems 2019-11-12 Wenjie Chen , Mehdi Rahmati , Vidyasagar Sadhu , Dario Pompili

In recent years, coordinate-based neural implicit representations have shown promising results for the task of Simultaneous Localization and Mapping (SLAM). While achieving impressive performance on small synthetic scenes, these methods…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Kunyi Li , Michael Niemeyer , Nassir Navab , Federico Tombari

The recent success of pre-trained 2D vision models is mostly attributable to learning from large-scale datasets. However, compared with 2D image datasets, the current pre-training data of 3D point cloud is limited. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Yuan Yao , Yuanhan Zhang , Zhenfei Yin , Jiebo Luo , Wanli Ouyang , Xiaoshui Huang

Surface defect detection is one of the most essential processes for industrial quality inspection. Deep learning-based surface defect detection methods have shown great potential. However, the well-performed models usually require large…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Chen Sun , Liang Gao , Xinyu Li , Yiping Gao

Color correction for underwater images has received increasing interests, due to its critical role in facilitating available mature vision algorithms for underwater scenarios. Inspired by the stunning success of deep convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2020-02-14 Xiaodong Liu , Zhi Gao , Ben M. Chen

Feature maps contain rich information about image intensity and spatial correlation. However, previous online knowledge distillation methods only utilize the class probabilities. Thus in this paper, we propose an online knowledge…

Machine Learning · Computer Science 2020-06-09 Inseop Chung , SeongUk Park , Jangho Kim , Nojun Kwak

The purpose of this paper is to explore the use of underwater image enhancement techniques to improve keypoint detection and matching. By applying advanced deep learning models, including generative adversarial networks and convolutional…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Pedro Diaz-Garcia , Felix Escalona , Miguel Cazorla

Underwater image suffer from color cast, low contrast and hazy effect due to light absorption, refraction and scattering, which degraded the high-level application, e.g, object detection and object tracking. Recent learning-based methods…

Computer Vision and Pattern Recognition · Computer Science 2022-08-30 Yu-Wei Chen , Soo-Chang Pei

As a promising approach in model compression, knowledge distillation improves the performance of a compact model by transferring the knowledge from a cumbersome one. The kind of knowledge used to guide the training of the student is…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Tao Liu , Xi Yang , Chenshu Chen

Knowledge distillation is an effective method for training small and efficient deep learning models. However, the efficacy of a single method can degenerate when transferring to other tasks, modalities, or even other architectures. To…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Roy Miles , Ismail Elezi , Jiankang Deng

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Yang Long , Li Liu , Ling Shao , Fumin Shen , Guiguang Ding , Jungong Han