English

Multi Kernel Estimation based Object Segmentation

Computer Vision and Pattern Recognition 2024-10-23 v1

Abstract

This paper presents a novel approach for multi-kernel estimation by enhancing the KernelGAN algorithm, which traditionally estimates a single kernel for the entire image. We introduce Multi-KernelGAN, which extends KernelGAN's capabilities by estimating two distinct kernels based on object segmentation masks. Our approach is validated through three distinct methods: texture-based patch Fast Fourier Transform (FFT) calculation, detail-based segmentation, and deep learning-based object segmentation using YOLOv8 and the Segment Anything Model (SAM). Among these methods, the combination of YOLO and SAM yields the best results for kernel estimation. Experimental results demonstrate that our multi-kernel estimation technique outperforms conventional single-kernel methods in super-resolution tasks.

Keywords

Cite

@article{arxiv.2410.17064,
  title  = {Multi Kernel Estimation based Object Segmentation},
  author = {Haim Goldfisher and Asaf Yekutiel},
  journal= {arXiv preprint arXiv:2410.17064},
  year   = {2024}
}