English
Related papers

Related papers: Automatic Trimap Generation for Image Matting

200 papers

We propose a novel neural-network-based method to perform matting of videos depicting people that does not require additional user input such as trimaps. Our architecture achieves temporal stability of the resulting alpha mattes by using…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ivan Molodetskikh , Mikhail Erofeev , Andrey Moskalenko , Dmitry Vatolin

Alpha matting is widely used in video conferencing as well as in movies, television, and social media sites. Deep learning approaches to the matte extraction problem are well suited to video conferencing due to the consistent subject matter…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Sharif Elcott , J. P. Lewis , Nori Kanazawa , Christoph Bregler

Image matting refers to predicting the alpha values of unknown foreground areas from natural images. Prior methods have focused on propagating alpha values from known to unknown regions. However, not all natural images have a specifically…

Computer Vision and Pattern Recognition · Computer Science 2022-09-07 Huanqia Cai , Fanglei Xue , Lele Xu , Lili Guo

Image matting aims to predict alpha values of elaborate uncertainty areas of natural images, like hairs, smoke, and spider web. However, existing methods perform poorly when faced with highly transparent foreground objects due to the large…

Computer Vision and Pattern Recognition · Computer Science 2023-03-14 Huanqia Cai , Fanglei Xue , Lele Xu , Lili Guo

The current state of the art alpha matting methods mainly rely on the trimap as the secondary and only guidance to estimate alpha. This paper investigates the effects of utilising the background information as well as trimap in the process…

Computer Vision and Pattern Recognition · Computer Science 2020-02-12 Hossein Javidnia , François Pitié

Over the last few years, deep learning based approaches have achieved outstanding improvements in natural image matting. However, there are still two drawbacks that impede the widespread application of image matting: the reliance on…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Yijie Zhong , Bo Li , Lv Tang , Hao Tang , Shouhong Ding

Image matting is generally modeled as a space transform from the color space to the alpha space. By estimating the alpha factor of the model, the foreground of an image can be extracted. However, there is some dimensional information…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Xuelong Li , Kang Liu , Yongsheng Dong , Dacheng Tao

In this paper, we propose an end to end solution for image matting i.e high-precision extraction of foreground objects from natural images. Image matting and background detection can be achieved easily through chroma keying in a studio…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Rishab Sharma , Rahul Deora , Anirudha Vishvakarma

Recent image matting studies are developing towards proposing trimap-free or interactive methods for complete complex image matting tasks. Although avoiding the extensive labors of trimap annotation, existing methods still suffer from two…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Dinghao Yang , Bin Wang , Weijia Li , Yiqi Lin , Conghui He

Image matting is an important vision problem. The main stream methods for it combine sampling-based methods and propagation-based methods. In this paper, we deal with the combination with a normalized weighting parameter, which could well…

Computer Vision and Pattern Recognition · Computer Science 2017-10-30 Ping Li , Tingyan Duan , Yongfeng Cao

This paper introduces an innovative approach for image matting that redefines the traditional regression-based task as a generative modeling challenge. Our method harnesses the capabilities of latent diffusion models, enriched with…

Computer Vision and Pattern Recognition · Computer Science 2024-07-31 Zhixiang Wang , Baiang Li , Jian Wang , Yu-Lun Liu , Jinwei Gu , Yung-Yu Chuang , Shin'ichi Satoh

An important step of many image editing tasks is to extract specific objects from an image in order to place them in a scene of a movie or compose them onto another background. Alpha matting describes the problem of separating the objects…

Computer Vision and Pattern Recognition · Computer Science 2021-01-26 Thomas Germer , Tobias Uelwer , Stefan Conrad , Stefan Harmeling

Image compositing is a task of combining regions from different images to compose a new image. A common use case is background replacement of portrait images. To obtain high quality composites, professionals typically manually perform…

Computer Vision and Pattern Recognition · Computer Science 2020-11-05 He Zhang , Jianming Zhang , Federico Perazzi , Zhe Lin , Vishal M. Patel

The labelling difficulty has been a longstanding problem in deep image matting. To escape from fine labels, this work explores using rough annotations such as trimaps coarsely indicating the foreground/background as supervision. We present…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Wenze Liu , Zixuan Ye , Hao Lu , Zhiguo Cao , Xiangyu Yue

Image matting is a long-standing problem in computer graphics and vision, mostly identified as the accurate estimation of the foreground in input images. We argue that the foreground objects can be represented by different-level…

Computer Vision and Pattern Recognition · Computer Science 2021-03-04 Yu Qiao , Yuhao Liu , Qiang Zhu , Xin Yang , Yuxin Wang , Qiang Zhang , Xiaopeng Wei

Image matting plays an important role in image and video editing. However, the formulation of image matting is inherently ill-posed. Traditional methods usually employ interaction to deal with the image matting problem with trimaps and…

Computer Vision and Pattern Recognition · Computer Science 2017-07-27 Bingke Zhu , Yingying Chen , Jinqiao Wang , Si Liu , Bo Zhang , Ming Tang

Cutting out an object and estimating its opacity mask, known as image matting, is a key task in many image editing applications. Deep learning approaches have made significant progress by adapting the encoder-decoder architecture of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-18 Marco Forte , François Pitié

We present a method for generating alpha mattes using a limited data source. We pretrain a novel transformerbased model (StyleMatte) on portrait datasets. We utilize this model to provide image-mask pairs for the StyleGAN3-based network…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Sergej Chicherin , Karen Efremyan

Existing color sampling based alpha matting methods use the compositing equation to estimate alpha at a pixel from pairs of foreground (F) and background (B) samples. The quality of the matte depends on the selected (F,B) pairs. In this…

Computer Vision and Pattern Recognition · Computer Science 2016-04-26 Jubin Johnson , Ehsan Shahrian Varnousfaderani , Hisham Cholakkal , Deepu Rajan

We introduce in-context matting, a novel task setting of image matting. Given a reference image of a certain foreground and guided priors such as points, scribbles, and masks, in-context matting enables automatic alpha estimation on a batch…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 He Guo , Zixuan Ye , Zhiguo Cao , Hao Lu