English
Related papers

Related papers: End-to-End Human Instance Matting

200 papers

We present a new instance segmentation approach tailored to biological images, where instances may correspond to individual cells, organisms or plant parts. Unlike instance segmentation for user photographs or road scenes, in biological…

Computer Vision and Pattern Recognition · Computer Science 2020-04-24 Victor Kulikov , Victor Lempitsky

Most previous image matting methods require a roughly-specificed trimap as input, and estimate fractional alpha values for all pixels that are in the unknown region of the trimap. In this paper, we argue that directly estimating the alpha…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Shaofan Cai , Xiaoshuai Zhang , Haoqiang Fan , Haibin Huang , Jiangyu Liu , Jiaming Liu , Jiaying Liu , Jue Wang , Jian Sun

Contour-based instance segmentation methods have developed rapidly recently but feature rough and hand-crafted front-end contour initialization, which restricts the model performance, and an empirical and fixed backend predicted-label…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Tao Zhang , Shiqing Wei , Shunping Ji

Inspired by the masked language modeling (MLM) in natural language processing tasks, the masked image modeling (MIM) has been recognized as a strong self-supervised pre-training method in computer vision. However, the high random mask ratio…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhaowen Li , Yousong Zhu , Zhiyang Chen , Wei Li , Chaoyang Zhao , Rui Zhao , Ming Tang , Jinqiao Wang

This paper addresses the problem of end-to-end (E2E) design of learning and communication in a task-oriented semantic communication system. In particular, we consider a multi-device cooperative edge inference system over a wireless…

Information Theory · Computer Science 2024-09-02 Chang Cai , Xiaojun Yuan , Ying-Jun Angela Zhang

Autonomous parking is a crucial task in the intelligent driving field. Traditional parking algorithms are usually implemented using rule-based schemes. However, these methods are less effective in complex parking scenarios due to the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Changze Li , Ziheng Ji , Zhe Chen , Tong Qin , Ming Yang

Image matting requires high-quality pixel-level human annotations to support the training of a deep model in recent literature. Whereas such annotation is costly and hard to scale, significantly holding back the development of the research.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yanda Li , Zilong Huang , Gang Yu , Ling Chen , Yunchao Wei , Jianbo Jiao

We introduce in-context matting, a novel task setting of image matting. Given a reference image of a certain foreground and guided priors such as points, scribbles, and masks, in-context matting enables automatic alpha estimation on a batch…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 He Guo , Zixuan Ye , Zhiguo Cao , Hao Lu

Person re-identification aims to robustly measure similarities between person images. The significant variation of person poses and viewing angles challenges for accurate person re-identification. The spatial layout and correspondences…

Computer Vision and Pattern Recognition · Computer Science 2018-07-31 Yantao Shen , Tong Xiao , Hongsheng Li , Shuai Yi , Xiaogang Wang

Conventional video matting outputs one alpha matte for all instances appearing in a video frame so that individual instances are not distinguished. While video instance segmentation provides time-consistent instance masks, results are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Jiachen Li , Roberto Henschel , Vidit Goel , Marianna Ohanyan , Shant Navasardyan , Humphrey Shi

The general aim of multi-focus image fusion is to gather focused regions of different images to generate a unique all-in-focus fused image. Deep learning based methods become the mainstream of image fusion by virtue of its powerful feature…

Computer Vision and Pattern Recognition · Computer Science 2022-05-26 Boyuan Ma , Xiang Yin , Di Wu , Xiaojuan Ban

Text image machine translation (TIMT) aims to translate texts embedded in images from one source language to another target language. Existing methods, both two-stage cascade and one-stage end-to-end architectures, suffer from different…

Computation and Language · Computer Science 2023-05-11 Cong Ma , Yaping Zhang , Mei Tu , Yang Zhao , Yu Zhou , Chengqing Zong

Edge detection has long been an important problem in the field of computer vision. Previous works have explored category-agnostic or category-aware edge detection. In this paper, we explore edge detection in the context of object instances.…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Xueyan Zou , Haotian Liu , Yong Jae Lee

We introduce associative embedding, a novel method for supervising convolutional neural networks for the task of detection and grouping. A number of computer vision problems can be framed in this manner including multi-person pose…

Computer Vision and Pattern Recognition · Computer Science 2017-06-12 Alejandro Newell , Zhiao Huang , Jia Deng

To address the challenging task of instance-aware human part parsing, a new bottom-up regime is proposed to learn category-level human semantic segmentation as well as multi-person pose estimation in a joint and end-to-end manner. It is a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-09 Tianfei Zhou , Wenguan Wang , Si Liu , Yi Yang , Luc Van Gool

Matching images and sentences demands a fine understanding of both modalities. In this paper, we propose a new system to discriminatively embed the image and text to a shared visual-textual space. In this field, most existing works apply…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Zhedong Zheng , Liang Zheng , Michael Garrett , Yi Yang , Mingliang Xu , Yi-Dong Shen

Image matting is a key technique for image and video editing and composition. Conventionally, deep learning approaches take the whole input image and an associated trimap to infer the alpha matte using convolutional neural networks. Such…

Computer Vision and Pattern Recognition · Computer Science 2021-01-18 Haichao Yu , Ning Xu , Zilong Huang , Yuqian Zhou , Humphrey Shi

We propose a novel neural-network-based method to perform matting of videos depicting people that does not require additional user input such as trimaps. Our architecture achieves temporal stability of the resulting alpha mattes by using…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Ivan Molodetskikh , Mikhail Erofeev , Andrey Moskalenko , Dmitry Vatolin

The most recent efforts in video matting have focused on eliminating trimap dependency since trimap annotations are expensive and trimap-based methods are less adaptable for real-time applications. Despite the latest tripmap-free methods…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Chung-Ching Lin , Jiang Wang , Kun Luo , Kevin Lin , Linjie Li , Lijuan Wang , Zicheng Liu

This paper describes an end-to-end (E2E) neural architecture for the audio rendering of small portions of display content on low resource personal computing devices. It is intended to address the problem of accessibility for vision-impaired…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-13 Liu Chen , Michael Deisher , Munir Georges