中文
相关论文

相关论文: Inpaint Anything: Segment Anything Meets Image Inp…

200 篇论文

Deep image inpainting has made impressive progress with recent advances in image generation and processing algorithms. We claim that the performance of inpainting algorithms can be better judged by the generated structures and textures.…

计算机视觉与模式识别 · 计算机科学 2022-12-06 Jitesh Jain , Yuqian Zhou , Ning Yu , Humphrey Shi

During the diagnostic process, doctors incorporate multimodal information including imaging and the medical history - and similarly medical AI development has increasingly become multimodal. In this paper we tackle a more subtle challenge:…

Automatic image matting (AIM) refers to estimating the soft foreground from an arbitrary natural image without any auxiliary input like trimap, which is useful for image editing. Prior methods try to learn semantic features to aid the…

计算机视觉与模式识别 · 计算机科学 2021-07-16 Jizhizi Li , Jing Zhang , Dacheng Tao

In this work, we present SEEM, a promptable and interactive model for segmenting everything everywhere all at once in an image, as shown in Fig.1. In SEEM, we propose a novel decoding mechanism that enables diverse prompting for all types…

计算机视觉与模式识别 · 计算机科学 2023-07-13 Xueyan Zou , Jianwei Yang , Hao Zhang , Feng Li , Linjie Li , Jianfeng Wang , Lijuan Wang , Jianfeng Gao , Yong Jae Lee

The Segment Anything Model (SAM) has exhibited outstanding performance in various image segmentation tasks. Despite being trained with over a billion masks, SAM faces challenges in mask prediction quality in numerous scenarios, especially…

计算机视觉与模式识别 · 计算机科学 2024-01-25 Zhaozhi Xie , Bochen Guan , Weihao Jiang , Muyang Yi , Yue Ding , Hongtao Lu , Lei Zhang

Removing clutter from scenes is essential in many applications, ranging from privacy-concerned content filtering to data augmentation. In this work, we present an automatic system that removes clutter from 3D scenes and inpaints with…

计算机视觉与模式识别 · 计算机科学 2023-09-04 Fangyin Wei , Thomas Funkhouser , Szymon Rusinkiewicz

Image inpainting approaches have achieved significant progress with the help of deep neural networks. However, existing approaches mainly focus on leveraging the priori distribution learned by neural networks to produce a single inpainting…

计算机视觉与模式识别 · 计算机科学 2022-01-27 Wangbo Yu , Jinhao Du , Ruixin Liu , Yixuan Li , Yuesheng zhu

We present Segment Anything Model (SAM) 3, a unified model that detects, segments, and tracks objects in images and videos based on concept prompts, which we define as either short noun phrases (e.g., "yellow school bus"), image exemplars,…

This paper examines the limitations of advanced text-to-image models in accurately rendering unconventional concepts which are scarcely represented or absent in their training datasets. We identify how these limitations not only confine the…

计算机视觉与模式识别 · 计算机科学 2024-05-31 Jiyoon Myung , Jihyeon Park

Effective editing of personal content holds a pivotal role in enabling individuals to express their creativity, weaving captivating narratives within their visual stories, and elevate the overall quality and impact of their visual content.…

计算机视觉与模式识别 · 计算机科学 2024-10-04 Jing Gu , Nanxuan Zhao , Wei Xiong , Qing Liu , Zhifei Zhang , He Zhang , Jianming Zhang , HyunJoon Jung , Yilin Wang , Xin Eric Wang

This paper introduces a semi-parametric approach to image inpainting for irregular holes. The nonparametric part consists of an external image database. During test time database is used to retrieve a supplementary image, similar to the…

计算机视觉与模式识别 · 计算机科学 2018-11-15 Karim Iskakov

Current AI-assisted skin image diagnosis has achieved dermatologist-level performance in classifying skin cancer, driven by rapid advancements in deep learning architectures. However, unlike traditional vision tasks, skin images in general…

计算机视觉与模式识别 · 计算机科学 2025-01-17 Xin Hu , Janet Wang , Jihun Hamm , Rie R Yotsu , Zhengming Ding

The Segment Anything Model (SAM) is a powerful vision foundation model that is revolutionizing the traditional paradigm of segmentation. Despite this, a reliance on prompting each frame and large computational cost limit its usage in…

计算机视觉与模式识别 · 计算机科学 2024-07-03 Zijian Wu , Adam Schmidt , Peter Kazanzides , Septimiu E. Salcudean

The reliance on large labeled datasets presents a significant challenge in medical image segmentation. Few-shot learning offers a potential solution, but existing methods often still require substantial training data. This paper proposes a…

图像与视频处理 · 电气工程与系统科学 2025-03-10 Haiyue Zu , Jun Ge , Heting Xiao , Jile Xie , Zhangzhe Zhou , Yifan Meng , Jiayi Ni , Junjie Niu , Linlin Zhang , Li Ni , Huilin Yang

Recently, removing objects from videos and filling in the erased regions using deep video inpainting (VI) algorithms has attracted considerable attention. Usually, a video sequence and object segmentation masks for all frames are required…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Sangjin Lee , Suhwan Cho , Sangyoun Lee

Image composition has advanced significantly with large-scale pre-trained T2I diffusion models. Despite progress in same-domain composition, cross-domain composition remains under-explored. The main challenges are the stochastic nature of…

计算机视觉与模式识别 · 计算机科学 2025-07-29 Haowen Li , Zhenfeng Fan , Zhang Wen , Zhengzhou Zhu , Yunjin Li

Image restoration is a low-level visual task, and most CNN methods are designed as black boxes, lacking transparency and intrinsic aesthetics. Many unsupervised approaches ignore the degradation of visible information in low-light scenes,…

计算机视觉与模式识别 · 计算机科学 2023-08-01 Qihan Zhao , Xiaofeng Zhang , Hao Tang , Chaochen Gu , Shanying Zhu

Segment Anything Model (SAM), a new AI model from Meta AI released in April 2023, is an ambitious tool designed to identify and separate individual objects within a given image through semantic interpretation. The advanced capabilities of…

图像与视频处理 · 电气工程与系统科学 2024-11-06 Gabriel Bellon de Carvalho , Jurandy Almeida

The Segment Anything Model (SAM) is a recently developed large model for general-purpose segmentation for computer vision tasks. SAM was trained using 11 million images with over 1 billion masks and can produce segmentation results for a…

计算机视觉与模式识别 · 计算机科学 2023-06-22 Yizhe Zhang , Tao Zhou , Shuo Wang , Peixian Liang , Danny Z. Chen

Image inpaiting is an important task in image processing and vision. In this paper, we develop a general method for patch-based image inpainting by synthesizing new textures from existing one. A novel framework is introduced to find several…

计算机视觉与模式识别 · 计算机科学 2016-05-06 Tao Zhou , Brian Johnson , Rui Li