English
Related papers

Related papers: CMT-DeepLab: Clustering Mask Transformers for Pano…

200 papers

In this paper we propose a Deep Autoencoder MIxture Clustering (DAMIC) algorithm based on a mixture of deep autoencoders where each cluster is represented by an autoencoder. A clustering network transforms the data into another space and…

Machine Learning · Computer Science 2019-03-28 Shlomo E. Chazan , Sharon Gannot , Jacob Goldberger

In this paper, we propose PolyTransform, a novel instance segmentation algorithm that produces precise, geometry-preserving masks by combining the strengths of prevailing segmentation approaches and modern polygon-based methods. In…

Computer Vision and Pattern Recognition · Computer Science 2021-01-19 Justin Liang , Namdar Homayounfar , Wei-Chiu Ma , Yuwen Xiong , Rui Hu , Raquel Urtasun

Medical image segmentation typically adopts a point-wise convolutional segmentation head to predict dense labels, where each output channel is heuristically tied to a specific class. This rigid design limits both feature sharing and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Bin Xie , Gady Agam

We propose a deep clustering architecture alongside image segmentation for medical image analysis. The main idea is based on unsupervised learning to cluster images on severity of the disease in the subject's sample, and this image is then…

Image and Video Processing · Electrical Eng. & Systems 2020-05-28 Sharmin Pathan , Anant Tripathi

Continual learning for segmentation has recently seen increasing interest. However, all previous works focus on narrow semantic segmentation and disregard panoptic segmentation, an important task with real-world impacts. %a In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-28 Fabio Cermelli , Matthieu Cord , Arthur Douillard

Modern 3D semantic instance segmentation approaches predominantly rely on specialized voting mechanisms followed by carefully designed geometric clustering techniques. Building on the successes of recent Transformer-based methods for object…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Jonas Schult , Francis Engelmann , Alexander Hermans , Or Litany , Siyu Tang , Bastian Leibe

Query-based transformer has shown great potential in constructing long-range attention in many image-domain tasks, but has rarely been considered in LiDAR-based 3D object detection due to the overwhelming size of the point cloud data. In…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Zixiang Zhou , Xiangchen Zhao , Yu Wang , Panqu Wang , Hassan Foroosh

This paper introduces the COCONut-PanCap dataset, created to enhance panoptic segmentation and grounded image captioning. Building upon the COCO dataset with advanced COCONut panoptic masks, this dataset aims to overcome limitations in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Xueqing Deng , Qihang Yu , Ali Athar , Chenglin Yang , Linjie Yang , Xiaojie Jin , Xiaohui Shen , Liang-Chieh Chen

Clustering is a core task in machine learning with wide-ranging applications in data mining and pattern recognition. However, its unsupervised nature makes it inherently challenging. Many existing clustering algorithms suffer from critical…

Machine Learning · Computer Science 2025-07-29 Ahmed Shokry , Ayman Khalafallah

Unsupervised semantic segmentation aims to categorize each pixel in an image into a corresponding class without the use of annotated data. It is a widely researched area as obtaining labeled datasets is expensive. While previous works in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yau Shing Jonathan Cheung , Xi Chen , Lihe Yang , Hengshuang Zhao

Remarkable performance from Transformer networks in Natural Language Processing promote the development of these models in dealing with computer vision tasks such as image recognition and segmentation. In this paper, we introduce a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-10-26 Qi Zhong , Xian-Feng Han

Clustering is one of the fundamental tasks in computer vision and pattern recognition. Recently, deep clustering methods (algorithms based on deep learning) have attracted wide attention with their impressive performance. Most of these…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Yanhai Gan , Xinghui Dong , Huiyu Zhou , Feng Gao , Junyu Dong

As a rising task, panoptic segmentation is faced with challenges in both semantic segmentation and instance segmentation. However, in terms of speed and accuracy, existing LiDAR methods in the field are still limited. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2024-07-15 Jinke Li , Xiao He , Yang Wen , Yuan Gao , Xiaoqiang Cheng , Dan Zhang

Transformer has achieved great success in computer vision, while how to split patches in an image remains a problem. Existing methods usually use a fixed-size patch embedding which might destroy the semantics of objects. To address this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Zhiyang Chen , Yousong Zhu , Chaoyang Zhao , Guosheng Hu , Wei Zeng , Jinqiao Wang , Ming Tang

Semantic, instance, and panoptic segmentation of 3D point clouds have been addressed using task-specific models of distinct design. Thereby, the similarity of all segmentation tasks and the implicit relationship between them have not been…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Maxim Kolodiazhnyi , Anna Vorontsova , Anton Konushin , Danila Rukhovich

We propose a novel framework for image clustering that incorporates joint representation learning and clustering. Our method consists of two heads that share the same backbone network - a "representation learning" head and a "clustering"…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Kien Do , Truyen Tran , Svetha Venkatesh

Clustering is central to many data-driven application domains and has been studied extensively in terms of distance functions and grouping algorithms. Relatively little work has focused on learning representations for clustering. In this…

Machine Learning · Computer Science 2016-05-26 Junyuan Xie , Ross Girshick , Ali Farhadi

Depth completion is a long-standing challenge in computer vision, where classification-based methods have made tremendous progress in recent years. However, most existing classification-based methods rely on pre-defined pixel-shared and…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Chen Shenglun , Zhang Hong , Ma XinZhu , Wang Zhihui , Li Haojie

Unsupervised disentangled representation learning is a long-standing problem in computer vision. This work proposes a novel framework for performing image clustering from deep embeddings by combining instance-level contrastive learning with…

Machine Learning · Computer Science 2021-10-05 Ramakrishnan Sundareswaran , Jansel Herrera-Gerena , John Just , Ali Jannesari

Dense prediction tasks, such as semantic segmentation, depth estimation, and surface normal prediction, can be easily formulated as per-pixel classification (discrete outputs) or regression (continuous outputs). This per-pixel prediction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Xuan Yang , Liangzhe Yuan , Kimberly Wilber , Astuti Sharma , Xiuye Gu , Siyuan Qiao , Stephanie Debats , Huisheng Wang , Hartwig Adam , Mikhail Sirotenko , Liang-Chieh Chen