English
Related papers

Related papers: ClusterFormer: Clustering As A Universal Visual Le…

200 papers

In medical image segmentation, specialized computer vision techniques, notably transformers grounded in attention mechanisms and residual networks employing skip connections, have been instrumental in advancing performance. Nonetheless,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Fuchen Zheng , Xuhang Chen , Weihuang Liu , Haolun Li , Yingtie Lei , Jiahui He , Chi-Man Pun , Shounjun Zhou

Transformers have demonstrated remarkable performance in natural language processing and computer vision. However, existing vision Transformers struggle to learn from limited medical data and are unable to generalize on diverse medical…

Image and Video Processing · Electrical Eng. & Systems 2023-04-06 Yunhe Gao , Mu Zhou , Di Liu , Zhennan Yan , Shaoting Zhang , Dimitris N. Metaxas

To overcome the poor scalability of convolutional neural network, recurrent attention model(RAM) selectively choose what and where to look on the image. By directing recurrent attention model how to look the image, RAM can be even more…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Minki Chung , Sungzoon Cho

Unsupervised models can provide supplementary soft constraints to help classify new, "target" data since similar instances in the target set are more likely to share the same class label. Such models can also help detect possible…

Machine Learning · Computer Science 2012-06-06 Ayan Acharya , Eduardo R. Hruschka , Joydeep Ghosh , Sreangsu Acharyya

Clustering is an essential problem in machine learning and data mining. One vital factor that impacts clustering performance is how to learn or design the data representation (or features). Fortunately, recent advances in deep learning can…

Machine Learning · Computer Science 2015-01-14 Gang Chen

While convolution and self-attention are extensively used in learned image compression (LIC) for transform coding, this paper proposes an alternative called Contextual Clustering based LIC (CLIC) which primarily relies on clustering…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Yichi Zhang , Zhihao Duan , Ming Lu , Dandan Ding , Fengqing Zhu , Zhan Ma

Transformer has achieved great successes in learning vision and language representation, which is general across various downstream tasks. In visual control, learning transferable state representation that can transfer between different…

Computer Vision and Pattern Recognition · Computer Science 2022-06-20 Yao Mu , Shoufa Chen , Mingyu Ding , Jianyu Chen , Runjian Chen , Ping Luo

Image clustering is one of the crucial techniques in multimedia analytics and knowledge discovery. Recently, the Deep clustering method (DC), characterized by its ability to perform feature learning and cluster assignment jointly, surpasses…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Haiyang Zheng , Ruilin Zhang , Hongpeng Wang

Diffusion models, widely recognized for their success in generative tasks, have not yet been applied to clustering. We introduce Clustering via Diffusion (CLUDI), a self-supervised framework that combines the generative power of diffusion…

Artificial Intelligence · Computer Science 2025-07-31 Roy Uziel , Irit Chelly , Oren Freifeld , Ari Pakman

In this paper, we propose a novel multi-view clustering model, named Dual-space Co-training Large-scale Multi-view Clustering (DSCMC). The main objective of our approach is to enhance the clustering performance by leveraging co-training in…

Machine Learning · Computer Science 2024-01-30 Zisen Kong , Zhiqiang Fu , Dongxia Chang , Yiming Wang , Yao Zhao

Compressive learning (CL) is an emerging framework that integrates signal acquisition via compressed sensing (CS) and machine learning for inference tasks directly on a small number of measurements. It can be a promising alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-07-26 Chong Mou , Jian Zhang

Transformer models have recently garnered significant attention in image restoration due to their ability to capture long-range pixel dependencies. However, long-range attention often results in computational overhead without practical…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Qifan Li , Tianyi Liang , Xingtao Wang , Xiaopeng Fan

We initiate a study of the geometry of the visual representation space -- the information channel from the vision encoder to the action decoder -- in an image-based control pipeline learned from behavior cloning. Inspired by the phenomenon…

Machine Learning · Computer Science 2025-02-07 Han Qi , Haocheng Yin , Heng Yang

Surface reconstruction from raw point clouds has been studied for decades in the computer graphics community, which is highly demanded by modeling and rendering applications nowadays. Classic solutions, such as Poisson surface…

Graphics · Computer Science 2023-10-11 Hui Tian , Zheng Qin , Renjiao Yi , Chenyang Zhu , Kai Xu

Clustering is an unsupervised machine learning methodology where unlabeled elements/objects are grouped together aiming to the construction of well-established clusters that their elements are classified according to their similarity. The…

Machine Learning · Statistics 2023-10-20 Dimitrios Saligkaras , Vasileios E. Papageorgiou

Semantic segmentation assigns labels to pixels in images, a critical yet challenging task in computer vision. Convolutional methods, although capturing local dependencies well, struggle with long-range relationships. Vision Transformers…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Mian Muhammad Naeem Abid , Nancy Mehta , Zongwei Wu , Radu Timofte

Clustering is a widely used unsupervised learning technique involving an intensive discrete optimization problem. Associative Memory models or AMs are differentiable neural networks defining a recursive dynamical system, which have been…

Machine Learning · Computer Science 2023-06-07 Bishwajit Saha , Dmitry Krotov , Mohammed J. Zaki , Parikshit Ram

In this paper, we propose a recurrent framework for Joint Unsupervised LEarning (JULE) of deep representations and image clusters. In our framework, successive operations in a clustering algorithm are expressed as steps in a recurrent…

Computer Vision and Pattern Recognition · Computer Science 2016-06-21 Jianwei Yang , Devi Parikh , Dhruv Batra

Due to various and complicated snow degradations, single image desnowing is a challenging image restoration task. As prior arts can not handle it ideally, we propose a novel transformer, SnowFormer, which explores efficient cross-attentions…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Sixiang Chen , Tian Ye , Yun Liu , Erkang Chen

The size and the computational load of fine-tuning large-scale pre-trained neural network are becoming two major obstacles in adopting machine learning in many applications. Continual learning (CL) can serve as a remedy through enabling…

Machine Learning · Computer Science 2023-03-28 Yuliang Cai , Jesse Thomason , Mohammad Rostami