English
Related papers

Related papers: Deep Gaussian mixture model for unsupervised image…

200 papers

The softmax cross-entropy loss function has been widely used to train deep models for various tasks. In this work, we propose a Gaussian mixture (GM) loss function for deep neural networks for visual classification. Unlike the softmax…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Weitao Wan , Jiansheng Chen , Cheng Yu , Tong Wu , Yuanyi Zhong , Ming-Hsuan Yang

Traditional supervised medical image segmentation models require large amounts of labeled data for training; however, obtaining such large-scale labeled datasets in the real world is extremely challenging. Recent semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yunyao Lu , Yihang Wu , Reem Kateb , Ahmad Chaddad

We derive an asymptotic expansion for the log likelihood of Gaussian mixture models (GMMs) with equal covariance matrices in the low signal-to-noise regime. The expansion reveals an intimate connection between two types of algorithms for…

Statistics Theory · Mathematics 2020-06-30 Anya Katsevich , Afonso Bandeira

We propose a large-margin Gaussian Mixture (L-GM) loss for deep neural networks in classification tasks. Different from the softmax cross-entropy loss, our proposal is established on the assumption that the deep features of the training set…

Computer Vision and Pattern Recognition · Computer Science 2018-03-09 Weitao Wan , Yuanyi Zhong , Tianpeng Li , Jiansheng Chen

Although Gaussian processes (GPs) with deep kernels have been successfully used for meta-learning in regression tasks, its uncertainty estimation performance can be poor. We propose a meta-learning method for calibrating deep kernel GPs for…

Machine Learning · Statistics 2023-12-14 Tomoharu Iwata , Atsutoshi Kumagai

The rapid development of deep learning has made a great progress in image segmentation, one of the fundamental tasks of computer vision. However, the current segmentation algorithms mostly rely on the availability of pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2023-02-16 Wei Shen , Zelin Peng , Xuehui Wang , Huayu Wang , Jiazhong Cen , Dongsheng Jiang , Lingxi Xie , Xiaokang Yang , Qi Tian

Existing Graph Neural Network (GNN) methods that learn inductive unsupervised graph representations focus on learning node and edge representations by predicting observed edges in the graph. Although such approaches have shown advances in…

Machine Learning · Computer Science 2020-10-12 Leonardo Cotta , Carlos H. C. Teixeira , Ananthram Swami , Bruno Ribeiro

A common problem with segmentation of medical images using neural networks is the difficulty to obtain a significant number of pixel-level annotated data for training. To address this issue, we proposed a semi-supervised segmentation…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Ange Lou , Kareem Tawfik , Xing Yao , Ziteng Liu , Jack Noble

Significant progress has been made in learning image classification neural networks under long-tail data distribution using robust training algorithms such as data re-sampling, re-weighting, and margin adjustment. Those methods, however,…

Computer Vision and Pattern Recognition · Computer Science 2022-12-05 Lechao Cheng , Chaowei Fang , Dingwen Zhang , Guanbin Li , Gang Huang

This work focuses on optimizing the hybrid quantum noise model to improve the capacity of Gaussian quantum channels using Machine Learning (ML) generated clusters. The work specifically leverages Gaussian Mixture Model (GMM) and the…

Signal Processing · Electrical Eng. & Systems 2025-01-24 Mouli Chakraborty , Anshu Mukherjee , Ioannis Krikidis , Avishek Nag , Subhash Chandra

Graph Neural Networks (GNNs) have gained considerable prominence in semi-supervised learning tasks in processing graph-structured data, primarily owing to their message-passing mechanism, which largely relies on the availability of clean…

Machine Learning · Computer Science 2024-11-07 Shuangjie Li , Baoming Zhang , Jianqing Song , Gaoli Ruan , Chongjun Wang , Junyuan Xie

While significant attention has been recently focused on designing supervised deep semantic segmentation algorithms for vision tasks, there are many domains in which sufficient supervised pixel-level labels are difficult to obtain. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-11-27 Xide Xia , Brian Kulis

The Expectation Maximization (EM) algorithm is widely used as an iterative modification to maximum likelihood estimation when the data is incomplete. We focus on a semi-supervised case to learn the model from labeled and unlabeled samples.…

Machine Learning · Computer Science 2023-01-26 Erixhen Sula , Lizhong Zheng

We present an approach to learn a dense pixel-wise labeling from image-level tags. Each image-level tag imposes constraints on the output labeling of a Convolutional Neural Network (CNN) classifier. We propose Constrained CNN (CCNN), a…

Computer Vision and Pattern Recognition · Computer Science 2015-10-20 Deepak Pathak , Philipp Krähenbühl , Trevor Darrell

This paper investigates Gaussian copula mixture models (GCMM), which are an extension of Gaussian mixture models (GMM) that incorporate copula concepts. The paper presents the mathematical definition of GCMM and explores the properties of…

Machine Learning · Computer Science 2023-05-25 Ke Wan , Alain Kornhauser

Convolutional neural networks (CNNs) provide flexible function approximations for a wide variety of applications when the input variables are in the form of images or spatial data. Although CNNs often outperform traditional statistical…

Methodology · Statistics 2024-05-24 Yeseul Jeon , Won Chang , Seonghyun Jeong , Sanghoon Han , Jaewoo Park

Despite deep convolutional neural networks achieved impressive progress in medical image computing and analysis, its paradigm of supervised learning demands a large number of annotations for training to avoid overfitting and achieving…

Computer Vision and Pattern Recognition · Computer Science 2020-12-11 Liyan Sun , Chenxin Li , Xinghao Ding , Yue Huang , Guisheng Wang , Yizhou Yu

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

In recent years, deep learning based methods have shown success in essential medical image analysis tasks such as segmentation. Post-processing and refining the results of segmentation is a common practice to decrease the misclassifications…

Image and Video Processing · Electrical Eng. & Systems 2021-08-29 Ufuk Demir , Atahan Ozer , Yusuf H. Sahin , Gozde Unal

This paper concerns pseudo labelling in segmentation. Our contribution is fourfold. Firstly, we present a new formulation of pseudo-labelling as an Expectation-Maximization (EM) algorithm for clear statistical interpretation. Secondly, we…

Computer Vision and Pattern Recognition · Computer Science 2022-09-14 Mou-Cheng Xu , Yukun Zhou , Chen Jin , Marius de Groot , Daniel C. Alexander , Neil P. Oxtoby , Yipeng Hu , Joseph Jacob