English
Related papers

Related papers: EMC$^2$: Efficient MCMC Negative Sampling for Cont…

200 papers

In many computational problems, using the Markov Chain Monte Carlo (MCMC) can be prohibitively time-consuming. We propose MCMC-Net, a simple yet efficient way to accelerate MCMC via neural networks. The key idea of our approach is to…

Numerical Analysis · Mathematics 2025-09-16 Sudeb Majee , Anuj Abhishek , Thilo Strauss , Taufiquar Khan

Trapped by the label scarcity in molecular property prediction and drug design, graph contrastive learning (GCL) came forward. Leading contrastive learning works show two kinds of view generators, that is, random or learnable data…

Machine Learning · Computer Science 2025-01-16 Xueyuan Chen , Shangzhe Li , Ruomei Liu , Bowen Shi , Jiaheng Liu , Junran Wu , Ke Xu

Recent methods for learning unsupervised visual representations, dubbed contrastive learning, optimize the noise-contrastive estimation (NCE) bound on mutual information between two views of an image. NCE uses randomly sampled negative…

Machine Learning · Computer Science 2020-10-06 Mike Wu , Milan Mosse , Chengxu Zhuang , Daniel Yamins , Noah Goodman

Subgraph-wise sampling -- a promising class of mini-batch training techniques for graph neural networks (GNNs -- is critical for real-world applications. During the message passing (MP) in GNNs, subgraph-wise sampling methods discard…

Machine Learning · Computer Science 2024-08-22 Jie Wang , Zhihao Shi , Xize Liang , Defu Lian , Shuiwang Ji , Bin Li , Enhong Chen , Feng Wu

Learning-based synthetic multi-contrast MRI commonly involves deep models trained using high-quality images of source and target contrasts, regardless of whether source and target domain samples are paired or unpaired. This results in…

Image and Video Processing · Electrical Eng. & Systems 2021-05-13 Mahmut Yurt , Salman Ul Hassan Dar , Muzaffer Özbey , Berk Tınaz , Kader Karlı Oğuz , Tolga Çukur

In this paper, we propose an efficient pseudo-marginal Markov chain Monte Carlo (MCMC) sampling approach to draw samples from posterior shape distributions for image segmentation. The computation time of the proposed approach is independent…

Computer Vision and Pattern Recognition · Computer Science 2018-09-05 Ertunc Erdil , Sinan Yildirim , Tolga Tasdizen , Mujdat Cetin

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Contrastive learning is a method of learning visual representations by training Deep Neural Networks (DNNs) to increase the similarity between representations of positive pairs (transformations of the same image) and reduce the similarity…

Machine Learning · Computer Science 2022-10-26 Beomsu Kim , Jong Chul Ye

Representation learning has emerged as a powerful paradigm for extracting valuable latent features from complex, high-dimensional data. In financial domains, learning informative representations for assets can be used for tasks like sector…

Machine Learning · Computer Science 2024-07-29 Rian Dolphin , Barry Smyth , Ruihai Dong

Energy-Based Models (EBMs) have been widely used for generative modeling. Contrastive Divergence (CD), a prevailing training objective for EBMs, requires sampling from the EBM with Markov Chain Monte Carlo methods (MCMCs), which leads to an…

Machine Learning · Computer Science 2023-07-06 Weijian Luo , Hao Jiang , Tianyang Hu , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

Compared to widely used likelihood-based approaches, the minimum contrast (MC) method offers a computationally efficient method for estimation and inference of spatial point processes. These relative gains in computing time become more…

Methodology · Statistics 2024-07-03 Lin Zhu , Junho Yang , Mikyoung Jun , Scott Cook

Sequential optimization methods are often confronted with the curse of dimensionality in high-dimensional spaces. Current approaches under the Gaussian process framework are still burdened by the computational complexity of tracking…

Machine Learning · Computer Science 2024-01-08 Zeji Yi , Yunyue Wei , Chu Xin Cheng , Kaibo He , Yanan Sui

Recent advancements in machine learning (ML), natural language processing (NLP), and foundational models have shown promise for real-life applications in critical, albeit compute-constrainted fields like healthcare. In such areas, combining…

Machine Learning · Computer Science 2025-02-05 Georgios Margaritis , Periklis Petridis , Dimitris J. Bertsimas

Learning representations of multimodal data that are both informative and robust to missing modalities at test time remains a challenging problem due to the inherent heterogeneity of data obtained from different channels. To address it, we…

Machine Learning · Computer Science 2022-11-21 Petra Poklukar , Miguel Vasco , Hang Yin , Francisco S. Melo , Ana Paiva , Danica Kragic

In this paper, we address the problem of global-scale image geolocation, proposing a mixed classification-retrieval scheme. Unlike other methods that strictly tackle the problem as a classification or retrieval task, we combine the two…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Giorgos Kordopatis-Zilos , Panagiotis Galopoulos , Symeon Papadopoulos , Ioannis Kompatsiaris

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Medical image segmentation has been widely recognized as a pivot procedure for clinical diagnosis, analysis, and treatment planning. However, the laborious and expensive annotation process lags down the speed of further advances.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Zhuowei Li , Zihao Liu , Zhiqiang Hu , Qing Xia , Ruiqin Xiong , Shaoting Zhang , Dimitris Metaxas , Tingting Jiang

Markov Chain Monte Carlo (MCMC) algorithms are commonly used for their versatility in sampling from complicated probability distributions. However, as the dimension of the distribution gets larger, the computational costs for a satisfactory…

Cosmology and Nongalactic Astrophysics · Physics 2020-12-01 Hector J. Hortua , Riccardo Volpi , Dimitri Marinelli , Luigi Malago

Time series classification is a critical task in various domains, such as finance, healthcare, and sensor data analysis. Unsupervised contrastive learning has garnered significant interest in learning effective representations from time…

Machine Learning · Computer Science 2025-03-24 Huili Cai , Xiang Zhang , Xiaofeng Liu

Most multi-view clustering methods are limited by shallow models without sound nonlinear information perception capability, or fail to effectively exploit complementary information hidden in different views. To tackle these issues, we…

Machine Learning · Computer Science 2022-10-14 Fu Lele , Zhang Lei , Yang Jinghua , Chen Chuan , Zhang Chuanfu , Zheng Zibin