English
Related papers

Related papers: Directly Training Joint Energy-Based Models for Co…

200 papers

Deep generative models have emerged as a popular machine learning-based approach for inverse design problems in the life sciences. However, these problems often require sampling new designs that satisfy multiple properties of interest in…

Energy-based models (EBMs) estimate unnormalized densities in an elegant framework, but they are generally difficult to train. Recent work has linked EBMs to generative adversarial networks, by noting that they can be trained through a…

Machine Learning · Computer Science 2025-06-06 Cong Geng , Jia Wang , Li Chen , Zhiyong Gao , Jes Frellsen , Søren Hauberg

While deep learning-based classification is generally tackled using standardized approaches, a wide variety of techniques are employed for regression. In computer vision, one particularly popular such technique is that of confidence-based…

Machine Learning · Computer Science 2020-07-21 Fredrik K. Gustafsson , Martin Danelljan , Goutam Bhat , Thomas B. Schön

Creating large-scale datasets for training high-performance generative models is often prohibitively expensive, especially when associated attributes or annotations must be provided. As a result, merging existing datasets has become a…

Machine Learning · Statistics 2026-03-31 Yanfeng Yang , Kenji Fukumizu

We develop a novel probabilistic approach for multi-label classification that is based on the mixtures-of-experts architecture combined with recently introduced conditional tree-structured Bayesian networks. Our approach captures different…

Machine Learning · Computer Science 2014-09-17 Charmgil Hong , Iyad Batal , Milos Hauskrecht

Self-training is a powerful approach to deep learning. The key process is to find a pseudo-label for modeling. However, previous self-training algorithms suffer from the over-confidence issue brought by the hard labels, even some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

The conventional evaluation protocols on machine learning models rely heavily on a labeled, i.i.d-assumed testing dataset, which is not often present in real world applications. The Automated Model Evaluation (AutoEval) shows an alternative…

Machine Learning · Computer Science 2024-03-18 Ru Peng , Heming Zou , Haobo Wang , Yawen Zeng , Zenan Huang , Junbo Zhao

We consider learning from labeled data collected across multiple environments, where the data distribution may vary across these environments. This problem is commonly approached from a causal perspective, seeking invariant representations…

Machine Learning · Statistics 2026-04-30 Yuli Slavutsky , David M. Blei

Despite the remarkable performance of text-to-image diffusion models in image generation tasks, recent studies have raised the issue that generated images sometimes cannot capture the intended semantic contents of the text prompts, which…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Geon Yeong Park , Jeongsol Kim , Beomsu Kim , Sang Wan Lee , Jong Chul Ye

Attributes act as intermediate representations that enable parameter sharing between classes, a must when training data is scarce. We propose to view attribute-based image classification as a label-embedding problem: each class is embedded…

Computer Vision and Pattern Recognition · Computer Science 2016-10-05 Zeynep Akata , Florent Perronnin , Zaid Harchaoui , Cordelia Schmid

Set prediction is about learning to predict a collection of unordered variables with unknown interrelations. Training such models with set losses imposes the structure of a metric space over sets. We focus on stochastic and underdefined…

Machine Learning · Computer Science 2021-02-23 David W. Zhang , Gertjan J. Burghouts , Cees G. M. Snoek

Introduction. We investigate the generalization ability of models built on datasets containing a small number of subjects, recorded in single study protocols. Next, we propose and evaluate methods combining these datasets into a single,…

Machine Learning · Computer Science 2023-12-05 Gideon Vos , Kelly Trinh , Zoltan Sarnyai , Mostafa Rahimi Azghadi

Multi-target regression is concerned with the simultaneous prediction of multiple continuous target variables based on the same set of input variables. It arises in several interesting industrial and environmental application domains, such…

Machine Learning · Computer Science 2015-05-05 Grigorios Tsoumakas , Eleftherios Spyromitros-Xioufis , Aikaterini Vrekou , Ioannis Vlahavas

A key obstacle in automated analytics and meta-learning is the inability to recognize when different datasets contain measurements of the same variable. Because provided attribute labels are often uninformative in practice, this task may be…

Machine Learning · Computer Science 2019-09-12 Jonas Mueller , Alex Smola

This work proposes a method for using any generator network as the foundation of an Energy-Based Model (EBM). Our formulation posits that observed images are the sum of unobserved latent variables passed through the generator network and a…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Mitch Hill , Erik Nijkamp , Jonathan Mitchell , Bo Pang , Song-Chun Zhu

Energy-based models (EBMs) are a powerful class of probabilistic generative models due to their flexibility and interpretability. However, relationships between potential flows and explicit EBMs remain underexplored, while contrastive…

We consider deep multivariate models for heterogeneous collections of random variables. In the context of computer vision, such collections may e.g. consist of images, segmentations, image attributes, and latent variables. When developing…

Machine Learning · Computer Science 2026-02-03 Dmitrij Schlesinger , Boris Flach , Alexander Shekhovtsov

In unsupervised ensemble learning, one obtains predictions from multiple sources or classifiers, yet without knowing the reliability and expertise of each source, and with no labeled data to assess it. The task is to combine these possibly…

Machine Learning · Computer Science 2016-02-24 Ariel Jaffe , Ethan Fetaya , Boaz Nadler , Tingting Jiang , Yuval Kluger

In many supervised learning tasks, the entities to be labeled are related to each other in complex ways and their labels are not independent. For example, in hypertext classification, the labels of linked pages are highly correlated. A…

Machine Learning · Computer Science 2013-01-07 Ben Taskar , Pieter Abbeel , Daphne Koller

In this work, we propose data augmentation methods for embeddings from pre-trained deep learning models that take a weighted combination of a pair of input embeddings, as inspired by Mixup, and combine such augmentation with extra label…

Machine Learning · Computer Science 2020-10-07 Cameron R. Wolfe , Keld T. Lundgaard