English
Related papers

Related papers: Identifiable Energy-based Representations: An Appl…

200 papers

Estimating causal effects is vital for decision making. In standard causal effect estimation, treatments are usually binary- or continuous-valued. However, in many important real-world settings, treatments can be structured,…

Machine Learning · Statistics 2024-12-02 Oriol Corcoll Andreu , Athanasios Vlontzos , Michael O'Riordan , Ciaran M. Gilligan-Lee

Energy-Based Models (EBMs) have proven to be a highly effective approach for modelling densities on finite-dimensional spaces. Their ability to incorporate domain-specific choices and constraints into the structure of the model through…

Machine Learning · Computer Science 2023-02-24 Jen Ning Lim , Sebastian Vollmer , Lorenz Wolf , Andrew Duncan

Conditional effect estimation has great scientific and policy importance because interventions may impact subjects differently depending on their characteristics. Most research has focused on estimating the conditional average treatment…

Methodology · Statistics 2023-04-25 Alec McClean , Zach Branson , Edward H. Kennedy

Evidence accumulation models (EAMs) are the dominant framework for modeling response time (RT) data from speeded decision-making tasks. While providing a good quantitative description of RT data in terms of abstract perceptual…

Neurons and Cognition · Quantitative Biology 2024-12-10 Paul I. Jaffe , Gustavo X. Santiago-Reyes , Robert J. Schafer , Patrick G. Bissett , Russell A. Poldrack

Energy-Based Models (EBMs) have been widely used for generative modeling. Contrastive Divergence (CD), a prevailing training objective for EBMs, requires sampling from the EBM with Markov Chain Monte Carlo methods (MCMCs), which leads to an…

Machine Learning · Computer Science 2023-07-06 Weijian Luo , Hao Jiang , Tianyang Hu , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

Conventional saliency prediction models typically learn a deterministic mapping from an image to its saliency map, and thus fail to explain the subjective nature of human attention. In this paper, to model the uncertainty of visual…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Jing Zhang , Jianwen Xie , Zilong Zheng , Nick Barnes

Estimation of heterogeneous causal effects - i.e., how effects of policies and treatments vary across subjects - is a fundamental task in causal inference. Many methods for estimating conditional average treatment effects (CATEs) have been…

Statistics Theory · Mathematics 2023-12-27 Edward H. Kennedy , Sivaraman Balakrishnan , James M. Robins , Larry Wasserman

Generative models typically rely on either simple latent priors (e.g., Variational Autoencoders, VAEs), which are efficient but limited, or highly expressive iterative samplers (e.g., Diffusion and Energy-based Models), which are costly and…

Machine Learning · Computer Science 2026-05-12 Prithvi Raj

For speech classification tasks, deep learning models often achieve high accuracy but exhibit shortcomings in calibration, manifesting as classifiers exhibiting overconfidence. The significance of calibration lies in its critical role in…

Audio and Speech Processing · Electrical Eng. & Systems 2024-06-27 Yaqian Hao , Chenguang Hu , Yingying Gao , Shilei Zhang , Junlan Feng

Training energy-based models (EBMs) on discrete spaces is challenging because sampling over such spaces can be difficult. We propose to train discrete EBMs with energy discrepancy (ED), a novel type of contrastive loss functional which only…

Machine Learning · Statistics 2023-07-18 Tobias Schröder , Zijing Ou , Yingzhen Li , Andrew B. Duncan

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

Causal effect estimation (CEE) provides a crucial tool for predicting the unobserved counterfactual outcome for an entity. As CEE relaxes the requirement for ``perfect'' counterfactual samples (e.g., patients with identical attributes and…

Machine Learning · Computer Science 2024-11-19 Hechuan Wen , Tong Chen , Guanhua Ye , Li Kheng Chai , Shazia Sadiq , Hongzhi Yin

Selection bias is pervasive in observational studies. For example, large scale biobanks data can exhibit ``healthy volunteer bias'' when respondents are healthier and of higher socio-economic status than the population they are meant to…

Methodology · Statistics 2026-05-14 Yiwen Qiu , Filip Kovacevic , Shimeng Huang , Peter Spirtes , Francesco Locatello

This paper studies treatment effect models in which individuals are classified into unobserved groups based on heterogeneous treatment rules. Using a finite mixture approach, we propose a marginal treatment effect (MTE) framework in which…

Econometrics · Economics 2022-05-24 Tadao Hoshino , Takahide Yanagi

This paper proposes a joint training method to learn both the variational auto-encoder (VAE) and the latent energy-based model (EBM). The joint training of VAE and latent EBM are based on an objective function that consists of three…

Computer Vision and Pattern Recognition · Computer Science 2020-06-12 Tian Han , Erik Nijkamp , Linqi Zhou , Bo Pang , Song-Chun Zhu , Ying Nian Wu

In causal inference, encouragement designs (EDs) are widely used to analyze causal effects, when randomized controlled trials (RCTs) are impractical or compliance to treatment cannot be perfectly enforced. Unlike RCTs, which directly…

Machine Learning · Computer Science 2024-12-20 Anpeng Wu , Kun Kuang , Ruoxuan Xiong , Xiangwei Chen , Zexu Sun , Fei Wu , Kun Zhang

Numerous algorithms have been developed for Conditional Average Treatment Effect (CATE) estimation. In this paper, we first highlight a common issue where many algorithms exhibit inconsistent learning behavior for the same instance across…

Machine Learning · Computer Science 2025-07-08 Yi-Fu Fu , Keng-Te Liao , Shou-De Lin

We develop new econometric methods for estimation and inference in high-dimensional panel data models with interactive fixed effects. Our approach can be regarded as a non-trivial extension of the very popular common correlated effects…

Econometrics · Economics 2025-08-11 Maximilian Ruecker , Michael Vogt , Oliver Linton , Christopher Walsh

Estimating causal effects from observational data is inherently challenging due to the lack of observable counterfactual outcomes and even the presence of unmeasured confounding. Traditional methods often rely on restrictive, untestable…

Methodology · Statistics 2025-04-07 Li Chen , Xiaotong Shen , Wei Pan

Understanding and inferencing Heterogeneous Treatment Effects (HTE) and Conditional Average Treatment Effects (CATE) are vital for developing personalized treatment recommendations. Many state-of-the-art approaches achieve inspiring…

Machine Learning · Computer Science 2024-08-28 Chan Hsu , Jun-Ting Wu , Yihuang Kang