English
Related papers

Related papers: A Factorial Mixture Prior for Compositional Deep G…

200 papers

Latent representations are the essence of deep generative models and determine their usefulness and power. For latent representations to be useful as generative concept representations, their latent space must support latent space…

Machine Learning · Computer Science 2019-01-01 Daniel T. Chang

Task vectors capture how a model changes during fine-tuning by recording the difference between pre-trained and task-specific weights. The composition of task vectors, a key operator in task arithmetic, enables models to integrate knowledge…

Machine Learning · Computer Science 2025-09-24 Boyuan Zhang , Yingjun Du , Xiantong Zhen , Ling Shao

Recent advances in engineering technologies have enabled the collection of a large number of longitudinal features. This wealth of information presents unique opportunities for researchers to investigate the complex nature of diseases and…

Methodology · Statistics 2023-11-27 Zihang Lu , Noirrit Kiran Chandra

The quality of data representation in deep learning methods is directly related to the prior model imposed on the representations; however, generally used fixed priors are not capable of adjusting to the context in the data. To address this…

Machine Learning · Computer Science 2013-03-18 Rakesh Chalasani , Jose C. Principe

Document editing has become a pervasive component of the production of information, with version control systems enabling edits to be efficiently stored and applied. In light of this, the task of learning distributed representations of…

Computation and Language · Computer Science 2021-01-05 Edison Marrese-Taylor , Machel Reid , Yutaka Matsuo

The vector quantization is a widely used method to map continuous representation to discrete space and has important application in tokenization for generative mode, bottlenecking information and many other tasks in machine learning. Vector…

Machine Learning · Computer Science 2024-10-15 Mingyuan Yan , Jiawei Wu , Rushi Shah , Dianbo Liu

Conditional Generative Models are now acknowledged an essential tool in Machine Learning. This paper focuses on their control. While many approaches aim at disentangling the data through the coordinate-wise control of their latent…

Machine Learning · Computer Science 2020-01-23 Victor Berger , Michèle Sebag

In data-mining applications, we are frequently faced with a large fraction of missing entries in the data matrix, which is problematic for most discriminant machine learning algorithms. A solution that we explore in this paper is the use of…

Machine Learning · Computer Science 2018-01-09 Olivier Delalleau , Aaron Courville , Yoshua Bengio

We propose a deep generative factor analysis model with beta process prior that can approximate complex non-factorial distributions over the latent codes. We outline a stochastic EM algorithm for scalable inference in a specific…

Machine Learning · Statistics 2020-11-11 Arunesh Mittal , Paul Sajda , John Paisley

In deep representational learning, it is often desired to isolate a particular factor (termed {\em content}) from other factors (referred to as {\em style}). What constitutes the content is typically specified by users through explicit…

Machine Learning · Computer Science 2020-09-08 Minyoung Kim , Vladimir Pavlovic

We propose a class of structured diffusion models, in which the prior distribution is chosen as a mixture of Gaussians, rather than a standard Gaussian distribution. The specific mixed Gaussian distribution, as prior, can be chosen to…

Machine Learning · Computer Science 2024-10-28 Nanshan Jia , Tingyu Zhu , Haoyu Liu , Zeyu Zheng

Mixtures of linear mixed models are widely used for modelling longitudinal data for which observation times differ between subjects. In typical applications, temporal trends are described using a basis expansion, with basis coefficients…

Methodology · Statistics 2025-11-25 Lucas Kock , Nadja Klein , David J. Nott

In addition to the forward inference of materials properties using machine learning, generative deep learning techniques applied on materials science allow the inverse design of materials, i.e., assessing the…

Materials Science · Physics 2024-10-01 Teng Long , Yixuan Zhang , Hongbin Zhang

Compositional structures between parts and objects are inherent in natural scenes. Modeling such compositional hierarchies via unsupervised learning can bring various benefits such as interpretability and transferability, which are…

Machine Learning · Computer Science 2019-10-22 Fei Deng , Zhuo Zhi , Sungjin Ahn

This paper presents an augmented deep factor model that generates latent factors for cross-sectional asset pricing. The conventional security sorting on firm characteristics for constructing long-short factor portfolio weights is nonlinear…

Methodology · Statistics 2024-12-11 Guanhao Feng , Jingyu He , Nicholas G. Polson , Jianeng Xu

We develop an efficient sampling approach for handling complex missing data patterns and a large number of missing observations in conditionally Gaussian state space models. Two important examples are dynamic factor models with unbalanced…

Econometrics · Economics 2023-02-08 Joshua C. C. Chan , Aubrey Poon , Dan Zhu

This paper shows that deep learning (DL) representations of data produced by generative adversarial nets (GANs) are random vectors which fall within the class of so-called \textit{concentrated} random vectors. Further exploiting the fact…

Machine Learning · Computer Science 2020-01-24 Mohamed El Amine Seddik , Cosme Louart , Mohamed Tamaazousti , Romain Couillet

We identify a new variational inference scheme for dynamical systems whose transition function is modelled by a Gaussian process. Inference in this setting has either employed computationally intensive MCMC methods, or relied on…

Machine Learning · Statistics 2019-06-14 Alessandro Davide Ialongo , Mark van der Wilk , James Hensman , Carl Edward Rasmussen

Hashing is promising for large-scale information retrieval tasks thanks to the efficiency of distance evaluation between binary codes. Generative hashing is often used to generate hashing codes in an unsupervised way. However, existing…

Computation and Language · Computer Science 2019-08-30 Wei Dong , Qinliang Su , Dinghan Shen , Changyou Chen

Combining multiple audio features can improve the performance of music tagging, but common deep learning-based feature fusion methods often lack interpretability. To address this problem, we propose a Genetic Programming (GP) pipeline that…