中文
相关论文

相关论文: Interpretable Sentence Representation with Variati…

200 篇论文

Variational autoencoder-based voice conversion (VAE-VC) has the advantage of requiring only pairs of speeches and speaker labels for training. Unlike the majority of the research in VAE-VC which focuses on utilizing auxiliary losses or…

声音 · 计算机科学 2021-12-07 Kei Akuzawa , Kotaro Onishi , Keisuke Takiguchi , Kohki Mametani , Koichiro Mori

Sparse Autoencoders (SAEs) have been successfully used to probe Large Language Models (LLMs) and extract interpretable concepts from their internal representations. These concepts are linear combinations of neuron activations that…

计算与语言 · 计算机科学 2026-02-23 Mathis Le Bail , Jérémie Dentan , Davide Buscaldi , Sonia Vanier

A key advance in learning generative models is the use of amortized inference distributions that are jointly trained with the models. We find that existing training objectives for variational autoencoders can lead to inaccurate amortized…

机器学习 · 计算机科学 2018-05-31 Shengjia Zhao , Jiaming Song , Stefano Ermon

In this paper we demonstrate methods for reliable and efficient training of discrete representation using Vector-Quantized Variational Auto-Encoder models (VQ-VAEs). Discrete latent variable models have been shown to learn nontrivial…

We would like to learn a representation of the data which decomposes an observation into factors of variation which we can independently control. Specifically, we want to use minimal supervision to learn a latent representation that…

机器学习 · 计算机科学 2017-05-25 Diane Bouchacourt , Ryota Tomioka , Sebastian Nowozin

Integrating physics models within machine learning models holds considerable promise toward learning robust models with improved interpretability and abilities to extrapolate. In this work, we focus on the integration of incomplete physics…

机器学习 · 计算机科学 2021-10-28 Naoya Takeishi , Alexandros Kalousis

Semantically meaningful information content in perceptual signals is usually unevenly distributed. In speech signals for example, there are often many silences, and the speed of pronunciation can vary considerably. In this work, we propose…

机器学习 · 计算机科学 2021-03-11 Sander Dieleman , Charlie Nash , Jesse Engel , Karen Simonyan

We develop a framework for incorporating structured graphical models in the \emph{encoders} of variational autoencoders (VAEs) that allows us to induce interpretable representations through approximate variational inference. This allows us…

Neural latent variable models enable the discovery of interesting structure in speech audio data. This paper presents a comparison of two different approaches which are broadly based on predicting future time-steps or auto-encoding the…

音频与语音处理 · 电气工程与系统科学 2020-10-28 Henry Zhou , Alexei Baevski , Michael Auli

Recently there has been an increased interest in unsupervised learning of disentangled representations using the Variational Autoencoder (VAE) framework. Most of the existing work has focused largely on modifying the variational cost…

机器学习 · 统计学 2019-09-12 Jan Stühmer , Richard E. Turner , Sebastian Nowozin

Structured variational autoencoders (SVAEs) combine probabilistic graphical model priors on latent variables, deep neural networks to link latent variables to observed data, and structure-exploiting algorithms for approximate posterior…

机器学习 · 统计学 2023-05-29 Yixiu Zhao , Scott W. Linderman

The variational autoencoder (VAE) is a popular deep latent variable model used to analyse high-dimensional datasets by learning a low-dimensional latent representation of the data. It simultaneously learns a generative model and an…

机器学习 · 计算机科学 2023-11-21 Mine Öğretir , Siddharth Ramchandran , Dimitrios Papatheodorou , Harri Lähdesmäki

Deep learning has significantly improved time series classification, yet the lack of explainability in these models remains a major challenge. While Explainable AI (XAI) techniques aim to make model decisions more transparent, their…

机器学习 · 计算机科学 2026-02-16 Yannik Hahn , Antonin Königsfeld , Hasan Tercan , Tobias Meisen

Motivation: Despite advances in the computational analysis of high-throughput molecular profiling assays (e.g. transcriptomics), a dichotomy exists between methods that are simple and interpretable, and ones that are complex but with lower…

机器学习 · 计算机科学 2023-06-12 Pedro Henrique da Costa Avelar , Min Wu , Sophia Tsoka

By composing graphical models with deep learning architectures, we learn generative models with the strengths of both frameworks. The structured variational autoencoder (SVAE) inherits structure and interpretability from graphical models,…

机器学习 · 计算机科学 2023-11-15 Harry Bendekgey , Gabriel Hope , Erik B. Sudderth

In Emotion Recognition in Conversations (ERC), the emotions of target utterances are closely dependent on their context. Therefore, existing works train the model to generate the response of the target utterance, which aims to recognise…

计算与语言 · 计算机科学 2023-05-30 Kailai Yang , Tianlin Zhang , Sophia Ananiadou

Recently generating natural language explanations has shown very promising results in not only offering interpretable explanations but also providing additional information and supervision for prediction. However, existing approaches…

计算与语言 · 计算机科学 2022-05-30 Wangchunshu Zhou , Jinyi Hu , Hanlin Zhang , Xiaodan Liang , Maosong Sun , Chenyan Xiong , Jian Tang

Deep neural networks with discrete latent variables offer the promise of better symbolic reasoning, and learning abstractions that are more useful to new tasks. There has been a surge in interest in discrete latent variable models, however,…

机器学习 · 计算机科学 2018-07-23 Aurko Roy , Ashish Vaswani , Arvind Neelakantan , Niki Parmar

Transformer models have become state-of-the-art in decoding stimuli and behavior from neural activity, significantly advancing neuroscience research. Yet greater transparency in their decision-making processes would substantially enhance…

定量方法 · 定量生物学 2025-06-18 Laurence Freeman , Philip Shamash , Vinam Arora , Caswell Barry , Tiago Branco , Eva Dyer

Variational autoencoders (VAEs) are a popular generative model used to approximate distributions. The encoder part of the VAE is used in amortized learning of latent variables, producing a latent representation for data samples. Recently,…

机器学习 · 统计学 2023-05-12 Daniel G. Edelberg , Roy R. Lederman