English
Related papers

Related papers: Approaching an unknown communication system by lat…

200 papers

The manifold assumption for high-dimensional data assumes that the data is generated by varying a set of parameters obtained from a low-dimensional latent space. Deep generative models (DGMs) are widely used to learn data representations in…

Machine Learning · Computer Science 2022-07-19 Krithika Iyer , Riddhish Bhalodia , Shireen Elhabian

Deep learning has advanced from fully connected architectures to structured models organized into components, e.g., the transformer composed of positional elements, modular architectures divided into slots, and graph neural nets made up of…

Machine Learning · Computer Science 2021-07-13 Dianbo Liu , Alex Lamb , Kenji Kawaguchi , Anirudh Goyal , Chen Sun , Michael Curtis Mozer , Yoshua Bengio

Unseen data conditions can inflict serious performance degradation on systems relying on supervised machine learning algorithms. Because data can often be unseen, and because traditional machine learning algorithms are trained in a…

Machine Learning · Computer Science 2017-09-01 Vikramjit Mitra , Horacio Franco

Deep convolutional networks (convnets) show a remarkable ability to learn disentangled representations. In recent years, the generalization of deep learning to Lie groups beyond rigid motion in $\mathbb{R}^n$ has allowed to build convnets…

Machine Learning · Computer Science 2020-11-13 Christopher Ick , Vincent Lostanlen

Integrating deep learning and causal discovery has encouraged us to spot that learning causal structures and representations in dialogue and video is full of challenges. We defined These data forms as "Indefinite Data", characterized by…

Machine Learning · Computer Science 2024-01-17 Hang Chen , Xinyu Yang , Keqing Du

Probabilistic Latent Variable Models (LVMs) provide an alternative to self-supervised learning approaches for linguistic representation learning from speech. LVMs admit an intuitive probabilistic interpretation where the latent structure…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-09 Sameer Khurana , Antoine Laurent , Wei-Ning Hsu , Jan Chorowski , Adrian Lancucki , Ricard Marxer , James Glass

We introduce a conditional generative model for learning to disentangle the hidden factors of variation within a set of labeled observations, and separate them into complementary codes. One code summarizes the specified factors of variation…

Machine Learning · Computer Science 2016-11-11 Michael Mathieu , Junbo Zhao , Pablo Sprechmann , Aditya Ramesh , Yann LeCun

Disentangled Representation Learning aims to improve the explainability of deep learning methods by training a data encoder that identifies semantically meaningful latent variables in the data generation process. Nevertheless, there is no…

Machine Learning · Computer Science 2024-10-08 Ruoyu Wang , Lina Yao

In order to build language technologies for majority of the languages, it is important to leverage the resources available in public domain on the internet - commonly referred to as `Found Data'. However, such data is characterized by the…

Audio and Speech Processing · Electrical Eng. & Systems 2019-09-27 Nishant Gurunath , Sai Krishna Rallabandi , Alan Black

Generative modeling and self-supervised learning have in recent years made great strides towards learning from data in a completely unsupervised way. There is still however an open area of investigation into guiding a neural network to…

Machine Learning · Computer Science 2023-05-17 Vaishnavi Patil , Matthew Evanusa , Joseph JaJa

Recently several deep learning based models have been proposed for end-to-end learning of dialogs. While these models can be trained from data without the need for any additional annotations, it is hard to interpret them. On the other hand,…

Artificial Intelligence · Computer Science 2018-11-05 Dhiraj Madan , Dinesh Raghu , Gaurav Pandey , Sachindra Joshi

Recommendation models are typically trained on observational user interaction data, but the interactions between latent factors in users' decision-making processes lead to complex and entangled data. Disentangling these latent factors to…

Information Retrieval · Computer Science 2023-04-18 Siyu Wang , Xiaocong Chen , Quan Z. Sheng , Yihong Zhang , Lina Yao

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

Interpreting critical variables involved in complex biological processes related to survival time can help understand prediction from survival models, evaluate treatment efficacy, and develop new therapies for patients. Currently, the…

Machine Learning · Computer Science 2022-10-03 Xinxing Wu , Chong Peng , Richard Charnigo , Qiang Cheng

We develop the sparse VAE for unsupervised representation learning on high-dimensional data. The sparse VAE learns a set of latent factors (representations) which summarize the associations in the observed data features. The underlying…

Machine Learning · Statistics 2025-04-16 Gemma E. Moran , Dhanya Sridhar , Yixin Wang , David M. Blei

Large language models are being widely used across industries to generate content that contributes directly to key performance metrics, such as conversion rates. Pretrained models, however, often fall short when it comes to aligning with…

Machine Learning · Computer Science 2025-06-03 Erfan Loghmani

Variational autoencoders (VAEs) and other generative methods have garnered growing interest not just for their generative properties but also for the ability to dis-entangle a low-dimensional latent variable space. However, few existing…

Machine Learning · Computer Science 2023-02-14 Sunay Bhat , Jeffrey Jiang , Omead Pooladzandi , Gregory Pottie

Deep generative models can emulate the perceptual properties of complex image datasets, providing a latent representation of the data. However, manipulating such representation to perform meaningful and controllable transformations in the…

Machine Learning · Computer Science 2019-12-13 Michel Besserve , Arash Mehrjou , Rémy Sun , Bernhard Schölkopf

We consider a semantic communication system for speech signals, named DeepSC-S. Motivated by the breakthroughs in deep learning (DL), we make an effort to recover the transmitted speech signals in the semantic communication systems, which…

Audio and Speech Processing · Electrical Eng. & Systems 2021-09-09 Zhenzi Weng , Zhijin Qin , Geoffrey Ye Li

We hypothesize that optimal system responses emerge from adaptive strategies grounded in causal and counterfactual knowledge. Counterfactual inference allows us to create hypothetical scenarios to examine the effects of alternative system…

Human-Computer Interaction · Computer Science 2025-05-29 Donghuo Zeng , Roberto Legaspi , Yuewen Sun , Xinshuai Dong , Kazushi Ikeda , Peter Spirtes , Kun Zhang