中文
相关论文

相关论文: Coupled Diffusion-Encoder Models for Reconstructio…

200 篇论文

Generative diffusion models offer a natural choice for data augmentation when training complex vision models. However, ensuring reliability of their generative content as augmentation samples remains an open challenge. Despite a number of…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Khawar Islam , Naveed Akhtar

Understanding the coordinated activity underlying brain computations requires large-scale, simultaneous recordings from distributed neuronal structures at a cellular-level resolution. One major hurdle to design high-bandwidth,…

神经与进化计算 · 计算机科学 2018-09-18 Tong Wu , Wenfeng Zhao , Edward Keefer , Zhi Yang

Density estimation, compression and data generation are crucial tasks in artificial intelligence. Variational Auto-Encoders (VAEs) constitute a single framework to achieve these goals. Here, we present a novel class of generative models,…

机器学习 · 统计学 2021-07-07 Ioannis Gatopoulos , Jakub M. Tomczak

Reducing token count is crucial for efficient training and inference of latent diffusion models, especially at high resolution. A common strategy is to build high-compression image tokenizers with more channels per token. However, when…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Xin Cai , Zhiyuan You , Zhoutong Zhang , Tianfan Xue

The crystal diffusion variational autoencoder (CDVAE) is a machine learning model that leverages score matching to generate realistic crystal structures that preserve crystal symmetry. In this study, we leverage novel diffusion…

Unifying multimodal understanding, generation and reconstruction representation in a single tokenizer remains a key challenge in building unified models. Previous research predominantly attempts to address this in a dual encoder paradigm,…

计算机视觉与模式识别 · 计算机科学 2025-12-01 Sinan Du , Jiahao Guo , Bo Li , Shuhao Cui , Zhengzhuo Xu , Yifu Luo , Yongxian Wei , Kun Gai , Xinggang Wang , Kai Wu , Chun Yuan

Recent 3D content generation pipelines commonly employ Variational Autoencoders (VAEs) to encode shapes into compact latent representations for diffusion-based generation. However, the widely adopted uniform point sampling strategy in Shape…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Rui Chen , Jianfeng Zhang , Yixun Liang , Guan Luo , Weiyu Li , Jiarui Liu , Xiu Li , Xiaoxiao Long , Jiashi Feng , Ping Tan

Video block compressive sensing has been studied for use in resource constrained scenarios, such as wireless sensor networks, but the approach still suffers from low performance and long reconstruction time. Inspired by classical…

图像与视频处理 · 电气工程与系统科学 2021-04-02 Joseph Zammit , Ian J Wassell

Human face exhibits an inherent hierarchy in its representations (i.e., holistic facial expressions can be encoded via a set of facial action units (AUs) and their intensity). Variational (deep) auto-encoders (VAE) have shown great results…

计算机视觉与模式识别 · 计算机科学 2017-08-08 Dieu Linh Tran , Robert Walecki , Ognjen Rudovic , Stefanos Eleftheriadis , Bjørn Schuller , Maja Pantic

Understanding the structure of complex, nonstationary, high-dimensional time-evolving signals is a central challenge in scientific data analysis. In many domains, such as speech and biomedical signal processing, the ability to learn…

机器学习 · 计算机科学 2026-01-13 Ioannis Ziogas , Aamna Al Shehhi , Ahsan H. Khandoker , Leontios J. Hadjileontiadis

Variational autoencoders (VAEs) typically encode images into a compact latent space, reducing computational cost but introducing an optimization dilemma: a higher-dimensional latent space improves reconstruction fidelity but often hampers…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Xunzhi Xiang , Xingye Tian , Guiyu Zhang , Yabo Chen , Shaofeng Zhang , Xuebo Wang , Xin Tao , Qi Fan

Variational Autoencoders (VAEs) are powerful generative models capable of learning compact latent representations. However, conventional VAEs often generate relatively blurry images due to their assumption of an isotropic Gaussian latent…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Andrew Kiruluta

Variational Autoencoder (VAE), compressing videos into latent representations, is a crucial preceding component of Latent Video Diffusion Models (LVDMs). With the same reconstruction quality, the more sufficient the VAE's compression for…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Liuhan Chen , Zongjian Li , Bin Lin , Bin Zhu , Qian Wang , Shenghai Yuan , Xing Zhou , Xinhua Cheng , Li Yuan

Vector Quantized Variational AutoEncoders (VQ-VAE) are a powerful representation learning framework that can discover discrete groups of features from a speech signal without supervision. Until now, the VQ-VAE architecture has previously…

音频与语音处理 · 电气工程与系统科学 2020-05-19 Yi Zhao , Haoyu Li , Cheng-I Lai , Jennifer Williams , Erica Cooper , Junichi Yamagishi

Generative modeling and clustering are conventionally distinct tasks in machine learning. Variational Autoencoders (VAEs) have been widely explored for their ability to integrate both, providing a framework for generative clustering.…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Jorge da Silva Gonçalves , Laura Manduchi , Moritz Vandenhirtz , Julia E. Vogt

Diffusion models (DMs) have revolutionized generative learning. They utilize a diffusion process to encode data into a simple Gaussian distribution. However, encoding a complex, potentially multimodal data distribution into a single…

机器学习 · 计算机科学 2024-07-04 Yilun Xu , Gabriele Corso , Tommi Jaakkola , Arash Vahdat , Karsten Kreis

With the growing size and complexity of turbulent flow models, data compression approaches are of the utmost importance to analyze, visualize, or restart the simulations. Recently, in-situ autoencoder-based compression approaches have been…

流体动力学 · 物理学 2022-10-18 Alberto Olmo , Ahmed Zamzam , Andrew Glaws , Ryan King

Deep generative models have made rapid progress in image, text, audio, and video generation, and are increasingly being applied to structured records. For tabular data, however, generative modeling remains difficult: a dataset may contain…

机器学习 · 计算机科学 2026-05-25 Zhong Li , Qi Huang , Lincen Yang , Jiayang Shi , Zhao Yang , Niki van Stein , Thomas Bäck , Matthijs van Leeuwen

Diffusion models have gained attention for their ability to represent complex distributions and incorporate uncertainty, making them ideal for robust predictions in the presence of noisy or incomplete data. In this study, we develop and…

机器学习 · 计算机科学 2024-11-05 Yilin Zhuang , Sibo Cheng , Karthik Duraisamy

Generative models, particularly Diffusion Models (DM), have shown strong potential for Computed Tomography (CT) reconstruction serving as expressive priors for solving ill-posed inverse problems. However, diffusion-based reconstruction…

图像与视频处理 · 电气工程与系统科学 2026-03-03 Jiayang Shi , Lincen Yang , Zhong Li , Tristan Van Leeuwen , Daniel M. Pelt , K. Joost Batenburg