English
Related papers

Related papers: VQ-SAD: Vector Quantized Structure Aware Diffusion…

200 papers

Although semantic communications have exhibited satisfactory performance for a large number of tasks, the impact of semantic noise and the robustness of the systems have not been well investigated. Semantic noise refers to the misleading…

Signal Processing · Electrical Eng. & Systems 2023-04-20 Qiyu Hu , Guangyi Zhang , Zhijin Qin , Yunlong Cai , Guanding Yu , Geoffrey Ye Li

Recent methods for molecular generation face a trade-off: they either enforce strict equivariance with costly architectures or relax it to gain scalability and flexibility. We propose a frame-based diffusion paradigm that achieves…

Machine Learning · Computer Science 2025-10-07 Mohan Guo , Cong Liu , Patrick Forré

This paper introduces a novel approach for topic modeling utilizing latent codebooks from Vector-Quantized Variational Auto-Encoder~(VQ-VAE), discretely encapsulating the rich information of the pre-trained embeddings such as the…

Computation and Language · Computer Science 2024-01-23 YoungJoon Yoo , Jongwon Choi

Learning a generative model from partial data (data with missingness) is a challenging area of machine learning research. We study a specific implementation of the Auto-Encoding Variational Bayes (AEVB) algorithm, named in this paper as a…

Machine Learning · Computer Science 2021-01-05 Amir Zadeh , Yao-Chong Lim , Paul Pu Liang , Louis-Philippe Morency

The Diffusion Model has not only garnered noteworthy achievements in the realm of image generation but has also demonstrated its potential as an effective pretraining method utilizing unlabeled data. Drawing from the extensive potential…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Muzhi Zhu , Yang Liu , Zekai Luo , Chenchen Jing , Hao Chen , Guangkai Xu , Xinlong Wang , Chunhua Shen

Diffusion models have achieved great success in image synthesis through iterative noise estimation using deep neural networks. However, the slow inference, high memory consumption, and computation intensity of the noise estimation model…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Xiuyu Li , Yijiang Liu , Long Lian , Huanrui Yang , Zhen Dong , Daniel Kang , Shanghang Zhang , Kurt Keutzer

Diffusion models represent a new paradigm in text-to-image generation. Beyond generating high-quality images from text prompts, models such as Stable Diffusion have been successfully extended to the joint generation of semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Pablo Marcos-Manchón , Roberto Alcover-Couso , Juan C. SanMiguel , Jose M. Martínez

The application of language models (LMs) to molecular structure generation using line notations such as SMILES and SELFIES has been well-established in the field of cheminformatics. However, extending these models to generate 3D molecular…

Machine Learning · Computer Science 2024-12-03 Kaiyuan Gao , Yusong Wang , Haoxiang Guan , Zun Wang , Qizhi Pei , John E. Hopcroft , Kun He , Lijun Wu

Few-shot image generation, which aims to produce plausible and diverse images for one category given a few images from this category, has drawn extensive attention. Existing approaches either globally interpolate different images or fuse…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Mengping Yang , Zhe Wang , Wenyi Feng , Qian Zhang , Ting Xiao

Deep generative models have been accelerating the inverse design process in material and drug design. Unlike their counterpart property predictors in typical molecular design frameworks, generative molecular design models have seen fewer…

Machine Learning · Computer Science 2024-11-06 A N M Nafiz Abeer , Sanket Jantre , Nathan M Urban , Byung-Jun Yoon

Talking head generation with arbitrary identities and speech audio remains a crucial problem in the realm of the virtual metaverse. Recently, diffusion models have become a popular generative technique in this field with their strong…

Graphics · Computer Science 2025-08-11 Xinyang Li , Gen Li , Zhihui Lin , Yichen Qian , GongXin Yao , Weinan Jia , Aowen Wang , Weihua Chen , Fan Wang

The de novo generation of molecules with targeted properties is crucial in biology, chemistry, and drug discovery. Current generative models are limited to using single property values as conditions, struggling with complex customizations…

Machine Learning · Computer Science 2024-10-08 Yanchen Luo , Junfeng Fang , Sihang Li , Zhiyuan Liu , Jiancan Wu , An Zhang , Wenjie Du , Xiang Wang

This paper explores leveraging the Clifford algebra's expressive power for $\E(n)$-equivariant diffusion models. We utilize the geometric products between Clifford multivectors and the rich geometric information encoded in Clifford…

Machine Learning · Computer Science 2025-04-25 Cong Liu , Sharvaree Vadgama , David Ruhe , Erik Bekkers , Patrick Forré

The open-world test dataset is often mixed with out-of-distribution (OOD) samples, where the deployed models will struggle to make accurate predictions. Traditional detection methods need to trade off OOD detection and in-distribution (ID)…

Machine Learning · Computer Science 2024-04-25 Xu Shen , Yili Wang , Kaixiong Zhou , Shirui Pan , Xin Wang

Text-driven motion generation has advanced significantly with the rise of denoising diffusion models. However, previous methods often oversimplify representations for the skeletal joints, temporal frames, and textual words, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Seokhyeon Hong , Chaelin Kim , Serin Yoon , Junghyun Nam , Sihun Cha , Junyong Noh

In this paper we introduce learnable lattice vector quantization and demonstrate its effectiveness for learning discrete representations. Our method, termed LL-VQ-VAE, replaces the vector quantization layer in VQ-VAE with lattice-based…

Machine Learning · Computer Science 2023-10-17 Ahmed Khalil , Robert Piechocki , Raul Santos-Rodriguez

We introduce a fingerprint representation of molecules based on a Fourier series of atomic radial distribution functions. This fingerprint is unique (except for chirality), continuous, and differentiable with respect to atomic coordinates…

Chemical Physics · Physics 2015-03-18 O. Anatole von Lilienfeld , Raghunathan Ramakrishnan , Matthias Rupp , Aaron Knoll

Semantic communication technology emerges as a pivotal bridge connecting AI with classical communication. The current semantic communication systems are generally modeled as an Auto-Encoder (AE). AE lacks a deep integration of AI principles…

Signal Processing · Electrical Eng. & Systems 2025-05-12 Yulong Feng , Jing Xu , Liujun Hu , Guanghui Yu , Xiangyang Duan

Vectorized quantum block encoding provides a way to embed classical data into Hilbert space, offering a pathway for quantum models, such as Quantum Transformers (QT), that replace classical self-attention with quantum circuit simulations to…

Quantum Physics · Physics 2025-09-05 Ziqing Guo , Ziwen Pan , Alex Khan , Jan Balewski

Most 3D scene generation methods are limited to only generating object bounding box parameters while newer diffusion methods also generate class labels and latent features. Using object size or latent feature, they then retrieve objects…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Dasith de Silva Edirimuni , Ajmal Saeed Mian