English
Related papers

Related papers: CMADiff: Cross-Modal Aligned Diffusion for Control…

200 papers

Proteins are complex biomolecules that perform a variety of crucial functions within living organisms. Designing and generating novel proteins can pave the way for many future synthetic biology applications, including drug discovery.…

Diffusion probabilistic models (DPMs) have become the state-of-the-art in high-quality image generation. However, DPMs have an arbitrary noisy latent space with no interpretable or controllable semantics. Although there has been significant…

Machine Learning · Computer Science 2024-08-27 Aneesh Komanduri , Chen Zhao , Feng Chen , Xintao Wu

Despite tremendous recent progress in human video generation, generative video diffusion models still struggle to capture the dynamics and physics of human motions faithfully. In this paper, we propose a new framework for human video…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Tao Hu , Varun Jampani

Diffusion-based generative models have shown promise in synthesizing histopathology images to address data scarcity caused by privacy constraints. Diagnostic text reports provide high-level semantic descriptions, and masks offer…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Mahesh Bhosale , Abdul Wasi , Yuanhao Zhai , Yunjie Tian , Samuel Border , Nan Xi , Pinaki Sarder , Junsong Yuan , David Doermann , Xuan Gong

Goal-directed molecular generation requires satisfying heterogeneous constraints such as protein--ligand compatibility and multi-objective drug-like properties, yet existing methods often optimize these constraints in isolation, failing to…

Machine Learning · Computer Science 2026-04-14 Yanting Li , Zhuoyang Jiang , Enyan Dai , Lei Wang , Wen-Cai Ye , Li Liu

Developing effective representations of protein structures is essential for advancing protein science, particularly for protein generative modeling. Current approaches often grapple with the complexities of the SE(3) manifold, rely on…

Machine Learning · Computer Science 2025-10-14 Shaoning Li , Le Zhuo , Yusong Wang , Mingyu Li , Xinheng He , Fandi Wu , Hongsheng Li , Pheng-Ann Heng

With the increasing deployment of facial image data across a wide range of applications, efficient compression tailored to facial semantics has become critical for both storage and transmission. While recent learning-based face image…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Yimin Zhou , Yichong Xia , Bin Chen , Mingyao Hong , Jiawei Li , Zhi Wang , Yaowei Wang

Continuous Conditional Diffusion Model (CCDM) is a diffusion-based framework designed to generate high-quality images conditioned on continuous regression labels. Although CCDM has demonstrated clear advantages over prior approaches across…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xin Ding , Yun Chen , Sen Zhang , Kao Zhang , Nenglun Chen , Peibei Cao , Yongwei Wang , Fei Wu

The paradigm shift toward structure-driven molecule generation has been propelled by advances in deep generative models, such as variational auto-encoders and diffusion models. However, these generative models for molecular design remain…

Machine Learning · Computer Science 2026-04-17 Peidong Liu , Wenbo Zhang , Wei Ju , Jiancheng Lv , Xianggen Liu

Text-based audio generation models have limitations as they cannot encompass all the information in audio, leading to restricted controllability when relying solely on text. To address this issue, we propose a novel model that enhances the…

Sound · Computer Science 2023-12-29 Zhifang Guo , Jianguo Mao , Rui Tao , Long Yan , Kazushige Ouchi , Hong Liu , Xiangdong Wang

Generating 3D human motion from text descriptions remains challenging due to the diverse and complex nature of human motion. While existing methods excel within the training distribution, they often struggle with out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Zongye Zhang , Bohan Kong , Qingjie Liu , Yunhong Wang

Protein design with desirable properties has been a significant challenge for many decades. Generative artificial intelligence is a promising approach and has achieved great success in various protein generation tasks. Notably, diffusion…

Generative models have achieved remarkable success in image, video, and text domains. Inspired by this, researchers have explored utilizing generative models to generate neural network parameters. However, these efforts have been limited by…

Artificial Intelligence · Computer Science 2024-08-05 Xiaolong Jin , Kai Wang , Dongwen Tang , Wangbo Zhao , Yukun Zhou , Junshu Tang , Yang You

The design of novel protein sequences with targeted functionalities underpins a central theme in protein engineering, impacting diverse fields such as drug discovery and enzymatic engineering. However, navigating this vast combinatorial…

Biomolecules · Quantitative Biology 2024-02-19 Yiheng Zhu , Zitai Kong , Jialu Wu , Weize Liu , Yuqiang Han , Mingze Yin , Hongxia Xu , Chang-Yu Hsieh , Tingjun Hou

Diffusion models offer a powerful means of capturing the manifold of realistic protein structures, enabling rapid design for protein engineering tasks. However, existing approaches observe critical failure modes when precise constraints are…

Biomolecules · Quantitative Biology 2026-03-27 Jacob K. Christopher , Austin Seamann , Jingyi Cui , Sagar Khare , Ferdinando Fioretto

Despite the success of generating high-quality images given any text prompts by diffusion-based generative models, prior works directly generate the entire images, but cannot provide object-wise manipulation capability. To support wider…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Runhui Huang , Kaixin Cai , Jianhua Han , Xiaodan Liang , Renjing Pei , Guansong Lu , Songcen Xu , Wei Zhang , Hang Xu

Multimodal neuroimaging provides complementary insights for Alzheimer's disease diagnosis, yet clinical datasets frequently suffer from missing modalities. We propose ACADiff, a framework that synthesizes missing brain imaging modalities…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Rong Zhou , Houliang Zhou , Yao Su , Brian Y. Chen , Yu Zhang , Lifang He , Alzheimer's Disease Neuroimaging Initiative

Developing bioactive molecules remains a central, time- and cost-heavy challenge in drug discovery, particularly for novel targets lacking structural or functional data. Pharmacophore modeling presents an alternative for capturing the key…

Machine Learning · Computer Science 2025-05-16 Amira Alakhdar , Barnabas Poczos , Newell Washburn

Structure-based drug design (SBDD), which aims to generate molecules that can bind tightly to the target protein, is an essential problem in drug discovery, and previous approaches have achieved initial success. However, most existing…

Machine Learning · Computer Science 2024-04-04 Xinze Li , Penglei Wang , Tianfan Fu , Wenhao Gao , Chengtao Li , Leilei Shi , Junhong Liu

Current AI-assisted protein design mainly utilizes protein sequential and structural information. Meanwhile, there exists tremendous knowledge curated by humans in the text format describing proteins' high-level functionalities. Yet,…