English
Related papers

Related papers: A Multi-Modal Contrastive Diffusion Model for Ther…

200 papers

Recent progresses on self-supervised 3D human action representation learning are largely attributed to contrastive learning. However, in conventional contrastive frameworks, the rich complementarity between different skeleton modalities…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Yunyao Mao , Jiajun Deng , Wengang Zhou , Zhenbo Lu , Wanli Ouyang , Houqiang Li

Despite the remarkable success of diffusion models in text-to-image generation, their effectiveness in grounded visual editing and compositional control remains challenging. Motivated by advances in self-supervised learning and in-context…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Shreya Kadambi , Risheek Garrepalli , Shubhankar Borse , Munawar Hyatt , Fatih Porikli

Diffusion models have shown excellent performance in text-to-image generation. Nevertheless, existing methods often suffer from performance bottlenecks when handling complex prompts that involve multiple objects, characteristics, and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Mingcheng Li , Xiaolu Hou , Ziyang Liu , Dingkang Yang , Ziyun Qian , Jiawei Chen , Jinjie Wei , Yue Jiang , Qingyao Xu , Lihua Zhang

Structure-based drug design (SBDD), which aims to generate 3D ligand molecules binding to target proteins, is a fundamental task in drug discovery. Existing SBDD methods typically treat protein as rigid and neglect protein structural change…

Biomolecules · Quantitative Biology 2024-10-01 Zaixi Zhang , Mengdi Wang , Qi Liu

Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and,…

Biomolecules · Quantitative Biology 2024-07-17 Leo Klarner , Tim G. J. Rudner , Garrett M. Morris , Charlotte M. Deane , Yee Whye Teh

Since its foundations, more than one hundred years ago, the field of structural biology has strived to understand and analyze the properties of molecules and their interactions by studying the structure that they take in 3D space. However,…

Biomolecules · Quantitative Biology 2023-02-27 Gabriele Corso

Diffusion models have been widely deployed in various image generation tasks, demonstrating an extraordinary connection between image and text modalities. Although prior studies have explored the vulnerability of diffusion models from the…

Machine Learning · Computer Science 2025-01-06 Dingcheng Yang , Yang Bai , Xiaojun Jia , Yang Liu , Xiaochun Cao , Wenjian Yu

Biologists frequently desire protein inhibitors for a variety of reasons, including use as research tools for understanding biological processes and application to societal problems in agriculture, healthcare, etc. Immunotherapy, for…

Machine Learning · Computer Science 2024-11-04 Po-Yu Liang , Jun Bai

Therapeutic peptides show promise in targeting previously undruggable binding sites, with recent advancements in deep generative models enabling full-atom peptide co-design for specific protein receptors. However, the critical role of…

Machine Learning · Computer Science 2026-01-09 Fang Wu , Zhengyuan Zhou , Shuting Jin , Xiangxiang Zeng , Jure Leskovec , Jinbo Xu

Advances in deep generative models shed light on de novo molecule generation with desired properties. However, molecule generation targeted for dual protein targets still faces formidable challenges including protein 3D structure data…

Peptide self-assembly prediction offers a powerful bottom-up strategy for designing biocompatible, low-toxicity materials for large-scale synthesis in a broad range of biomedical and energy applications. However, screening the vast sequence…

Biomolecules · Quantitative Biology 2026-04-23 Nuno Costa , Julija Zavadlav

Accurate diagnosis and treatment of complex diseases require integrating histological, molecular, and clinical data, yet in practice these modalities are often incomplete owing to tissue scarcity, assay cost, and workflow constraints.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Jinxi Xiang , Mingjie Li , Siyu Hou , Yijiang Chen , Xiangde Luo , Yuanfeng Ji , Xiang Zhou , Ehsan Adeli , Akshay Chaudhari , Curtis P. Langlotz , Kilian M. Pohl , Ruijiang Li

Recent advances in generative medical models are constrained by modality-specific scenarios that hinder the integration of complementary evidence from imaging, pathology, and clinical notes. This fragmentation limits their evolution into…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Jiawei Mao , Yuhan Wang , Lifeng Chen , Can Zhao , Yucheng Tang , Dong Yang , Liangqiong Qu , Daguang Xu , Yuyin Zhou

Current SMILES-based diffusion models for molecule generation typically support only unimodal constraint. They inject conditioning signals at the start of the training process and require retraining a new model from scratch whenever the…

Machine Learning · Computer Science 2025-08-21 Yunzhe Zhang , Yifei Wang , Khanh Vinh Nguyen , Pengyu Hong

Energy-Based Models (EBMs) have been widely used for generative modeling. Contrastive Divergence (CD), a prevailing training objective for EBMs, requires sampling from the EBM with Markov Chain Monte Carlo methods (MCMCs), which leads to an…

Machine Learning · Computer Science 2023-07-06 Weijian Luo , Hao Jiang , Tianyang Hu , Jiacheng Sun , Zhenguo Li , Zhihua Zhang

We study how to generate molecule conformations (i.e., 3D structures) from a molecular graph. Traditional methods, such as molecular dynamics, sample conformations via computationally expensive simulations. Recently, machine learning…

Machine Learning · Computer Science 2021-04-01 Minkai Xu , Shitong Luo , Yoshua Bengio , Jian Peng , Jian Tang

Diffusion models have enabled remarkably high-quality medical image generation, yet it is challenging to enforce anatomical constraints in generated images. To this end, we propose a diffusion model-based method that supports…

Image and Video Processing · Electrical Eng. & Systems 2024-06-21 Nicholas Konz , Yuwen Chen , Haoyu Dong , Maciej A. Mazurowski

Proteins are essential macromolecules defined by their amino acid sequences, which determine their three-dimensional structures and, consequently, their functions in all living organisms. Therefore, generative protein modeling necessitates…

Machine Learning · Computer Science 2024-10-18 Xinyou Wang , Zaixiang Zheng , Fei Ye , Dongyu Xue , Shujian Huang , Quanquan Gu

Contrastive learning has been successfully used for retrieval of semantically aligned sentences, but it often requires large batch sizes or careful engineering to work well. In this paper, we instead propose a generative model for learning…

Computation and Language · Computer Science 2023-06-06 John Wieting , Jonathan H. Clark , William W. Cohen , Graham Neubig , Taylor Berg-Kirkpatrick

We present the Melody-Guided Music Generation (MG2) model, a novel approach using melody to guide the text-to-music generation that, despite a simple method and limited resources, achieves excellent performance. Specifically, we first align…

Sound · Computer Science 2024-12-31 Shaopeng Wei , Manzhen Wei , Haoyu Wang , Yu Zhao , Gang Kou