English
Related papers

Related papers: TextOmics-Guided Diffusion for Hit-like Molecular …

200 papers

The task of deducing three-dimensional molecular configurations from their two-dimensional graph representations holds paramount importance in the fields of computational chemistry and pharmaceutical development. The rapid advancement of…

Biomolecules · Quantitative Biology 2025-01-09 Bobin Yang , Jie Deng , Zhenghan Chen , Ruoxue Wu

Text-to-image (T2I) diffusion models (DMs) have shown promise in generating high-quality images from textual descriptions. The real-world applications of these models require particular attention to their safety and fidelity, but this has…

Cryptography and Security · Computer Science 2023-06-26 Hongcheng Gao , Hao Zhang , Yinpeng Dong , Zhijie Deng

The recent wave of large-scale text-to-image diffusion models has dramatically increased our text-based image generation abilities. These models can generate realistic images for a staggering variety of prompts and exhibit impressive…

Machine Learning · Computer Science 2023-09-14 Alexander C. Li , Mihir Prabhudesai , Shivam Duggal , Ellis Brown , Deepak Pathak

While various models and computational tools have been proposed for structure and property analysis of molecules, generating molecules that conform to all desired structures and properties remains a challenge. Here, we introduce a…

Computation and Language · Computer Science 2024-10-11 Peng Zhou , Jianmin Wang , Chunyan Li , Zixu Wang , Yiping Liu , Siqi Sun , Jianxin Lin , Leyi Wei , Xibao Cai , Houtim Lai , Wei Liu , Longyue Wang , Yuansheng Liu , Xiangxiang Zeng

Most existing evaluations of text-to-motion generation focus on in-distribution textual inputs and a limited set of evaluation criteria, which restricts their ability to systematically assess model generalization and motion generation…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Bin Yang , Rong Ou , Weisheng Xu , Jiaqi Xiong , Xintao Li , Taowen Wang , Luyu Zhu , Xu Jiang , Jing Tan , Renjing Xu

Symbolic music generation aims to create musical notes, which can help users compose music, such as generating target instrument tracks based on provided source tracks. In practical scenarios where there's a predefined ensemble of tracks…

Sound · Computer Science 2023-10-02 Ang Lv , Xu Tan , Peiling Lu , Wei Ye , Shikun Zhang , Jiang Bian , Rui Yan

Token communications is an emerging generative semantic communication concept that reduces transmission rates by using context and transformer-based token processing, with tokens serving as universal semantic units. In this paper, we…

Information Theory · Computer Science 2025-07-11 Li Qiao , Mahdi Boloursaz Mashhadi , Zhen Gao , Deniz Gündüz

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Macrocycles are ring-shaped molecules that offer a promising alternative to small-molecule drugs due to their enhanced selectivity and binding affinity against difficult targets. Despite their chemical value, they remain underexplored in…

Recent advances in text-to-music generation models have opened new avenues in musical creativity. However, music generation usually involves iterative refinements, and how to edit the generated music remains a significant challenge. This…

Generative models for molecules based on sequential line notation (e.g. SMILES) or graph representation have attracted an increasing interest in the field of structure-based drug design, but they struggle to capture important 3D spatial…

Machine Learning · Computer Science 2023-12-12 Wei Feng , Lvwei Wang , Zaiyun Lin , Yanhao Zhu , Han Wang , Jianqiang Dong , Rong Bai , Huting Wang , Jielong Zhou , Wei Peng , Bo Huang , Wenbiao Zhou

Diffusion model, a new generative modelling paradigm, has achieved great success in image, audio, and video generation. However, considering the discrete categorical nature of text, it is not trivial to extend continuous diffusion models to…

Computation and Language · Computer Science 2023-05-23 Hongyi Yuan , Zheng Yuan , Chuanqi Tan , Fei Huang , Songfang Huang

Text-to-image generation (TTI) refers to the usage of models that could process text input and generate high fidelity images based on text descriptions. Text-to-image generation using neural networks could be traced back to the emergence of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Fengxiang Bie , Yibo Yang , Zhongzhu Zhou , Adam Ghanem , Minjia Zhang , Zhewei Yao , Xiaoxia Wu , Connor Holmes , Pareesa Golnari , David A. Clifton , Yuxiong He , Dacheng Tao , Shuaiwen Leon Song

Masked Diffusion Models (MDMs) have emerged as a powerful generative modeling technique. Despite their remarkable results, they typically suffer from slow inference with several steps. In this paper, we propose Di$\mathtt{[M]}$O, a novel…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Yuanzhi Zhu , Xi Wang , Stéphane Lathuilière , Vicky Kalogeiton

Recently, 3D generative models have shown promising performances in structure-based drug design by learning to generate ligands given target binding sites. However, only modeling the target-ligand distribution can hardly fulfill one of the…

Biomolecules · Quantitative Biology 2024-03-22 Xiangxin Zhou , Xiwei Cheng , Yuwei Yang , Yu Bao , Liang Wang , Quanquan Gu

Elucidating reaction mechanisms hinges on efficiently generating transition states (TSs), products, and complete reaction networks. Recent generative models, such as diffusion models for TS sampling and sequence-based architectures for…

Chemical Physics · Physics 2025-11-06 Ping Tuo , Jiale Chen , Ju Li

Recent advancements in generative models have revolutionized the field of artificial intelligence, enabling the creation of highly-realistic and detailed images. In this study, we propose a novel Mask Conditional Text-to-Image Generative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Rami Skaik , Leonardo Rossi , Tomaso Fontanini , Andrea Prati

The paradigm shift toward structure-driven molecule generation has been propelled by advances in deep generative models, such as variational auto-encoders and diffusion models. However, these generative models for molecular design remain…

Machine Learning · Computer Science 2026-04-17 Peidong Liu , Wenbo Zhang , Wei Ju , Jiancheng Lv , Xianggen Liu

Cross-modality data translation has attracted great interest in image computing. Deep generative models (\textit{e.g.}, GANs) show performance improvement in tackling those problems. Nevertheless, as a fundamental challenge in image…

Computer Vision and Pattern Recognition · Computer Science 2023-02-01 Zihao Wang , Yingyu Yang , Maxime Sermesant , Hervé Delingette , Ona Wu

Diffusion models have revitalized the image generation domain, playing crucial roles in both academic research and artistic expression. With the emergence of new diffusion models, assessing the performance of text-to-image models has become…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Chutian Meng , Fan Ma , Jiaxu Miao , Chi Zhang , Yi Yang , Yueting Zhuang