English
Related papers

Related papers: TextOmics-Guided Diffusion for Hit-like Molecular …

200 papers

The generation of images of realistic looking, readable handwritten text is a challenging task which is referred to as handwritten text generation (HTG). Given a string and examples from a writer, the goal is to synthesize an image…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Kai Brandenbusch

Learning the underlying distribution of molecular graphs and generating high-fidelity samples is a fundamental research problem in drug discovery and material science. However, accurately modeling distribution and rapidly generating novel…

Machine Learning · Computer Science 2023-05-24 Han Huang , Leilei Sun , Bowen Du , Weifeng Lv

Diffusion models have emerged as a promising approach for text generation, with recent works falling into two main categories: discrete and continuous diffusion models. Discrete diffusion models apply token corruption independently using…

Computation and Language · Computer Science 2025-05-29 Bocheng Li , Zhujin Gao , Linli Xu

Handwritten Text Generation (HTG) conditioned on text and style is a challenging task due to the variability of inter-user characteristics and the unlimited combinations of characters that form new words unseen during training. Diffusion…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Konstantina Nikolaidou , George Retsinas , Giorgos Sfikas , Marcus Liwicki

We address the problem of generating realistic 3D human-object interactions (HOIs) driven by textual prompts. To this end, we take a modular design and decompose the complex task into simpler sub-tasks. We first develop a dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Xiaogang Peng , Yiming Xie , Zizhao Wu , Varun Jampani , Deqing Sun , Huaizu Jiang

Large generative diffusion models have revolutionized text-to-image generation and offer immense potential for conditional generation tasks such as image enhancement, restoration, editing, and compositing. However, their widespread adoption…

Computer Vision and Pattern Recognition · Computer Science 2024-02-20 Kangfu Mei , Mauricio Delbracio , Hossein Talebi , Zhengzhong Tu , Vishal M. Patel , Peyman Milanfar

Text-to-image (TTI) diffusion models have demonstrated impressive results in generating high-resolution images of complex and imaginative scenes. Recent approaches have further extended these methods with personalization techniques that…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Tanzila Rahman , Shweta Mahajan , Hsin-Ying Lee , Jian Ren , Sergey Tulyakov , Leonid Sigal

Developing an effective molecular generation framework even with a limited number of molecules is often important for its practical deployment, e.g., drug discovery, since acquiring task-related molecular data requires expensive and…

Machine Learning · Computer Science 2024-07-17 Seojin Kim , Jaehyun Nam , Sihyun Yu , Younghoon Shin , Jinwoo Shin

Molecular generation with diffusion models has emerged as a promising direction for AI-driven drug discovery and materials science. While graph diffusion models have been widely adopted due to the discrete nature of 2D molecular graphs,…

Artificial Intelligence · Computer Science 2026-02-20 Hojung Jung , Rodrigo Hormazabal , Jaehyeong Jo , Youngrok Park , Kyunggeun Roh , Se-Young Yun , Sehui Han , Dae-Woong Jeong

In recent years, the burgeoning interest in diffusion models has led to significant advances in image and speech generation. Nevertheless, the direct synthesis of music waveforms from unrestricted textual prompts remains a relatively…

Sound · Computer Science 2023-09-22 Pengfei Zhu , Chao Pang , Yekun Chai , Lei Li , Shuohuan Wang , Yu Sun , Hao Tian , Hua Wu

Hit identification is a critical yet resource-intensive step in the drug discovery pipeline, traditionally relying on high-throughput screening of large compound libraries. Despite advancements in virtual screening, these methods remain…

Machine Learning · Computer Science 2025-12-29 Nagham Osman , Vittorio Lembo , Giovanni Bottegoni , Laura Toni

Text-to-Image (T2I) generation methods based on diffusion model have garnered significant attention in the last few years. Although these image synthesis methods produce visually appealing results, they frequently exhibit spelling errors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yiming Zhao , Zhouhui Lian

Predicting molecular conformations from molecular graphs is a fundamental problem in cheminformatics and drug discovery. Recently, significant progress has been achieved with machine learning approaches, especially with deep generative…

Machine Learning · Computer Science 2022-03-16 Minkai Xu , Lantao Yu , Yang Song , Chence Shi , Stefano Ermon , Jian Tang

We present HOIDiNi, a text-driven diffusion framework for synthesizing realistic and plausible human-object interaction (HOI). HOI generation is extremely challenging since it induces strict contact accuracies alongside a diverse motion…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Roey Ron , Guy Tevet , Haim Sawdayee , Amit H. Bermano

The design of novel molecules with desired properties is a key challenge in drug discovery and materials science. Traditional methods rely on trial-and-error, while recent deep learning approaches have accelerated molecular generation.…

Machine Learning · Computer Science 2025-03-10 Md Atik Ahamed , Qiang Ye , Qiang Cheng

This paper introduces the first text-guided work for generating the sequence of hand-object interaction in 3D. The main challenge arises from the lack of labeled data where existing ground-truth datasets are nowhere near generalizable in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Junuk Cha , Jihyeon Kim , Jae Shin Yoon , Seungryul Baek

We tackle the common challenge of inter-concept visual confusion in compositional concept generation using text-guided diffusion models (TGDMs). It becomes even more pronounced in the generation of customized concepts, due to the scarcity…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Wang Lin , Jingyuan Chen , Jiaxin Shi , Yichen Zhu , Chen Liang , Junzhong Miao , Tao Jin , Zhou Zhao , Fei Wu , Shuicheng Yan , Hanwang Zhang

Current text-to-image (T2I) generation models struggle to align spatial composition with the input text, especially in complex scenes. Even layout-based approaches yield suboptimal spatial control, as their generation process is decoupled…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheyuan Liu , Munan Ning , Qihui Zhang , Shuo Yang , Zhongrui Wang , Yiwei Yang , Xianzhe Xu , Yibing Song , Weihua Chen , Fan Wang , Li Yuan

In-context generation significantly enhances Diffusion Transformers (DiTs) by enabling controllable image-to-image generation through reference examples. However, the resulting input concatenation drastically increases sequence length,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Junqing Lin , Xingyu Zheng , Pei Cheng , Bin Fu , Jingwei Sun , Guangzhong Sun

Optimizing communication topology in LLM-based multi-agent system is critical for enabling collective intelligence. Existing methods mainly rely on spatio-temporal interaction paradigms, where the sequential execution of multi-round…

Multiagent Systems · Computer Science 2026-04-17 Rui Sun , Jie Ding , Chenghua Gong , Tianjun Gu , Yihang Jiang , Juyuan Zhang , Liming Pan , Linyuan Lü