English
Related papers

Related papers: MODA: A Unified 3D Diffusion Framework for Multi-T…

200 papers

Cross-modal garment synthesis and manipulation will significantly benefit the way fashion designers generate garments and modify their designs via flexible linguistic interfaces.Current approaches follow the general text-to-image paradigm…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Xujie Zhang , Binbin Yang , Michael C. Kampffmeyer , Wenqing Zhang , Shiyue Zhang , Guansong Lu , Liang Lin , Hang Xu , Xiaodan Liang

Effectively designing molecular geometries is essential to advancing pharmaceutical innovations, a domain, which has experienced great attention through the success of generative models and, in particular, diffusion models. However, current…

Biomolecules · Quantitative Biology 2025-01-07 Sirine Ayadi , Leon Hetzel , Johanna Sommer , Fabian Theis , Stephan Günnemann

Text-conditioned molecular generation aims to translate natural-language descriptions into chemical structures, enabling scientists to specify functional groups, scaffolds, and physicochemical constraints without handcrafted rules.…

Machine Learning · Computer Science 2025-11-18 Lingxiao Li , Haobo Zhang , Bin Chen , Jiayu Zhou

The inverse design of metasurfaces faces inherent challenges due to the nonlinear and highly complex relationship between geometric configurations and their electromagnetic behavior. Traditional optimization approaches often suffer from…

Molecular generation and molecular property prediction are both crucial for drug discovery, but they are often developed independently. Inspired by recent studies, which demonstrate that diffusion model, a prominent generative approach, can…

Machine Learning · Computer Science 2025-04-07 Shikun Feng , Yuyan Ni , Yan Lu , Zhi-Ming Ma , Wei-Ying Ma , Yanyan Lan

Drug discovery can be viewed as a combinatorial search over an immense chemical space, motivating the development of deep generative models for de novo molecular design. Among these, GPT-based molecular language models (MLM) have shown…

Machine Learning · Computer Science 2026-02-02 Qianwei Yang , Dong Xu , Zhangfan Yang , Sisi Yuan , Zexuan Zhu , Jianqiang Li , Junkai Ji

Many protein design applications, such as binder or enzyme design, require scaffolding a structural motif with high precision. Generative modelling paradigms based on denoising diffusion processes emerged as a leading candidate to address…

Machine Learning · Computer Science 2024-03-15 Kieran Didi , Francisco Vargas , Simon V Mathis , Vincent Dutordoir , Emile Mathieu , Urszula J Komorowska , Pietro Lio

Garment sewing patterns are fundamental design elements that bridge the gap between design concepts and practical manufacturing. The generative modeling of sewing patterns is crucial for creating diversified garments. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Xinyu Li , Qi Yao , Yuanda Wang

We present a systematic theoretical framework that interprets masked diffusion models (MDMs) as solutions to energy minimization problems in discrete optimal transport. Specifically, we prove that three distinct energy…

Machine Learning · Computer Science 2026-03-24 Sitong Chen , Shen Nie , Jiacheng Sun , Zijin Feng , Zhenguo Li , Ji-Rong Wen , Chongxuan Li

Diffusion models have recently gained state of the art performance on many image generation tasks. However, most models require significant computational resources to achieve this. This becomes apparent in the application of medical image…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Karan Jain , Mohammad Nayeem Teli

Diffusion models have risen as a powerful tool in robotics due to their flexibility and multi-modality. While some of these methods effectively address complex problems, they often depend heavily on inference-time obstacle detection and…

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

We present a method that reduces, by an order of magnitude, the time and memory needed to train multi-task vision-language robotic diffusion policies. This improvement arises from a previously underexplored distinction between action…

Robotics · Computer Science 2025-06-06 Yutong Hu , Pinhao Song , Kehan Wen , Renaud Detry

The paradigm shift toward structure-driven molecule generation has been propelled by advances in deep generative models, such as variational auto-encoders and diffusion models. However, these generative models for molecular design remain…

Machine Learning · Computer Science 2026-04-17 Peidong Liu , Wenbo Zhang , Wei Ju , Jiancheng Lv , Xianggen Liu

Marine obstacle detection demands robust segmentation under challenging conditions, such as sun glitter, fog, and rapidly changing wave patterns. These factors degrade image quality, while the scarcity and structural repetition of marine…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Miaohua Zhang , Mohammad Ali Armin , Xuesong Li , Sisi Liang , Lars Petersson , Changming Sun , David Ahmedt-Aristizabal , Zeeshan Hayder

We are considering in this paper the task of label-efficient fine-tuning of segmentation models: We assume that a large labeled dataset is available and allows to train an accurate segmentation model in one domain, and that we have to adapt…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Bruno Sauvalle , Mathieu Salzmann

Training diffusion models is always a computation-intensive task. In this paper, we introduce a novel speed-up method for diffusion model training, called, which is based on a closer look at time steps. Our key findings are: i) Time steps…

Machine Learning · Computer Science 2025-03-26 Kai Wang , Mingjia Shi , Yukun Zhou , Zekai Li , Zhihang Yuan , Yuzhang Shang , Xiaojiang Peng , Hanwang Zhang , Yang You

Diffusion models are relatively easy to train but require many steps to generate samples. Consistency models are far more difficult to train, but generate samples in a single step. In this paper we propose Multistep Consistency Models: A…

Machine Learning · Computer Science 2024-11-20 Jonathan Heek , Emiel Hoogeboom , Tim Salimans

Recently, diffusion transformers have gained wide attention with its excellent performance in text-to-image and text-to-vidoe models, emphasizing the need for transformers as backbone for diffusion models. Transformer-based models have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Nithin Gopalakrishnan Nair , Jeya Maria Jose Valanarasu , Vishal M. Patel

Masked (or absorbing) diffusion is actively explored as an alternative to autoregressive models for generative modeling of discrete data. However, existing work in this area has been hindered by unnecessarily complex model formulations and…

Machine Learning · Computer Science 2025-01-17 Jiaxin Shi , Kehang Han , Zhe Wang , Arnaud Doucet , Michalis K. Titsias