English
Related papers

Related papers: Conformation Generation using Transformer Flows

200 papers

Conditional Flow Matching (CFM) models can generate high-quality samples from a non-informative prior, but they can be slow, often needing hundreds of network evaluations (NFE). To address this, we propose Implicit Dynamical Flow Fusion…

Machine Learning · Computer Science 2025-05-28 Mohammad R. Rezaei , Milos R. Popovic , Milad Lankarany , Rahul G. Krishnan

Diffusion and flow-based models have become the state of the art for generative AI across a wide range of data modalities, including images, videos, shapes, molecules, music, and more. This tutorial provides a self-contained introduction to…

Machine Learning · Computer Science 2026-03-19 Peter Holderrieth , Ezra Erives

Biological processes, functions, and properties are intricately linked to the ensemble of protein conformations, rather than being solely determined by a single stable conformation. In this study, we have developed P2DFlow, a generative…

Biological Physics · Physics 2025-03-05 Yaowei Jin , Qi Huang , Ziyang Song , Mingyue Zheng , Dan Teng , Qian Shi

Despite Flow Matching and diffusion models having emerged as powerful generative paradigms for continuous variables such as images and videos, their application to high-dimensional discrete data, such as language, is still limited. In this…

Machine Learning · Computer Science 2024-11-06 Itai Gat , Tal Remez , Neta Shaul , Felix Kreuk , Ricky T. Q. Chen , Gabriel Synnaeve , Yossi Adi , Yaron Lipman

Generative models have emerged as a powerful paradigm for solving physics systems and modeling complex spatiotemporal dynamics. However, achieving high physical accuracy without incurring high computational cost remains a fundamental…

Machine Learning · Computer Science 2026-05-27 Jiahe Huang , Sihan Xu , Sharvaree Vadgama , Rose Yu

This paper proposes a deep neural network approach for predicting multiphase flow in heterogeneous domains with high computational efficiency. The deep neural network model is able to handle permeability heterogeneity in high dimensional…

Machine Learning · Computer Science 2021-03-15 Gege Wen , Meng Tang , Sally M. Benson

The conformational landscape of proteins is crucial to understanding their functionality in complex biological processes. Traditional physics-based computational methods, such as molecular dynamics (MD) simulations, suffer from rare event…

Biomolecules · Quantitative Biology 2024-09-25 Yan Wang , Lihao Wang , Yuning Shen , Yiqun Wang , Huizhuo Yuan , Yue Wu , Quanquan Gu

The paradigm shift toward structure-driven molecule generation has been propelled by advances in deep generative models, such as variational auto-encoders and diffusion models. However, these generative models for molecular design remain…

Machine Learning · Computer Science 2026-04-17 Peidong Liu , Wenbo Zhang , Wei Ju , Jiancheng Lv , Xianggen Liu

Drug Discovery is a fundamental and ever-evolving field of research. The design of new candidate molecules requires large amounts of time and money, and computational methods are being increasingly employed to cut these costs. Machine…

Machine Learning · Statistics 2021-05-28 Pietro Bongini , Monica Bianchini , Franco Scarselli

Flow matching has emerged as a powerful generative framework, with recent few-step methods achieving remarkable inference acceleration. However, we identify a critical yet overlooked limitation: these models suffer from severe diversity…

Machine Learning · Computer Science 2026-04-15 Yexiong Lin , Jia Shi , Shanshan Ye , Wanyu Wang , Yu Yao , Tongliang Liu

Computational Fluid Dynamics (CFD) is a major sub-field of engineering. Corresponding flow simulations are typically characterized by heavy computational resource requirements. Often, very fine and complex meshes are required to resolve…

Machine Learning · Computer Science 2021-02-26 Keefe Huang , Moritz Krügener , Alistair Brown , Friedrich Menhorn , Hans-Joachim Bungartz , Dirk Hartmann

Diffusion Transformers (DiTs) have demonstrated strong performance in generative modeling, particularly in image synthesis, making them a compelling choice for molecular conformer generation. However, applying DiTs to molecules introduces…

Machine Learning · Computer Science 2025-11-12 J. Thorben Frank , Winfried Ripken , Gregor Lied , Klaus-Robert Müller , Oliver T. Unke , Stefan Chmiela

Molecule generation is advancing rapidly in chemical discovery and drug design. Flow matching methods have recently set the state of the art (SOTA) in unconditional molecule generation, surpassing score-based diffusion models. However,…

Generating molecular graphs is a challenging task due to their discrete nature and the competitive objectives involved. Diffusion models have emerged as SOTA approaches in data generation across various modalities. For molecular graphs,…

Machine Learning · Computer Science 2025-01-08 Prashanth Pombala , Gerrit Grossmann , Verena Wolf

TensorFlow is a machine learning system that operates at large scale and in heterogeneous environments. TensorFlow uses dataflow graphs to represent computation, shared state, and the operations that mutate that state. It maps the nodes of…

It is well known that Drug Design is often a costly process both in terms of time and economic effort. While good Quantitative Structure-Activity Relationship models (QSAR) can help predicting molecular properties without the need to…

Biomolecules · Quantitative Biology 2022-02-14 Dylan Savoia , Alessio Ragno , Roberto Capobianco

We consider the problem of molecular graph generation using deep models. While graphs are discrete, most existing methods use continuous latent variables, resulting in inaccurate modeling of discrete graph structures. In this work, we…

Machine Learning · Computer Science 2021-06-03 Youzhi Luo , Keqiang Yan , Shuiwang Ji

Transition states (TSs) are central to understanding and quantitatively predicting chemical reactivity and reaction mechanisms. Although traditional TS generation methods are computationally expensive, recent generative modeling approaches…

Chemical Physics · Physics 2026-02-12 Ron Shprints , Peter Holderrieth , Juno Nam , Rafael Gómez-Bombarelli , Tommi Jaakkola

Diffusion models and their variations, such as rectified flows, generate diverse and high-quality images, but they are still hindered by slow iterative sampling caused by the highly curved generative paths they learn. An important cause of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Nazir Nayal , Christopher Wewer , Jan Eric Lenssen

Dilated and transposed convolutions are widely used in modern convolutional neural networks (CNNs). These kernels are used extensively during CNN training and inference of applications such as image segmentation and high-resolution image…