English
Related papers

Related papers: Rethinking Diffusion Models with Symmetries throug…

200 papers

Incorporating group symmetries via equivariance into neural networks has emerged as a robust approach for overcoming the efficiency and data demands of modern deep learning. While most existing approaches, such as group convolutions and…

Rich data and powerful machine learning models allow us to design drugs for a specific protein target \textit{in silico}. Recently, the inclusion of 3D structures during targeted drug design shows superior performance to other target-free…

Biomolecules · Quantitative Biology 2023-03-08 Jiaqi Guan , Wesley Wei Qian , Xingang Peng , Yufeng Su , Jian Peng , Jianzhu Ma

Generative modeling of physical systems, such as molecules, requires learning distributions that are invariant under global symmetries, such as rotations in three-dimensional space. Equivariant diffusion and flow matching models can…

Machine Learning · Computer Science 2026-05-08 Samir Darouich , Vinh Tong , Lluís Pastor-Pérez , Tanja Bien , Loay Mualem , Mathias Niepert

Diffusion models based on permutation-equivariant networks can learn permutation-invariant distributions for graph data. However, in comparison to their non-invariant counterparts, we have found that these invariant models encounter greater…

Machine Learning · Computer Science 2024-06-21 Qi Yan , Zhengyang Liang , Yang Song , Renjie Liao , Lele Wang

The diffusion model has emerged as a powerful tool for generating atomic structures for materials science. This work calls attention to the deficiency of current particle-based diffusion models, which represent atoms as a point cloud, in…

Materials Science · Physics 2024-08-29 Bo Lei , Enze Chen , Hyuna Kwon , Tim Hsu , Babak Sadigh , Vincenzo Lordi , Timofey Frolov , Fei Zhou

Diffusion models are a class of generative models that serve to establish a stochastic transport map between an empirically observed, yet unknown, target distribution and a known prior. Despite their remarkable success in real-world…

Machine Learning · Computer Science 2025-03-13 Puheng Li , Zhong Li , Huishuai Zhang , Jiang Bian

The expressivity of Graph Neural Networks (GNNs) has been studied broadly in recent years to reveal the design principles for more powerful GNNs. Graph canonization is known as a typical approach to distinguish non-isomorphic graphs, yet…

Machine Learning · Computer Science 2024-02-12 Zehao Dong , Muhan Zhang , Philip R. O. Payne , Michael A Province , Carlos Cruchaga , Tianyu Zhao , Fuhai Li , Yixin Chen

Diffusion models are powerful generative models that produce high-quality samples from complex data. While their infinite-data behavior is well understood, their generalization with finite data remains less clear. Classical learning theory…

Machine Learning · Statistics 2026-02-02 Claudia Merger , Sebastian Goldt

Creating graphic layouts is a fundamental step in graphic designs. In this work, we present a novel generative model named LayoutDiffusion for automatic layout generation. As layout is typically represented as a sequence of discrete tokens,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Junyi Zhang , Jiaqi Guo , Shizhao Sun , Jian-Guang Lou , Dongmei Zhang

Calculus and geometry are ubiquitous in the theoretical modelling of scientific phenomena, but have historically been very challenging to apply directly to real data as statistics. Diffusion geometry is a new theory that reformulates…

Differential Geometry · Mathematics 2026-02-09 Iolo Jones , David Lanners

Generating realistic images of complex visual scenes becomes challenging when one wishes to control the structure of the generated images. Previous approaches showed that scenes with few entities can be controlled using scene graphs, but…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Roei Herzig , Amir Bar , Huijuan Xu , Gal Chechik , Trevor Darrell , Amir Globerson

Generating high-resolution images with generative models has recently been made widely accessible by leveraging diffusion models pre-trained on large-scale datasets. Various techniques, such as MultiDiffusion and SyncDiffusion, have further…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Stanislav Frolov , Brian B. Moser , Andreas Dengel

Generative neural image compression supports data representation at extremely low bitrate, synthesizing details at the client and consistently producing highly realistic images. By leveraging the similarities between quantization error and…

Image and Video Processing · Electrical Eng. & Systems 2025-04-04 Lucas Relic , Roberto Azevedo , Yang Zhang , Markus Gross , Christopher Schroers

Graph-structured data jointly contain discrete topology and continuous geometry, which poses fundamental challenges for generative modeling due to heterogeneous distributions, incompatible noise dynamics, and the need for equivariant…

Machine Learning · Computer Science 2026-04-10 Rongjian Xu , Teng Pang , Zhiqiang Dong , Guoqiang Wu

Taming the generation outcome of state of the art Diffusion and Flow-Matching (FM) models without having to re-train a task-specific model unlocks a powerful tool for solving inverse problems, conditional generation, and controlled…

Machine Learning · Computer Science 2024-07-23 Heli Ben-Hamu , Omri Puny , Itai Gat , Brian Karrer , Uriel Singer , Yaron Lipman

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

Recent progress in image generation has sparked research into controlling these models through condition signals, with various methods addressing specific challenges in conditional generation. Instead of proposing another specialized…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Xirui Li , Charles Herrmann , Kelvin C. K. Chan , Yinxiao Li , Deqing Sun , Chao Ma , Ming-Hsuan Yang

Graph generation is a critical yet challenging task, as empirical analyses require a deep understanding of complex, non-Euclidean structures. Diffusion models have recently made significant advances in graph generation, but these models are…

Machine Learning · Computer Science 2026-03-13 Yiming Huang , Tolga Birdal

Graph diffusion models have made significant progress in learning structured graph data and have demonstrated strong potential for predictive tasks. Existing approaches typically embed node, edge, and graph-level features into a unified…

Machine Learning · Computer Science 2025-12-12 Yisen Gao , Xingcheng Fu , Qingyun Sun , Jianxin Li , Xianxian Li

Generating molecular graphs is crucial in drug design and discovery but remains challenging due to the complex interdependencies between nodes and edges. While diffusion models have demonstrated their potentiality in molecular graph design,…

Machine Learning · Computer Science 2024-11-11 Xiaoyang Hou , Tian Zhu , Milong Ren , Dongbo Bu , Xin Gao , Chunming Zhang , Shiwei Sun