English
Related papers

Related papers: Pretraining Generative Flow Networks with Inexpens…

200 papers

This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to model distributions over continuous spaces, and generative flow networks (GFlowNets), which…

Machine Learning · Computer Science 2023-03-03 Nikolay Malkin , Salem Lahlou , Tristan Deleu , Xu Ji , Edward Hu , Katie Everett , Dinghuai Zhang , Yoshua Bengio

The expressive power of neural networks in modelling non-trivial distributions can in principle be exploited to bypass topological freezing and critical slowing down in simulations of lattice field theories. Some popular approaches are…

High Energy Physics - Lattice · Physics 2025-02-05 Shiyang Chen , Gert Aarts , Biagio Lucini

Graph convolutional networks (GCNs) are \emph{discriminative models} that directly model the class posterior $p(y|\mathbf{x})$ for semi-supervised classification of graph data. While being effective, as a representation learning approach,…

Machine Learning · Computer Science 2023-05-30 Tianchun Wang , Farzaneh Mirzazadeh , Xiang Zhang , Jie Chen

Graph generation is a critical task in numerous domains, including molecular design and social network analysis, due to its ability to model complex relationships and structured data. While most modern graph generative models utilize…

Machine Learning · Computer Science 2025-06-04 Xiaohui Chen , Yinkai Wang , Jiaxing He , Yuanqi Du , Soha Hassoun , Xiaolin Xu , Li-Ping Liu

Recent advances in artificial intelligence have propelled the development of innovative computational materials modeling and design techniques. Generative deep learning models have been used for molecular representation, discovery, and…

Chemical Physics · Physics 2021-02-12 Navid Shervani-Tabar , Nicholas Zabaras

Recent advances have shown that video generation models can enhance robot learning by deriving effective robot actions through inverse dynamics. However, these methods heavily depend on the quality of generated data and struggle with…

Robotics · Computer Science 2025-08-18 Kelin Yu , Sheng Zhang , Harshit Soora , Furong Huang , Heng Huang , Pratap Tokekar , Ruohan Gao

While one commonly trains large diffusion models by collecting datasets on target downstream tasks, it is often desired to align and finetune pretrained diffusion models with some reward functions that are either designed by experts or…

Machine Learning · Computer Science 2025-05-20 Zhen Liu , Tim Z. Xiao , Weiyang Liu , Yoshua Bengio , Dinghuai Zhang

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

We study generative modeling of graphs with recurring subgraph motifs. We propose Flowette, a continuous flow matching framework that employs a graph neural network-based transformer to learn a velocity field over graph representations with…

Machine Learning · Computer Science 2026-05-19 Asiri Wijesinghe , Sevvandi Kandanaarachchi , Daniel M. Steinberg , Cheng Soon Ong

The discovery of inorganic crystal structures with targeted properties is a significant challenge in materials science. Generative models, especially state-of-the-art diffusion models, offer the promise of modeling complex data…

Designing a neural network architecture for molecular representation is crucial for AI-driven drug discovery and molecule design. In this work, we propose a new framework for molecular representation learning. Our contribution is threefold:…

Machine Learning · Computer Science 2022-10-18 Jiye Kim , Seungbeom Lee , Dongwoo Kim , Sungsoo Ahn , Jaesik Park

Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph…

Machine Learning · Computer Science 2023-02-28 Zemin Liu , Xingtong Yu , Yuan Fang , Xinming Zhang

Recent advances in text-to-image diffusion models have achieved impressive image generation capabilities. However, it remains challenging to control the generation process with desired properties (e.g., aesthetic quality, user intention),…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Taeyoung Yun , Dinghuai Zhang , Jinkyoo Park , Ling Pan

Combination therapy has shown to improve therapeutic efficacy while reducing side effects. Importantly, it has become an indispensable strategy to overcome resistance in antibiotics, anti-microbials, and anti-cancer drugs. Facing enormous…

Molecular Networks · Quantitative Biology 2020-04-24 Mostafa Karimi , Arman Hasanzadeh , Yang shen

Reliable training of generative adversarial networks (GANs) typically require massive datasets in order to model complicated distributions. However, in several applications, training samples obey invariances that are \textit{a priori}…

Graph networks are a new machine learning (ML) paradigm that supports both relational reasoning and combinatorial generalization. Here, we develop universal MatErials Graph Network (MEGNet) models for accurate property prediction in both…

Materials Science · Physics 2019-04-29 Chi Chen , Weike Ye , Yunxing Zuo , Chen Zheng , Shyue Ping Ong

Scaling deep learning models has been at the heart of recent revolutions in language modelling and image generation. Practitioners have observed a strong relationship between model size, dataset size, and performance. However,…

Molecular dynamics is a powerful simulation tool to explore material properties. Most of the realistic material systems are too large to be simulated with first-principles molecular dynamics. Classical molecular dynamics has lower…

Computational Physics · Physics 2021-01-11 Zun Wang , Chong Wang , Sibo Zhao , Shiqiao Du , Yong Xu , Bing-Lin Gu , Wenhui Duan

Graph Neural Networks (GNNs) are proficient in graph representation learning and achieve promising performance on versatile tasks such as node classification and link prediction. Usually, a comprehensive hyperparameter tuning is essential…

Machine Learning · Computer Science 2024-10-10 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Gating mechanisms have emerged as an effective strategy integrated into model designs beyond recurrent neural networks for addressing long-range dependency problems. In a broad understanding, it provides adaptive control over the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Yifan Wang , Xu Ma , Yitian Zhang , Zhongruo Wang , Sung-Cheol Kim , Vahid Mirjalili , Vidya Renganathan , Yun Fu