English
Related papers

Related papers: Signal from Structure: Exploiting Submodular Upper…

200 papers

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Generative Flow Networks (GFlowNets) enable fine-tuning large language models to approximate reward-proportional posteriors, but they remain prone to mode collapse, manifesting as prefix collapse and length bias. We attribute this to two…

Machine Learning · Computer Science 2026-05-29 Xi Wang , Wenbo Lu , Shengjie Wang

There are many frameworks for deep generative modeling, each often presented with their own specific training algorithms and inference methods. Here, we demonstrate the connections between existing deep generative models and the recently…

Machine Learning · Computer Science 2023-02-01 Dinghuai Zhang , Ricky T. Q. Chen , Nikolay Malkin , Yoshua Bengio

Graphs Neural Networks (GNNs) demonstrate high-performance on the link prediction (LP) task. However, these models often rely on all dataset samples being drawn from the same distribution. In addition, graph generative models (GGMs) show a…

Machine Learning · Computer Science 2025-07-17 Jay Revolinsky , Harry Shomer , Jiliang Tang

The performance of sensor arrays in sensing and wireless communications improves with more elements, but this comes at the cost of increased energy consumption and hardware expense. This work addresses the challenge of selecting $k$ sensor…

Machine Learning · Computer Science 2024-07-30 Spilios Evmorfos , Zhaoyi Xu , Athina Petropulu

This paper builds bridges between two families of probabilistic algorithms: (hierarchical) variational inference (VI), which is typically used to model distributions over continuous spaces, and generative flow networks (GFlowNets), which…

Machine Learning · Computer Science 2023-03-03 Nikolay Malkin , Salem Lahlou , Tristan Deleu , Xu Ji , Edward Hu , Katie Everett , Dinghuai Zhang , Yoshua Bengio

Graph neural networks (GNNs) are shown to be successful in modeling applications with graph structures. However, training an accurate GNN model requires a large collection of labeled data and expressive features, which might be inaccessible…

Machine Learning · Computer Science 2019-06-03 Ziniu Hu , Changjun Fan , Ting Chen , Kai-Wei Chang , Yizhou Sun

Efficiently identifying the right trajectories for training remains an open problem in GFlowNets. To address this, it is essential to prioritize exploration in regions of the state space where the reward distribution has not been…

Machine Learning · Computer Science 2025-10-23 Sajan Muhammad , Salem Lahlou

High-content phenotypic screening, including high-content imaging (HCI), has gained popularity in the last few years for its ability to characterize novel therapeutics without prior knowledge of the protein target. When combined with deep…

Generative Flow Networks (GFlowNets), a class of generative models over discrete and structured sample spaces, have been previously applied to the problem of inferring the marginal posterior distribution over the directed acyclic graph…

Foundational language models show a remarkable ability to learn new concepts during inference via context data. However, similar work for images lag behind. To address this challenge, we introduce FLoWN, a flow matching model that learns to…

Machine Learning · Computer Science 2025-04-22 Daniel Saragih , Deyu Cao , Tejas Balaji , Ashwin Santhosh

We introduce a novel training principle for probabilistic models that is an alternative to maximum likelihood. The proposed Generative Stochastic Networks (GSN) framework is based on learning the transition operator of a Markov chain whose…

Machine Learning · Computer Science 2015-03-29 Guillaume Alain , Yoshua Bengio , Li Yao , Jason Yosinski , Eric Thibodeau-Laufer , Saizheng Zhang , Pascal Vincent

In this work, we consider the radio resource allocation problem in a wireless system with various integrated functionalities, such as communication, sensing and computing. We design suitable resource management techniques that can…

Machine Learning · Computer Science 2025-05-09 Charbel Bou Chaaya , Mehdi Bennis

Many crucial scientific problems involve designing novel molecules with desired properties, which can be formulated as a black-box optimization problem over the discrete chemical space. In practice, multiple conflicting objectives and…

Machine Learning · Computer Science 2023-11-03 Yiheng Zhu , Jialu Wu , Chaowen Hu , Jiahuan Yan , Chang-Yu Hsieh , Tingjun Hou , Jian Wu

The graph neural network (GNN) has demonstrated its superior performance in various applications. The working mechanism behind it, however, remains mysterious. GNN models are designed to learn effective representations for graph-structured…

Machine Learning · Computer Science 2022-06-10 Zepeng Zhang , Ziping Zhao

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

GFlowNets is a novel flow-based method for learning a stochastic policy to generate objects via a sequence of actions and with probability proportional to a given positive reward. We contribute to relaxing hypotheses limiting the…

Machine Learning · Computer Science 2024-05-14 Leo Maxime Brunswic , Yinchuan Li , Yushun Xu , Shangling Jui , Lizhuang Ma

Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for imbalanced…

Machine Learning · Computer Science 2022-02-08 Xiaohe Li , Lijie Wen , Yawen Deng , Fuli Feng , Xuming Hu , Lei Wang , Zide Fan

Deep generative neural networks (DGNNs) have achieved realistic and high-quality data generation. In particular, the adversarial training scheme has been applied to many DGNNs and has exhibited powerful performance. Despite of recent…

Machine Learning · Computer Science 2019-12-13 Giyoung Jeon , Haedong Jeong , Jaesik Choi

Generative models see increasing use in computer-aided drug design. However, while performing well at capturing distributions of molecular motifs, they often produce synthetically inaccessible molecules. To address this, we introduce…