English
Related papers

Related papers: Ant Colony Sampling with GFlowNets for Combinatori…

200 papers

Federated Learning faces significant challenges in statistical and system heterogeneity, along with high energy consumption, necessitating efficient client selection strategies. Traditional approaches, including heuristic and learning-based…

Machine Learning · Computer Science 2025-10-01 Zhiyuan Ning , Chunlin Tian , Meng Xiao , Wei Fan , Pengyang Wang , Li Li , Pengfei Wang , Yuanchun Zhou

It is not rare that the performance of one metaheuristic algorithm can be improved by incorporating ideas taken from another. In this article we present how Simulated Annealing (SA) can be used to improve the efficiency of the Ant Colony…

Artificial Intelligence · Computer Science 2017-05-03 Rafał Skinderowicz

Gaussian processes are flexible probabilistic regression models which are widely used in statistics and machine learning. However, a drawback is their limited scalability to large data sets. To alleviate this, full-scale approximations…

Methodology · Statistics 2026-01-13 Tim Gyger , Reinhard Furrer , Fabio Sigrist

Generative flow networks (GFlowNets) are a method for learning a stochastic policy for generating compositional objects, such as graphs or strings, from a given unnormalized density by sequences of actions, where many possible action…

Machine Learning · Computer Science 2023-10-05 Nikolay Malkin , Moksh Jain , Emmanuel Bengio , Chen Sun , Yoshua Bengio

Given the limitations of backpropagation, perturbation-based gradient computation methods have recently gained focus for learning with only forward passes, also referred to as queries. Conventional forward learning consumes enormous queries…

Machine Learning · Computer Science 2025-03-11 Tao Ren , Zishi Zhang , Jinyang Jiang , Guanghao Li , Zeliang Zhang , Mingqian Feng , Yijie Peng

The Ant Colony Optimization (ACO) algorithm is a nature-inspired metaheuristic method used for optimization problems. Although not a machine learning method per se, ACO is often employed alongside machine learning models to enhance…

Strongly Correlated Electrons · Physics 2026-05-14 G. M. Tonin , T. Pauletti , R. M. Dos Santos , V. V. França

While Markov chain Monte Carlo methods (MCMC) provide a general framework to sample from a probability distribution defined up to normalization, they often suffer from slow convergence to the target distribution when the latter is highly…

Machine Learning · Computer Science 2023-07-06 Tristan Deleu , Yoshua Bengio

In this paper, thinking over characteristics of ant colony optimization Algorithm, taking into account the characteristics of cloud computing, combined with clonal selection algorithm (CSA) global optimum advantage of the convergence of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2014-11-11 Jianbiao Lin , Yukun Zhong , Xiaowei Lin , Hui Lin , Qiang Zeng

Graph neural networks (GNNs) have achieved great success for a variety of tasks such as node classification, graph classification, and link prediction. However, the use of GNNs (and machine learning more generally) to solve combinatorial…

Machine Learning · Computer Science 2024-11-26 Frederik Wenkel , Semih Cantürk , Stefan Horoi , Michael Perlmutter , Guy Wolf

The performance of flow matching and diffusion models can be greatly improved at inference time using reward alignment algorithms, yet efficiency remains a major limitation. While several algorithms were proposed, we demonstrate that a…

Machine Learning · Computer Science 2026-02-12 Peter Holderrieth , Uriel Singer , Tommi Jaakkola , Ricky T. Q. Chen , Yaron Lipman , Brian Karrer

Although Generative Flow Networks (GFlowNets) are designed to capture multiple modes of a reward function, they often suffer from mode collapse in practice, getting trapped in early-discovered modes and requiring prolonged training to find…

Machine Learning · Computer Science 2025-11-11 Idriss Malek , Aya Laajil , Abhijith Sharma , Eric Moulines , Salem Lahlou

The Filtered-x Normalized Least Mean Square (FxNLMS) algorithm suffers from slow convergence and a risk of divergence, although it can achieve low steady-state errors after sufficient adaptation. In contrast, the Generative Fixed-Filter…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-28 Zhengding Luo , Haozhe Ma , Boxiang Wang , Ziyi Yang , Dongyuan Shi , Woon-Seng Gan

Flow matching casts sample generation as learning a continuous-time velocity field that transports noise to data. Existing flow matching networks typically predict each point's velocity independently, considering only its location and time…

Machine Learning · Computer Science 2025-11-11 Md Shahriar Rahim Siddiqui , Moshe Eliasof , Eldad Haber

An ant colony optimization approach for partitioning a set of objects is proposed. In order to minimize the intra-variance, or within sum-of-squares, of the partitioned classes, we construct ant-like solutions by a constructive approach…

Machine Learning · Statistics 2019-12-04 Jeffry Chavarria-Molina , Juan Jose Fallas-Monge , Javier Trejos-Zelaya

Generative flow networks utilize a flow-matching loss to learn a stochastic policy for generating objects from a sequence of actions, such that the probability of generating a pattern can be proportional to the corresponding given reward.…

Machine Learning · Computer Science 2025-09-26 Leo Maxime Brunswic , Haozhi Wang , Shuang Luo , Jianye Hao , Amir Rasouli , Yinchuan Li

This paper introduces an enhanced meta-heuristic (ML-ACO) that combines machine learning (ML) and ant colony optimization (ACO) to solve combinatorial optimization problems. To illustrate the underlying mechanism of our ML-ACO algorithm, we…

Neural and Evolutionary Computing · Computer Science 2021-11-09 Yuan Sun , Sheng Wang , Yunzhuang Shen , Xiaodong Li , Andreas T. Ernst , Michael Kirley

An energy efficient use of large scale sensor networks necessitates activating a subset of possible sensors for estimation at a fusion center. The problem is inherently combinatorial; to this end, a set of iterative, randomized algorithms…

Information Theory · Computer Science 2017-09-13 Arpan Chattopadhyay , Urbashi Mitra

We present energy-based generative flow networks (EB-GFN), a novel probabilistic modeling algorithm for high-dimensional discrete data. Building upon the theory of generative flow networks (GFlowNets), we model the generation process by a…

Machine Learning · Computer Science 2022-06-10 Dinghuai Zhang , Nikolay Malkin , Zhen Liu , Alexandra Volokhova , Aaron Courville , Yoshua Bengio

Existing optical flow estimators usually employ the network architectures typically designed for image classification as the encoder to extract per-pixel features. However, due to the natural difference between the tasks, the architectures…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Zhiwei Lin , Tingting Liang , Taihong Xiao , Yongtao Wang , Zhi Tang , Ming-Hsuan Yang

The recently proposed generative flow networks (GFlowNets) are a method of training a policy to sample compositional discrete objects with probabilities proportional to a given reward via a sequence of actions. GFlowNets exploit the…

Machine Learning · Computer Science 2024-02-27 Daniil Tiapkin , Nikita Morozov , Alexey Naumov , Dmitry Vetrov