English
Related papers

Related papers: Learning Oriented Cross-Entropy Approach to User A…

200 papers

Using the maximum entropy method, we derive the "adaptive cluster expansion" (ACE), which can be trained to estimate probability density functions in high dimensional spaces. The main advantage of ACE over other Bayesian networks is its…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Stephen Luttrell

We consider the problem of optimally compressing and caching data across a communication network. Given the data generated at edge nodes and a routing path, our goal is to determine the optimal data compression ratios and caching decisions…

Networking and Internet Architecture · Computer Science 2018-01-25 Jian Li , Faheem Zafari , Don Towsley , Kin K. Leung , Ananthram Swami

We study the cross-entropy method (CEM) for the non-convex optimization of a continuous and parameterized objective function and introduce a differentiable variant that enables us to differentiate the output of CEM with respect to the…

Machine Learning · Computer Science 2020-08-18 Brandon Amos , Denis Yarats

In this paper, we consider the sum power minimization problem via jointly optimizing user association, power control, computation capacity allocation and location planning in a mobile edge computing (MEC) network with multiple unmanned…

Information Theory · Computer Science 2019-02-14 Zhaohui Yang , Cunhua Pan , Kezhi Wang , Mohammad Shikh-Bahaei

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang

We develop a new methodology for model-based clustering. Optimizing the log-likelihood provides a principled statistical framework for clustering, with solutions found via the EM algorithm. However, because the log-likelihood is nonconvex,…

Methodology · Statistics 2026-05-06 Gonzalo Mena

Ensemble clustering integrates a set of base clustering results to generate a stronger one. Existing methods usually rely on a co-association (CA) matrix that measures how many times two samples are grouped into the same cluster according…

Machine Learning · Computer Science 2023-02-24 Yuheng Jia , Sirui Tao , Ran Wang , Yongheng Wang

The study considers the usage of a probabilistic optimization method called Cross-Entropy (CE). This is the version of the Monte Carlo method created by Reuven Rubinstein (1997). It was developed in the context of determining rare events.…

Optimization and Control · Mathematics 2021-04-15 Maria Katarzyna Stachowiak , Krzysztof Józef Szajowski

The ever-increasing integration of stochastic renewable energy sources into power systems operation is making the supply-demand balance more challenging. While joint chance-constrained methods are equipped to model these complexities and…

Systems and Control · Electrical Eng. & Systems 2025-01-23 Meiyi Li , Javad Mohammadi

The Soft Happy Colouring (SHC) problem, a mathematical framework for identifying homophilic network structures, seeks to maximise the number of $\rho$-happy vertices, i.e. vertices with at least a proportion $\rho$ of neighbours that share…

Social and Information Networks · Computer Science 2026-04-15 Mohammad Hadi Shekarriz , Asef Nazari , Dhananjay Thiruvady

The Improved Cross-Entropy (ICE) method is a powerful tool for estimating failure probabilities in reliability analysis. Its core idea is to approximate the optimal importance-sampling density by minimizing the forward Kullback-Leibler…

Numerical Analysis · Mathematics 2025-09-10 Zhiwei Gao , George Karniadakis

This paper explores the problem of clustering ensemble, which aims to combine multiple base clusterings to produce better performance than that of the individual one. The existing clustering ensemble methods generally construct a…

Machine Learning · Computer Science 2020-12-17 Yuheng Jia , Hui Liu , Junhui Hou , Qingfu Zhang

Collaborative edge computing (CEC) is an emerging paradigm where heterogeneous edge devices collaborate to fulfill computation tasks, such as model training or video processing, by sharing communication and computation resources.…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-05-27 Jinkun Zhang , Yuezhou Liu , Edmund Yeh

Distributed consensus has been widely studied for sensor network applications. Whereas the asymptotic convergence rate has been extensively explored in prior work, other important and practical issues, including energy efficiency and link…

Networking and Internet Architecture · Computer Science 2013-04-10 Lei Chen , Jeff Frolik

In this paper, we present a cross-entropy optimization method for hyperparameter optimization in stochastic gradient-based approaches to train deep neural networks. The value of a hyperparameter of a learning algorithm often has great…

Machine Learning · Computer Science 2024-09-17 Kevin Li , Fulu Li

Many real-world problems can be phrased as a multi-objective optimization problem, where the goal is to identify the best set of compromises between the competing objectives. Multi-objective Bayesian optimization (BO) is a sample efficient…

Machine Learning · Computer Science 2022-10-07 Ben Tu , Axel Gandy , Nikolas Kantas , Behrang Shafei

Nowadays, centralized Path Computation Elements (PCE) integrate control plane algorithms to optimize routing and load-balancing continuously. When a link fails, the traffic load is automatically transferred to the remaining paths according…

Networking and Internet Architecture · Computer Science 2023-01-11 Youcef Magnouche , Sébastien Martin , Jérémie Leguay

This paper shows how the Bayesian network paradigm can be used in order to solve combinatorial optimization problems. To do it some methods of structure learning from data and simulation of Bayesian networks are inserted inside Estimation…

Artificial Intelligence · Computer Science 2013-01-18 Pedro Larrañaga , Ramon Etxeberria , Jose A. Lozano , Jose M. Pena

Model-free deep-reinforcement-based learning algorithms have been applied to a range of COPs~\cite{bello2016neural}~\cite{kool2018attention}~\cite{nazari2018reinforcement}. However, these approaches suffer from two key challenges when…

Machine Learning · Computer Science 2022-06-01 Nasrin Sultana , Jeffrey Chan , Tabinda Sarwar , A. K. Qin

Combinatorial Optimisation problems arise in several application domains and are often formulated in terms of graphs. Many of these problems are NP-hard, but exact solutions are not always needed. Several heuristics have been developed to…

Machine Learning · Computer Science 2022-05-23 David Ireland , Giovanni Montana