English
Related papers

Related papers: Online variants of the cross-entropy method

200 papers

Online optimization has emerged as powerful tool in large scale optimization. In this paper, we introduce efficient online algorithms based on the alternating directions method (ADM). We introduce a new proof technique for ADM in the batch…

Machine Learning · Computer Science 2012-07-03 Huahua Wang , Arindam Banerjee

Fuzzy clustering methods identify naturally occurring clusters in a dataset, where the extent to which different clusters are overlapped can differ. Most methods have a parameter to fix the level of fuzziness. However, the appropriate level…

Neural and Evolutionary Computing · Computer Science 2024-10-30 Avisek Gupta , Shounak Datta , Swagatam Das

Global discrete optimization is notoriously difficult due to the lack of gradient information and the curse of dimensionality, making exhaustive search infeasible. Tensor cross approximation is an efficient technique to approximate…

Computation · Statistics 2025-02-19 Sergey Dolgov , Dmitry Savostyanov

This letter considers optimizing user association in a heterogeneous network via utility maximization, which is a combinatorial optimization problem due to integer constraints. Different from existing solutions based on convex optimization,…

Information Theory · Computer Science 2018-06-12 Xietian Huang , Wei Xu , Guo Xie , Shi Jin , Xiaohu You

The domination problem and several of its variants (total domination, 2-domination and secure domination) are considered. These problems have various real-world applications, but are NP-hard to solve to provable optimality, making fast…

Optimization and Control · Mathematics 2023-09-18 Ryan Burdett , Michael Haythorpe , Alex Newcombe

This work deals with the solution of a non-convex optimization problem to enhance the performance of an energy harvesting device, which involves a nonlinear objective function and a discontinuous constraint. This optimization problem, which…

Computational Engineering, Finance, and Science · Computer Science 2021-05-31 Americo Cunha

In the following article, we present a novel way to etimate the amounts of traffic on the Origin-Destination couples (OD couples). This new approach combines together a routing algorithm based on the principle of the shortest path and a…

Optimization and Control · Mathematics 2016-08-16 Hélène Le Cadre

We construct a cross-entropy clustering (CEC) theory which finds the optimal number of clusters by automatically removing groups which carry no information. Moreover, our theory gives simple and efficient criterion to verify cluster…

Information Theory · Computer Science 2014-05-19 Przemysław Spurek , Jacek Tabor

In this paper, we present a receding-horizon, sampling-based planner capable of reasoning over multimodal policy distributions. By using the cross-entropy method to optimize a multimodal policy under a common cost function, our approach…

Robotics · Computer Science 2025-09-24 Mark Gonzales , Ethan Oh , Joseph Moore

This paper introduces CEopt (https://ceopt.org), a MATLAB tool leveraging the Cross-Entropy method for non-convex optimization. Due to the relative simplicity of the algorithm, it provides a kind of transparent ``gray-box'' optimization…

In this paper, we propose a novel offloading learning approach to compromise energy consumption and latency in multi-tier network with mobile edge computing. In order to solve this integer programming problem, instead of using conventional…

Information Theory · Computer Science 2019-12-10 Shuhan Zhu , Wei Xu , Lisheng Fan , Kezhi Wang , George K. Karagiannidis

This work includes a number of novel contributions for the multiple-source adaptation problem. We present new normalized solutions with strong theoretical guarantees for the cross-entropy loss and other similar losses. We also provide new…

Machine Learning · Computer Science 2018-05-23 Judy Hoffman , Mehryar Mohri , Ningshan Zhang

We employ the Bayesian improved cross entropy (BiCE) method for rare event estimation in static networks and choose the categorical mixture as the parametric family to capture the dependence among network components. At each iteration of…

Methodology · Statistics 2023-09-25 Jianpeng Chan , Iason Papaioannou , Daniel Straub

Large language models (LLMs) have been garnering increasing attention in the recommendation community. Some studies have observed that LLMs, when fine-tuned by the cross-entropy (CE) loss with a full softmax, could achieve…

Information Retrieval · Computer Science 2024-08-27 Cong Xu , Zhangchi Zhu , Mo Yu , Jun Wang , Jianyong Wang , Wei Zhang

In this paper, we propose a semi-supervised clustering method, CEC-IB, that models data with a set of Gaussian distributions and that retrieves clusters based on a partial labeling provided by the user (partition-level side information). By…

Machine Learning · Computer Science 2017-11-15 Marek Śmieja , Bernhard C. Geiger

Semi-supervised clustering techniques have emerged as valuable tools for leveraging prior information in the form of constraints to improve the quality of clustering outcomes. Despite the proliferation of such methods, the ability to…

Machine Learning · Computer Science 2023-12-19 Guangjie Zeng , Hao Peng , Angsheng Li , Zhiwei Liu , Runze Yang , Chunyang Liu , Lifang He

A brief discussion is given of the traditional version of the Maximum Entropy Method, including a review of some of the criticism that has been made in regard to its use in statistical inference. Motivated by these questions, a modified…

Data Analysis, Statistics and Probability · Physics 2007-09-12 Robert Kariotis

Online optimisation studies the convergence of optimisation methods as the data embedded in the problem changes. Based on this idea, we propose a primal dual online method for nonlinear time-discrete inverse problems. We analyse the method…

Optimization and Control · Mathematics 2025-03-18 Neil Dizon , Jyrki Jauhiainen , Tuomo Valkonen

This paper deals with the existence of global weak solutions for a wide class of (multiple species) cross-diffusions systems. The existence is based on two different ingredients: an entropy estimate giving some gradient control and a…

Analysis of PDEs · Mathematics 2016-09-28 Thomas Lepoutre , Ayman Moussa

Online optimization has emerged as powerful tool in large scale optimization. In this pa- per, we introduce efficient online optimization algorithms based on the alternating direction method (ADM), which can solve online convex optimization…

Machine Learning · Computer Science 2013-07-11 Huahua Wang , Arindam Banerjee