English
Related papers

Related papers: CEoptim: Cross-Entropy R Package for Optimization

200 papers

Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to…

Optimization and Control · Mathematics 2019-06-24 Stefan Banholzer , Bennet Gebken , Michael Dellnitz , Sebastian Peitz , Stefan Volkwein

The Cluster Expansion (CE) Method encounters significant computational challenges in multicomponent systems due to the computational expense of generating training data through density functional theory (DFT) calculations. This work aims to…

Materials Science · Physics 2024-12-10 Guillermo Vazquez , Daniel Sauceda , Raymundo Arróyave

Combinatorial optimization is one of the fundamental research fields that has been extensively studied in theoretical computer science and operations research. When developing an algorithm for combinatorial optimization, it is commonly…

Machine Learning · Computer Science 2023-08-30 Yuko Kuroki , Junya Honda , Masashi Sugiyama

Computer experiments with both qualitative and quantitative factors are widely used in many applications. Motivated by the emerging need of optimal configuration in the high-performance computing (HPC) system, this work proposes a…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-01-08 Xia Cai , Li Xu , C. Devon Lin , Yili Hong , Xinwei Deng

This paper presents a novel centroid-based heuristic algorithm, termed Kempe Swap K-Means, for constrained clustering under rigid must-link (ML) and cannot-link (CL) constraints. The algorithm employs a dual-phase iterative process: an…

Machine Learning · Computer Science 2026-03-31 Yuxuan Ren , Shijie Deng

The best practical techniques for exact solution of instances of the constrained maximum-entropy sampling problem, a discrete-optimization problem arising in the design of experiments, are via a branch-and-bound framework, working with a…

Optimization and Control · Mathematics 2024-02-19 Zhongzhu Chen , Marcia Fampa , Jon Lee

Multimodal data is a precious asset enabling a variety of downstream tasks in machine learning. However, real-world data collected across different modalities is often not paired, which is a significant challenge to learn a joint…

Machine Learning · Computer Science 2025-08-11 Mustapha Bounoua , Giulio Franzese , Pietro Michiardi

Sampling-based model predictive control methods like MPPI and CEM are essential for real-time control of nonlinear robotic systems, particularly where discontinuous dynamics preclude gradient-based optimization. However, these methods…

Robotics · Computer Science 2026-05-05 Vincent Pacelli , Akash Ratheesh , Evangelos A. Theodorou

This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for…

Optimization and Control · Mathematics 2024-08-27 Yukuan Hu , Mengyu Li , Xin Liu , Cheng Meng

We explore a method of statistical estimation called Maximum Entropy on the Mean (MEM) which is based on an information-driven criterion that quantifies the compliance of a given point with a reference prior probability measure. At the core…

Statistics Theory · Mathematics 2022-12-20 Yakov Vaisbourd , Rustum Choksi , Ariel Goodwin , Tim Hoheisel , Carola-Bibiane Schönlieb

We apply two variations of the principle of Minimum Cross Entropy (the Kullback information measure) to fit parameterized probability density models to observed data densities. For an array beamforming problem with P incident narrowband…

Information Theory · Computer Science 2008-06-24 Cheng-Yuan Liou , Bruce R. Musicus

Cross-entropy (CE) training provides dense and scalable supervision for language models, but it optimizes next-token prediction under teacher forcing rather than sequence-level behavior under model rollouts. We introduce a feature-matching…

Machine Learning · Computer Science 2026-03-17 Samy Jelassi , Mujin Kwun , Rosie Zhao , Yuanzhi Li , Nicolo Fusi , Yilun Du , Sham M. Kakade , Carles Domingo-Enrich

Trajectory optimization methods for motion planning attempt to generate trajectories that minimize a suitable objective function. Such methods efficiently find solutions even for high degree-of-freedom robots. However, a globally optimal…

Robotics · Computer Science 2019-07-18 Luka Petrović , Juraj Peršić , Marija Seder , Ivan Marković

Ensemble methods such as bagging and random forests are ubiquitous in various fields, from finance to genomics. Despite their prevalence, the question of the efficient tuning of ensemble parameters has received relatively little attention.…

Methodology · Statistics 2023-12-19 Jin-Hong Du , Pratik Patil , Kathryn Roeder , Arun Kumar Kuchibhotla

Semi-discrete optimal transport (SOT), which maps a continuous probability measure to a discrete one, is a fundamental problem with wide-ranging applications. Entropic regularization is often employed to solve the SOT problem, leading to a…

Numerical Analysis · Mathematics 2025-08-01 Moaad Khamlich , Francesco Romor , Gianluigi Rozza

Existing Bayesian Optimization (BO) methods typically balance exploration and exploitation to optimize costly objective functions. However, these methods often suffer from a significant one-step bias, which may lead to convergence towards…

Machine Learning · Computer Science 2025-10-23 Ruiyao Miao , Junren Xiao , Shiya Tsang , Hui Xiong , Yingnian Wu

In this paper, a cooperative task computation framework exploits the computation resource in UEs to accomplish more tasks meanwhile minimizes the power consumption of UEs. The system cost includes the cost of UEs' power consumption and the…

Information Theory · Computer Science 2020-07-14 Yijin Pan , Cunhua Pan , Kezhi Wang , Huiling Zhu , Jiangzhou Wang

Numerical homogenization for mechanical multiscale modeling by means of the finite element method (FEM) is an elegant way of obtaining structure-property relations, if the behavior of the constituents of the lower scale is well understood.…

Numerical Analysis · Mathematics 2025-08-07 Nils Lange , Geralf Hütter , Bjoern Kiefer

The minimum error entropy (MEE) criterion has been successfully used in fields such as parameter estimation, system identification and the supervised machine learning. There is in general no explicit expression for the optimal MEE estimate…

Information Theory · Computer Science 2015-04-14 Badong Chen , Guangmin Wang , Nanning Zheng , Jose C. Principe

lcensemble is a high-performing, scalable and user-friendly Python package for the general tasks of classification and regression. The package implements Local Cascade Ensemble (LCE), a machine learning method that further enhances the…

Machine Learning · Computer Science 2023-08-17 Kevin Fauvel , Élisa Fromont , Véronique Masson , Philippe Faverdin , Alexandre Termier