English
Related papers

Related papers: Challenges of Interaction in Optimizing Mixed Cate…

200 papers

Complex system design problems, such as those involved in aerospace engineering, require the use of numerically costly simulation codes in order to predict the performance of the system to be designed. In this context, these codes are often…

Optimization and Control · Mathematics 2024-02-14 Loic Brevault , Mathieu Balesdent

Finding interactions between variables in large and high-dimensional datasets is often a serious computational challenge. Most approaches build up interaction sets incrementally, adding variables in a greedy fashion. The drawback is that…

Machine Learning · Statistics 2016-04-27 Rajen Dinesh Shah , Nicolai Meinshausen

Real-world optimization problems are generally not just black-box problems, but also involve mixed types of inputs in which discrete and continuous variables coexist. Such mixed-space optimization possesses the primary challenge of modeling…

Machine Learning · Computer Science 2022-02-09 Jaeyeon Ahn , Taehyeon Kim , Seyoung Yun

A prominent approach to solving combinatorial optimization problems on parallel hardware is Ising machines, i.e., hardware implementations of networks of interacting binary spin variables. Most Ising machines leverage second-order…

Emerging Technologies · Computer Science 2022-12-08 Connor Bybee , Denis Kleyko , Dmitri E. Nikonov , Amir Khosrowshahi , Bruno A. Olshausen , Friedrich T. Sommer

We propose a method for variable selection in discriminant analysis with mixed categorical and continuous variables. This method is based on a criterion that permits to reduce the variable selection problem to a problem of estimating…

Statistics Theory · Mathematics 2017-03-14 Alban Mbina Mbina , Guy Martial Nkiet , Fulgence Eyi Obiang

We explore how warm-starting strategies can be integrated into scalarization-based approaches for multi-objective optimization in (mixed) integer linear programming. Scalarization methods remain widely used classical techniques to compute…

Optimization and Control · Mathematics 2025-07-30 Stephanie Riedmüller , Janina Zittel , Thorsten Koch

Typical black-box optimization approaches in robotics focus on learning from metric scores. However, that is not always possible, as not all developers have ground truth available. Learning appropriate robot behavior in human-centric…

Robotics · Computer Science 2023-08-10 Leonid Keselman , Katherine Shih , Martial Hebert , Aaron Steinfeld

We consider the primal and dual forms of the optimality conditions for PDE-contrained optimization problems arising in Data-Driven Computational Mechanics when specialized to the reaction-diffusion context. Starting with the continuous…

Numerical Analysis · Mathematics 2025-12-24 Ramon Codina , Roberto Federico Ausas , Pedro Balbão Bazon , Cristian Guillermo Gebhardt

We introduce a cooperative Bayesian optimization problem for optimizing black-box functions of two variables where two agents choose together at which points to query the function but have only control over one variable each. This setting…

Machine Learning · Computer Science 2024-03-08 Ali Khoshvishkaie , Petrus Mikkola , Pierre-Alexandre Murena , Samuel Kaski

The search for higher-order feature interactions that are statistically significantly associated with a class variable is of high relevance in fields such as Genetics or Healthcare, but the combinatorial explosion of the candidate space…

Machine Learning · Statistics 2019-05-13 Mahito Sugiyama , Karsten Borgwardt

This paper presents a powerful swarm intelligence meta-heuristic optimization algorithm called Dynamic Cat Swarm Optimization. The formulation is through modifying the existing Cat Swarm Optimization. The original Cat Swarm Optimization…

Neural and Evolutionary Computing · Computer Science 2021-07-20 Aram Ahmed , Tarik A. Rashid , Soran Saeed

This study targets the mixed-integer black-box optimization (MI-BBO) problem where continuous and integer variables should be optimized simultaneously. The CMA-ES, our focus in this study, is a population-based stochastic search method that…

Neural and Evolutionary Computing · Computer Science 2023-01-13 Ryoki Hamano , Shota Saito , Masahiro Nomura , Shinichi Shirakawa

Many real-world functions are defined over both categorical and category-specific continuous variables and thus cannot be optimized by traditional Bayesian optimization (BO) methods. To optimize such functions, we propose a new method that…

Machine Learning · Computer Science 2019-12-02 Dang Nguyen , Sunil Gupta , Santu Rana , Alistair Shilton , Svetha Venkatesh

Coordination among connected and autonomous vehicles (CAVs) is advancing due to developments in control and communication technologies. However, much of the current work is based on oversimplified and unrealistic task-specific assumptions,…

Multiagent Systems · Computer Science 2024-10-25 Rui Du , Kai Zhao , Jinlong Hou , Qiang Zhang , Peter Zhang

We propose a multi-objective optimization algorithm aimed at achieving good anytime performance over a wide range of problems. Performance is assessed in terms of the hypervolume metric. The algorithm called HMO-CMA-ES represents a hybrid…

Neural and Evolutionary Computing · Computer Science 2016-05-10 Ilya Loshchilov , Tobias Glasmachers

Bilevel optimization is a field of significant theoretical and practical interest, yet solving such optimization problems remains challenging. Evolutionary methods have been employed to address these problems in the black-box setting;…

Neural and Evolutionary Computing · Computer Science 2026-04-06 Marc Ong , Youhei Akimoto

The selection of the most appropriate algorithm to solve a given problem instance, known as algorithm selection, is driven by the potential to capitalize on the complementary performance of different algorithms across sets of problem…

Machine Learning · Computer Science 2024-06-12 Gjorgjina Cenikj , Ana Nikolikj , Gašper Petelin , Niki van Stein , Carola Doerr , Tome Eftimov

The goal of a sequential decision making problem is to design an interactive policy that adaptively selects a group of items, each selection is based on the feedback from the past, in order to maximize the expected utility of selected…

Data Structures and Algorithms · Computer Science 2022-09-13 Shaojie Tang

Finding statistically significant interactions between binary variables is computationally and statistically challenging in high-dimensional settings, due to the combinatorial explosion in the number of hypotheses. Terada et al. recently…

Machine Learning · Statistics 2014-07-07 Felipe Llinares , Mahito Sugiyama , Karsten M. Borgwardt

Black-box optimization is often encountered for decision-making in complex systems management, where the knowledge of system is limited. Under these circumstances, it is essential to balance the utilization of new information with…

Computation · Statistics 2025-01-15 Teng Lian , Jian-Qiang Hu , Yuhang Wu , Zeyu Zheng