English
Related papers

Related papers: Heuristic Learning for Co-Design Scheme of Optimal…

200 papers

This survey is focused on certain sequential decision-making problems that involve optimizing over probability functions. We discuss the relevance of these problems for learning and control. The survey is organized around a framework that…

Optimization and Control · Mathematics 2023-01-13 Emiland Garrabe , Giovanni Russo

As deep learning techniques advance more than ever, hyper-parameter optimization is the new major workload in deep learning clusters. Although hyper-parameter optimization is crucial in training deep learning models for high model…

Machine Learning · Computer Science 2019-11-26 Ahnjae Shin , Dong-Jin Shin , Sungwoo Cho , Do Yoon Kim , Eunji Jeong , Gyeong-In Yu , Byung-Gon Chun

Sequential Bayesian optimal experimental design (SBOED) for PDE-governed inverse problems is computationally challenging, especially for infinite-dimensional random field parameters. High-fidelity approaches require repeated forward and…

Optimization and Control · Mathematics 2026-01-12 Kaichen Shen , Peng Chen

Optimal selection of interdependent IT Projects for implementation in multi periods has been challenging in the framework of real option valuation. This paper presents a mathematical optimization model for multi-stage portfolio of IT…

Computational Engineering, Finance, and Science · Computer Science 2010-06-15 Shashank Pushkar , Abhijit Mustafi , Akhileshwar Mishra

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Biclustering, also known as co-clustering or two-way clustering, simultaneously partitions the rows and columns of a data matrix to reveal submatrices with coherent patterns. Incorporating background knowledge into clustering to enhance…

Optimization and Control · Mathematics 2026-02-24 Antonio M. Sudoso

Selecting input variables or design points for statistical models has been of great interest in adaptive design and active learning. Motivated by two scientific examples, this paper presents a strategy of selecting the design points for a…

Machine Learning · Statistics 2021-02-12 Chiwoo Park , Peihua Qiu , Jennifer Carpena-Núñez , Rahul Rao , Michael Susner , Benji Maruyama

Heuristic algorithms play a vital role in solving combinatorial optimization (CO) problems, yet traditional designs depend heavily on manual expertise and struggle to generalize across diverse instances. We introduce \textbf{HeurAgenix}, a…

Artificial Intelligence · Computer Science 2025-06-25 Xianliang Yang , Ling Zhang , Haolong Qian , Lei Song , Jiang Bian

We present a novel dual control strategy for uncertain linear systems based on targeted harmonic exploration and gain-scheduling with performance and excitation guarantees. In the proposed sequential approach, robust control is implemented…

Systems and Control · Electrical Eng. & Systems 2024-07-30 Janani Venkatasubramanian , Johannes Köhler , Julian Berberich , Frank Allgöwer

We consider learning problems over training sets in which both, the number of training examples and the dimension of the feature vectors, are large. To solve these problems we propose the random parallel stochastic algorithm (RAPSA). We…

Machine Learning · Computer Science 2016-03-23 Aryan Mokhtari , Alec Koppel , Alejandro Ribeiro

The integration of Reinforcement Learning (RL) with heuristic methods is an emerging trend for solving optimization problems, which leverages RL's ability to learn from the data generated during the search process. One promising approach is…

Machine Learning · Computer Science 2024-09-19 Arthur Müller , Lukas Vollenkemper

A human's attention can intuitively adapt to corrupted areas of an image by recalling a similar uncorrupted image they have previously seen. This observation motivates us to improve the attention of adversarial images by considering their…

Computer Vision and Pattern Recognition · Computer Science 2022-01-05 Runqi Wang , Xiaoyue Duan , Baochang Zhang , Song Xue , Wentao Zhu , David Doermann , Guodong Guo

Sequential-in-time methods solve a sequence of training problems to fit nonlinear parametrizations such as neural networks to approximate solution trajectories of partial differential equations over time. This work shows that…

Numerical Analysis · Mathematics 2024-04-02 Huan Zhang , Yifan Chen , Eric Vanden-Eijnden , Benjamin Peherstorfer

Many of the artificial intelligence techniques developed to date rely on heuristic search through large spaces. Unfortunately, the size of these spaces and the corresponding computational effort reduce the applicability of otherwise novel…

Artificial Intelligence · Computer Science 2011-05-30 D. J. Cook , R. C. Varnell

We propose a hierarchical architecture for efficiently computing high-quality solutions to structured mixed-integer programs (MIPs). To reduce computational effort, our approach decouples the original problem into a higher level problem and…

Optimization and Control · Mathematics 2025-12-04 Stefan Clarke , Bartolomeo Stellato

Large Language Model-based Hyper Heuristic (LHH) has recently emerged as an efficient way for automatic heuristic design. However, most existing LHHs just perform well in optimizing a single function within a pre-defined solver. Their…

Artificial Intelligence · Computer Science 2026-04-15 Chuyang Xiang , Yichen Wei , Jiale Ma , Handing Wang , Junchi Yan

Heuristic design with large language models (LLMs) has emerged as a promising approach for tackling combinatorial optimization problems (COPs). However, existing approaches often rely on manually predefined evolutionary computation (EC)…

Machine Learning · Computer Science 2026-03-25 Yiding Shi , Jianan Zhou , Wen Song , Jieyi Bi , Yaoxin Wu , Zhiguang Cao , Jie Zhang

In this paper we apply a two-stage sequential design to item calibration problems under a three-parameter logistic model assumption. The measurement errors of the estimates of the latent trait levels of examinees are considered in our…

Applications · Statistics 2013-05-23 Yuan-chin Ivan Chang

In this paper, we consider a remote inference system, where a neural network is used to infer a time-varying target (e.g., robot movement), based on features (e.g., video clips) that are progressively received from a sensing node (e.g., a…

Information Theory · Computer Science 2024-06-25 Md Kamran Chowdhury Shisher , Bo Ji , I-Hong Hou , Yin Sun

Bayesian optimal experimental design has immense potential to inform the collection of data so as to subsequently enhance our understanding of a variety of processes. However, a major impediment is the difficulty in evaluating optimal…

Computation · Statistics 2018-03-14 David J. Price , Nigel G. Bean , Joshua V. Ross , Jonathan Tuke