English
Related papers

Related papers: Parametric Region Search: A Mixed-Integer Bilevel …

200 papers

This paper presents the Variable Landscape Search (VLS), a novel metaheuristic designed to globally optimize complex problems by dynamically altering the objective function landscape. Unlike traditional methods that operate within a static…

Optimization and Control · Mathematics 2024-08-08 Rustam Mussabayev , Ravil Mussabayev

In transportation planning and development, transport network design problem seeks to optimize specific objectives (e.g. total travel time) through choosing among a given set of projects while keeping consumption of resources (e.g. budget)…

Optimization and Control · Mathematics 2015-02-04 Mehran Fasihozaman Langerudi

A learning approach to selecting regularization parameters in multi-penalty Tikhonov regularization is investigated. It leads to a bilevel optimization problem, where the lower level problem is a Tikhonov regularized problem parameterized…

Optimization and Control · Mathematics 2018-12-05 Gernot Holler , Karl Kunisch , Richard C. Barnard

In this paper, we consider non-convex multi-block bilevel optimization (MBBO) problems, which involve $m\gg 1$ lower level problems and have important applications in machine learning. Designing a stochastic gradient and controlling its…

Optimization and Control · Mathematics 2023-06-05 Quanqi Hu , Zi-Hao Qiu , Zhishuai Guo , Lijun Zhang , Tianbao Yang

This paper surveys the trend of leveraging machine learning to solve mixed integer programming (MIP) problems. Theoretically, MIP is an NP-hard problem, and most of the combinatorial optimization (CO) problems can be formulated as the MIP.…

Artificial Intelligence · Computer Science 2022-03-08 Jiayi Zhang , Chang Liu , Junchi Yan , Xijun Li , Hui-Ling Zhen , Mingxuan Yuan

Large Neighborhood Search (LNS) is a combinatorial optimization heuristic that starts with an assignment of values for the variables to be optimized, and iteratively improves it by searching a large neighborhood around the current…

Optimization and Control · Mathematics 2022-05-23 Nicolas Sonnerat , Pengming Wang , Ira Ktena , Sergey Bartunov , Vinod Nair

Machine learning pipeline potentially consists of several stages of operations like data preprocessing, feature engineering and machine learning model training. Each operation has a set of hyper-parameters, which can become irrelevant for…

Machine Learning · Computer Science 2021-05-04 Xudong Sun , Jiali Lin , Bernd Bischl

Local search is an effective method for solving large-scale combinatorial optimization problems, and it has made remarkable progress in recent years through several subtle mechanisms. In this paper, we found two ways to improve the local…

Artificial Intelligence · Computer Science 2023-06-30 Luyu Jiang , Dantong Ouyang , Qi Zhang , Liming Zhang

In optimization-based image restoration models, the correct selection of hyperparameters is crucial for achieving superior performance. However, current research typically involves manual tuning of these hyperparameters, which is highly…

Optimization and Control · Mathematics 2026-04-03 Hang Xie , Xuewen Li , Peili Li , Qiuyu Wang

As reconfigurable intelligent surfaces (RIS) emerge as a pivotal technology in the upcoming sixth-generation (6G) networks, their deployment within practical multiple operator (OP) networks presents significant challenges, including the…

Systems and Control · Electrical Eng. & Systems 2025-02-24 Haocheng Zhang , Wei Wang , Hao Zhou , Zhiping Lu , Ming Li

Optimization is key to solve many problems in computational biology. Global optimization methods provide a robust methodology, and metaheuristics in particular have proven to be the most efficient methods for many applications. Despite…

Optimization and Control · Mathematics 2013-11-25 Jose A Egea , David Henriques , Thomas Cokelaer , Alejandro F Villaverde , Julio R Banga , Julio Saez-Rodriguez

Hypercomplex signal processing (HSP) offers powerful tools for analyzing and processing multidimensional signals by explicitly exploiting inter-dimensional correlations through Clifford algebra. In recent years, hypercomplex formulations of…

Signal Processing · Electrical Eng. & Systems 2026-03-02 Kumar Vijay Mishra , Henry Arguello , Brian M. Sadler

Multi-step-ahead time series prediction is one of the most challenging research topics in the field of time series modeling and prediction, and is continually under research. Recently, the multiple-input several multiple-outputs (MISMO)…

Artificial Intelligence · Computer Science 2014-01-03 Yukun Bao , Tao Xiong , Zhongyi Hu

Biclustering is an unsupervised machine learning technique that simultaneously clusters rows and columns in a data matrix. Biclustering has emerged as an important approach and plays an essential role in various applications such as…

Machine Learning · Computer Science 2022-03-31 Adan Jose-Garcia , Julie Jacques , Vincent Sobanski , Clarisse Dhaenens

Deep learning models form one of the most powerful machine learning models for the extraction of important features. Most of the designs of deep neural models, i.e., the initialization of parameters, are still manually tuned. Hence,…

Machine Learning · Computer Science 2023-05-18 Mrittika Chakraborty , Wreetbhas Pal , Sanghamitra Bandyopadhyay , Ujjwal Maulik

We present new algorithms for Personalized PageRank estimation and Personalized PageRank search. First, for the problem of estimating Personalized PageRank (PPR) from a source distribution to a target node, we present a new bidirectional…

Data Structures and Algorithms · Computer Science 2015-12-16 Peter Lofgren , Siddhartha Banerjee , Ashish Goel

Multivariate regression models are widely used in various fields such as biology and finance. In this paper, we focus on two key challenges: (a) When should we favor a multivariate model over a series of univariate models; (b) If the…

Methodology · Statistics 2020-03-25 Yuehan Yang , Siwei Xia , Hu Yang

Though effective in the segmentation, conventional multilevel thresholding methods are computationally expensive as exhaustive search are used for optimal thresholds to optimize the objective functions. To overcome this problem,…

Neural and Evolutionary Computing · Computer Science 2020-06-18 Xiaotao Huang , Liang Shen , Chongyi Fan , Jiahua zhu , Sixian Chen

Pareto Local Search (PLS) is a basic building block in many metaheuristics for Multiobjective Combinatorial Optimization Problem (MCOP). In this paper, an enhanced PLS variant called Parallel Pareto Local Search based on Decomposition…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-11-12 Jialong Shi , Qingfu Zhang , Jianyong Sun

Direct Preference Optimization (DPO) is an effective framework for aligning large language models with human preferences, but it struggles with complex reasoning tasks. DPO optimizes for the likelihood of generating preferred over…

Artificial Intelligence · Computer Science 2026-04-23 Darsh Kachroo , Adriana Caraeni , Arjun Prasaath Anbazhagan , Brennan Lagasse , Kevin Zhu