English
Related papers

Related papers: Balans: Multi-Armed Bandits-based Adaptive Large N…

200 papers

The contextual multi-armed bandit (MAB) is a widely used framework for problems requiring sequential decision-making under uncertainty, such as recommendation systems. In applications involving a large number of users, the performance of…

Machine Learning · Computer Science 2025-02-05 Zhiyong Wang , Jiahang Sun , Mingze Kong , Jize Xie , Qinghua Hu , John C. S. Lui , Zhongxiang Dai

Online learning in large-scale structured bandits is known to be challenging due to the curse of dimensionality. In this paper, we propose a unified meta-learning framework for a general class of structured bandit problems where the…

Machine Learning · Computer Science 2022-03-01 Runzhe Wan , Lin Ge , Rui Song

Recent advances in mathematical programming have made Mixed Integer Optimization a competitive alternative to popular regularization methods for selecting features in regression problems. The approach exhibits unquestionable foundational…

Methodology · Statistics 2019-10-01 Ana Kenney , Francesca Chiaromonte , Giovanni Felici

Cutting plane methods play a significant role in modern solvers for tackling mixed-integer programming (MIP) problems. Proper selection of cuts would remove infeasible solutions in the early stage, thus largely reducing the computational…

Optimization and Control · Mathematics 2021-10-11 Zeren Huang , Kerong Wang , Furui Liu , Hui-ling Zhen , Weinan Zhang , Mingxuan Yuan , Jianye Hao , Yong Yu , Jun Wang

This paper proposes a Heaviside composite optimization approach and presents a progressive (mixed) integer programming (PIP) method for solving multi-class classification and multi-action treatment problems with constraints. A Heaviside…

Optimization and Control · Mathematics 2024-01-08 Yue Fang , Junyi Liu , Jong-Shi Pang

Meta-learning is characterized by its ability to learn how to learn, enabling the adaptation of learning strategies across different tasks. Recent research introduced the Meta-Thompson Sampling (Meta-TS), which meta-learns an unknown prior…

Machine Learning · Statistics 2024-09-12 Hao Li , Dong Liang , Zheng Xie

For pre-training of MoE (Mixture-of-Experts) models, one of the main issues is unbalanced expert loads, which may cause routing collapse or increased computational overhead. Existing methods contain the Loss-Controlled method and the…

Machine Learning · Computer Science 2025-03-21 Yuan Sun

Elimination algorithms for bandit identification, which prune the plausible correct answers sequentially until only one remains, are computationally convenient since they reduce the problem size over time. However, existing elimination…

Machine Learning · Computer Science 2022-10-25 Andrea Tirinzoni , Rémy Degenne

Large Neighborhood Search (LNS) is a common heuristic in combinatorial optimization that iteratively searches over a large neighborhood of the current solution for a better one. Recently, neural network-based LNS solvers have achieved great…

Machine Learning · Computer Science 2025-08-25 Shengyu Feng , Zhiqing Sun , Yiming Yang

This applied research article explores the application of Mixed-Integer Linear Programming (MILP) to address line-balancing challenges in the garment industry, focusing on optimizing production processes under multiple constraints. By…

Optimization and Control · Mathematics 2025-04-10 Ray Wai Man Kong , Ding Ning , Theodore Ho Tin Kong

Extracting actionable intelligence from distributed, heterogeneous, correlated and high-dimensional data sources requires run-time processing and learning both locally and globally. In the last decade, a large number of meta-learning…

Machine Learning · Computer Science 2016-11-01 Cem Tekin , Jinsung Yoon , Mihaela van der Schaar

Mixed-Integer Programs (MIPs) are NP-hard optimization models that arise in a broad range of decision-making applications, including finance, logistics, energy systems, and network design. Although modern commercial solvers have achieved…

Partial MaxSAT (PMS) and Weighted PMS (WPMS) are two practical generalizations of the MaxSAT problem. In this paper, we propose a local search algorithm for these problems, called BandHS, which applies two multi-armed bandits to guide the…

Artificial Intelligence · Computer Science 2022-11-30 Jiongzhi Zheng , Kun He , Jianrong Zhou , Yan Jin , Chu-Min Li , Felip Manyà

Multi-armed bandit (MAB) problems are widely applied to online optimization tasks that require balancing exploration and exploitation. In practical scenarios, these tasks often involve multiple conflicting objectives, giving rise to…

Machine Learning · Computer Science 2025-06-17 Mansoor Davoodi , Setareh Maghsudi

Contextual bandits are a form of multi-armed bandit in which the agent has access to predictive side information (known as the context) for each arm at each time step, and have been used to model personalized news recommendation, ad…

Machine Learning · Statistics 2017-05-25 Aniket Anand Deshmukh , Urun Dogan , Clayton Scott

Clustering is a ubiquitous task in data science. Compared to the commonly used $k$-means clustering, $k$-medoids clustering requires the cluster centers to be actual data points and support arbitrary distance metrics, which permits greater…

Machine Learning · Computer Science 2020-12-08 Mo Tiwari , Martin Jinye Zhang , James Mayclin , Sebastian Thrun , Chris Piech , Ilan Shomorony

Mixed-integer convex programming (MICP) has seen significant algorithmic and hardware improvements with several orders of magnitude solve time speedups compared to 25 years ago. Despite these advances, MICP has been rarely applied to…

Robotics · Computer Science 2022-04-12 A. Cauligi , P. Culbertson , B. Stellato , D. Bertsimas , M. Schwager , M. Pavone

In this paper, we describe a comprehensive algorithmic framework for solving mixed integer bilevel linear optimization problems (MIBLPs) using a generalized branch-and-cut approach. The framework presented merges features from existing…

Optimization and Control · Mathematics 2021-04-20 Sahar Tahernejad , Ted K. Ralphs , Scott T. DeNegre

Recently various optimization problems, such as Mixed Integer Linear Programming Problems (MILPs), have undergone comprehensive investigation, leveraging the capabilities of machine learning. This work focuses on learning-based solutions…

Machine Learning · Computer Science 2024-06-21 Zhentao Tan , Yadong Mu

Practical use of neural networks often involves requirements on latency, energy and memory among others. A popular approach to find networks under such requirements is through constrained Neural Architecture Search (NAS). However, previous…

Machine Learning · Computer Science 2022-04-28 Niv Nayman , Yonathan Aflalo , Asaf Noy , Rong Jin , Lihi Zelnik-Manor