English
Related papers

Related papers: Scalable Kernel Inverse Optimization

200 papers

Bayesian optimization (BO) based on Gaussian process models is a powerful paradigm to optimize black-box functions that are expensive to evaluate. While several BO algorithms provably converge to the global optimum of the unknown function,…

Machine Learning · Statistics 2019-04-03 Felix Berkenkamp , Angela P. Schoellig , Andreas Krause

Efficient surgery room scheduling is essential for hospital efficiency, patient satisfaction, and resource utilization. This study addresses this challenge by introducing a novel concept of Random-Key Optimizer (RKO), rigorously tested on…

Neural and Evolutionary Computing · Computer Science 2025-01-27 Bruno Salezze Vieira , Eduardo Machado Silva , Antonio Augusto Chaves

The paper introduces a new efficient nonlinear one-class classifier formulated as the Rayleigh quotient criterion optimisation. The method, operating in a reproducing kernel Hilbert space, minimises the scatter of target distribution along…

Machine Learning · Computer Science 2019-02-12 Shervin Rahimzadeh Arashloo , Josef Kittler

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

Reduced modeling of a computationally demanding dynamical system aims at approximating its trajectories, while optimizing the trade-off between accuracy and computational complexity. In this work, we propose to achieve such an approximation…

Machine Learning · Statistics 2025-02-20 Patrick Héas , Cédric Herzet , Benoit Combès

Conventional inverse optimization inputs a solution and finds the parameters of an optimization model that render a given solution optimal. The literature mostly focuses on inferring the objective function in linear problems when accepted…

Optimization and Control · Mathematics 2024-10-10 Houra Mahmoudzadeh , Kimia Ghobadi

Reinforcement learning in complex environments is a challenging problem. In particular, the success of reinforcement learning algorithms depends on a well-designed reward function. Inverse reinforcement learning (IRL) solves the problem of…

Machine Learning · Computer Science 2021-01-20 Rakhoon Hwang , Hanjin Lee , Hyung Ju Hwang

We propose a general framework for policy representation for reinforcement learning tasks. This framework involves finding a low-dimensional embedding of the policy on a reproducing kernel Hilbert space (RKHS). The usage of RKHS based…

Machine Learning · Computer Science 2020-10-16 Bogdan Mazoure , Thang Doan , Tianyu Li , Vladimir Makarenkov , Joelle Pineau , Doina Precup , Guillaume Rabusseau

In data-driven inverse optimization an observer aims to learn the preferences of an agent who solves a parametric optimization problem depending on an exogenous signal. Thus, the observer seeks the agent's objective function that best…

Optimization and Control · Mathematics 2017-07-25 Peyman Mohajerin Esfahani , Soroosh Shafieezadeh-Abadeh , Grani Adiwena Hanasusanto , Daniel Kuhn

This paper studies the decentralized optimization and learning problem where multiple interconnected agents aim to learn an optimal decision function defined over a reproducing kernel Hilbert space by jointly minimizing a global objective…

Machine Learning · Computer Science 2021-07-01 Ping Xu , Yue Wang , Xiang Chen , Zhi Tian

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

A large class of inverse problems for PDEs are only well-defined as mappings from operators to functions. Existing operator learning frameworks map functions to functions and need to be modified to learn inverse maps from data. We propose a…

Machine Learning · Computer Science 2023-06-06 Roberto Molinaro , Yunan Yang , Björn Engquist , Siddhartha Mishra

Kernel methods form a theoretically-grounded, powerful and versatile framework to solve nonlinear problems in signal processing and machine learning. The standard approach relies on the \emph{kernel trick} to perform pairwise evaluations of…

Machine Learning · Computer Science 2020-01-03 Kan Li , Jose C. Principe

The fundamental goal of self-supervised learning (SSL) is to produce useful representations of data without access to any labels for classifying the data. Modern methods in SSL, which form representations based on known or constructed…

Machine Learning · Computer Science 2022-09-30 Bobak T. Kiani , Randall Balestriero , Yubei Chen , Seth Lloyd , Yann LeCun

We propose algorithms to take point sets for kernel-based interpolation of functions in reproducing kernel Hilbert spaces (RKHSs) by convex optimization. We consider the case of kernels with the Mercer expansion and propose an algorithm by…

Numerical Analysis · Mathematics 2019-08-19 Ken'ichiro Tanaka

A general framework of unsupervised learning for combinatorial optimization (CO) is to train a neural network (NN) whose output gives a problem solution by directly optimizing the CO objective. Albeit with some advantages over traditional…

Machine Learning · Computer Science 2023-01-24 Haoyu Wang , Pan Li

Inverse Reinforcement Learning (IRL) learns a reward function to explain expert demonstrations. Modern IRL methods often use the adversarial (minimax) formulation that alternates between reward and policy optimization, which often lead to…

Machine Learning · Computer Science 2025-10-14 Yang Chen , Menglin Zou , Jiaqi Zhang , Yitan Zhang , Junyi Yang , Gael Gendron , Libo Zhang , Jiamou Liu , Michael J. Witbrock

We introduce a unified framework for learning the spatio-temporal dynamics of vector valued functions by combining operator valued reproducing kernel Hilbert spaces (OV-RKHS) with kernel based Koopman operator methods. The approach enables…

Machine Learning · Computer Science 2025-08-27 Mahishanka Withanachchi

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

A linear operator in a Hilbert space defined through the form of Riesz representation naturally introduces a reproducing kernel Hilbert space structure over the range space. Such formulation, called H-HK formulation in this paper, possesses…

Analysis of PDEs · Mathematics 2021-10-27 Tao Qian