English
Related papers

Related papers: Learning to Solve the Constrained Most Probable Ex…

200 papers

Probabilistic circuits (PCs) such as sum-product networks efficiently represent large multi-variate probability distributions. They are preferred in practice over other probabilistic representations such as Bayesian and Markov networks…

Machine Learning · Computer Science 2024-02-07 Shivvrat Arya , Tahrima Rahman , Vibhav Gogate

We consider the problem of communicating exogenous information by means of Markov decision process trajectories. This setting, which we call a Markov coding game (MCG), generalizes both source coding and a large class of referential games.…

This paper studies the remote estimation of multiple Markov sources over a lossy and rate-constrained channel. Unlike most existing studies that treat all source states equally, we exploit the \emph{semantics of information} and consider…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Jiping Luo , Nikolaos Pappas

Maximizing oil production from gas-lifted oil wells entails solving Mixed-Integer Linear Programs (MILPs). As the parameters of the wells, such as the basic-sediment-to-water ratio and the gas-oil ratio, are updated, the problems must be…

Machine Learning · Computer Science 2023-09-04 Bruno Machado Pacheco , Laio Oriel Seman , Eduardo Camponogara

We study the Safe Reinforcement Learning (SRL) problem using the Constrained Markov Decision Process (CMDP) formulation in which an agent aims to maximize the expected total reward subject to a safety constraint on the expected total value…

Machine Learning · Computer Science 2020-10-27 Dongsheng Ding , Xiaohan Wei , Zhuoran Yang , Zhaoran Wang , Mihailo R. Jovanović

We consider the infinite-horizon linear Markov Decision Processes (MDPs), where the transition probabilities of the dynamic model can be linearly parameterized with the help of a predefined low-dimensional feature mapping. While the…

Machine Learning · Computer Science 2023-10-19 Yu-Heng Hung , Ping-Chun Hsieh , Akshay Mete , P. R. Kumar

In this paper, we investigate the combination of synthesis, model-based learning, and online sampling techniques to obtain safe and near-optimal schedulers for a preemptible task scheduling problem. Our algorithms can handle Markov decision…

Artificial Intelligence · Computer Science 2021-07-14 Damien Busatto-Gaston , Debraj Chakraborty , Shibashis Guha , Guillermo A. Pérez , Jean-François Raskin

Recently, message-passing graph neural networks (MPNNs) have shown potential for solving combinatorial and continuous optimization problems due to their ability to capture variable-constraint interactions. While existing approaches leverage…

Artificial Intelligence · Computer Science 2025-02-05 Chendi Qian , Christopher Morris

Structural learning, a method to estimate the parameters for discrete energy minimization, has been proven to be effective in solving computer vision problems, especially in 3D scene parsing. As the complexity of the models increases,…

Computer Vision and Pattern Recognition · Computer Science 2017-01-13 Mengtian Li , Daniel Huber

A number of algorithms have been developed to solve probabilistic inference problems on belief networks. These algorithms can be divided into two main groups: exact techniques which exploit the conditional independence revealed when the…

Artificial Intelligence · Computer Science 2013-04-08 Ross D. Shachter , Mark Alan Peot

A new robust algorithm based of the explanation method SurvLIME called SurvLIME-KS is proposed for explaining machine learning survival models. The algorithm is developed to ensure robustness to cases of a small amount of training data or…

Machine Learning · Computer Science 2020-05-06 Maxim S. Kovalev , Lev V. Utkin

We study the discriminative probabilistic modeling on a continuous domain for the data prediction task of (multimodal) self-supervised representation learning. To address the challenge of computing the integral in the partition function for…

Machine Learning · Computer Science 2025-03-06 Bokun Wang , Yunwen Lei , Yiming Ying , Tianbao Yang

The canonical solution methodology for finite constrained Markov decision processes (CMDPs), where the objective is to maximize the expected infinite-horizon discounted rewards subject to the expected infinite-horizon discounted costs…

Machine Learning · Computer Science 2020-05-11 Sami Khairy , Prasanna Balaprakash , Lin X. Cai

To reduce the heavy computational burden of reactive power optimization of distribution networks, machine learning models are receiving increasing attention. However, most machine learning models (e.g., neural networks) are usually…

Systems and Control · Electrical Eng. & Systems 2023-11-08 Wenlong Liao , Benjamin Schäfer , Dalin Qin , Gonghao Zhang , Zhixian Wang , Zhe Yang

Maximum likelihood estimation (MLE) of latent variable models is often recast as the minimization of a free energy functional over an extended space of parameters and probability distributions. This perspective was recently combined with…

Machine Learning · Computer Science 2024-06-05 Jen Ning Lim , Juan Kuntz , Samuel Power , Adam M. Johansen

This paper studies the problem of parameter learning in probabilistic graphical models having latent variables, where the standard approach is the expectation maximization algorithm alternating expectation (E) and maximization (M) steps.…

Machine Learning · Computer Science 2017-02-15 Hyeryung Jang , Hyungwon Choi , Yung Yi , Jinwoo Shin

Solving math word problems is the task that analyses the relation of quantities and requires an accurate understanding of contextual natural language information. Recent studies show that current models rely on shallow heuristics to predict…

Computation and Language · Computer Science 2022-11-30 Yibin Shen , Qianying Liu , Zhuoyuan Mao , Fei Cheng , Sadao Kurohashi

It is common to address the curse of dimensionality in Markov decision processes (MDPs) by exploiting low-rank representations. This motivates much of the recent theoretical study on linear MDPs. However, most approaches require a given…

Machine Learning · Computer Science 2022-12-09 Tianjun Zhang , Tongzheng Ren , Mengjiao Yang , Joseph E. Gonzalez , Dale Schuurmans , Bo Dai

Undirected graphical models known as Markov networks are popular for a wide variety of applications ranging from statistical physics to computational biology. Traditionally, learning of the network structure has been done under the…

Machine Learning · Statistics 2025-06-26 Johan Pensar , Henrik Nyman , Juha Niiranen , Jukka Corander

Learning structured models using maximum margin techniques has become an indispensable tool for com- puter vision researchers, as many computer vision applications can be cast naturally as an image labeling problem. Pixel-based or…

Machine Learning · Computer Science 2013-09-17 Andreas Christian Mueller , Sven Behnke