English
Related papers

Related papers: Semi-Empirical Objective Functions for MCMC Propos…

200 papers

While model selection is a well-studied topic in parametric and nonparametric regression or density estimation, selection of possibly high-dimensional nuisance parameters in semiparametric problems is far less developed. In this paper, we…

Methodology · Statistics 2023-09-06 Yifan Cui , Eric Tchetgen Tchetgen

Maximizing a single submodular set function subject to a cardinality constraint is a well-studied and central topic in combinatorial optimization. However, finding a set that maximizes multiple functions at the same time is much less…

Data Structures and Algorithms · Computer Science 2025-05-16 Fabian Spaeh , Atsushi Miyauchi

Recent research has led to the development of MCMC algorithms with likelihood-informed proposals when targeting posterior distributions supported on discrete state spaces. Our work is placed within this field and puts forward a new MCMC…

Methodology · Statistics 2026-05-22 Luca Aiello , Raffaele Argiento , Alexandros Beskos , Maria De Iorio

Many problems arising in applications result in the need to probe a probability distribution for functions. Examples include Bayesian nonparametric statistics and conditioned diffusion processes. Standard MCMC algorithms typically become…

Computation · Statistics 2015-03-20 S. L. Cotter , G. O. Roberts , A. M. Stuart , D. White

Real-world scenarios frequently involve multi-objective data-driven optimization problems, characterized by unknown problem coefficients and multiple conflicting objectives. Traditional two-stage methods independently apply a machine…

Machine Learning · Computer Science 2024-06-04 Peng Li , Lixia Wu , Chaoqun Feng , Haoyuan Hu , Lei Fu , Jieping Ye

Subset selection tasks, arise in recommendation systems and search engines and ask to select a subset of items that maximize the value for the user. The values of subsets often display diminishing returns, and hence, submodular functions…

Machine Learning · Computer Science 2023-05-05 Anay Mehrotra , Nisheeth K. Vishnoi

Geometric programming problems occur frequently in engineering design and management. In multiobjective optimization, the trade-off information between different objective functions is probably the most important piece of information in a…

Data Structures and Algorithms · Computer Science 2010-03-25 A. K. Ojha , A. K. Das

Partially observable Markov decision processes (POMDPs) provide an elegant mathematical framework for modeling complex decision and planning problems in stochastic domains in which states of the system are observable only indirectly, via a…

Artificial Intelligence · Computer Science 2011-06-02 M. Hauskrecht

A novel neural network (NN) approach is proposed for constrained optimization. The proposed method uses a specially designed NN architecture and training/optimization procedure called Neural Optimization Machine (NOM). The objective…

Machine Learning · Statistics 2022-08-10 Jie Chen , Yongming Liu

Traditional MCMC algorithms are computationally intensive and do not scale well to large data. In particular, the Metropolis-Hastings (MH) algorithm requires passing over the entire dataset to evaluate the likelihood ratio in each…

Machine Learning · Statistics 2019-08-29 Tung-Yu Wu , Y. X. Rachel Wang , Wing H. Wong

Bayesian modelling and computational inference by Markov chain Monte Carlo (MCMC) is a principled framework for large-scale uncertainty quantification, though is limited in practice by computational cost when implemented in the simplest…

Computation · Statistics 2020-09-21 Colin Fox , Tiangang Cui , Markus Neumayer

In this paper, we identify partial correlation information structures that allow for simpler reformulations in evaluating the maximum expected value of mixed integer linear programs with random objective coefficients. To this end, assuming…

Optimization and Control · Mathematics 2018-10-25 Divya Padmanabhan , Karthik Natarajan , Karthyek R. A. Murthy

Machine learning tasks are generally formulated as optimization problems, where one searches for an optimal function within a certain functional space. In practice, parameterized functional spaces are considered, in order to be able to…

Artificial Intelligence · Computer Science 2024-12-13 Manon Verbockhaven , Sylvain Chevallier , Guillaume Charpiat , Théo Rudkiewicz

Approximate Bayesian Computation (ABC) is a useful class of methods for Bayesian inference when the likelihood function is computationally intractable. In practice, the basic ABC algorithm may be inefficient in the presence of discrepancy…

Statistics Theory · Mathematics 2015-05-14 Stefano Cabras , Maria Eugenia Castellanos Nueda , Erlis Ruli

Markov decision processes (MDPs) are used to model a wide variety of applications ranging from game playing over robotics to finance. Their optimal policy typically maximizes the expected sum of rewards given at each step of the decision…

Machine Learning · Computer Science 2025-05-26 Maximilian Nägele , Jan Olle , Thomas Fösel , Remmy Zen , Florian Marquardt

We propose a new method for optimistic planning in infinite-horizon discounted Markov decision processes based on the idea of adding regularization to the updates of an otherwise standard approximate value iteration procedure. This…

Machine Learning · Computer Science 2023-06-16 Antoine Moulin , Gergely Neu

Binary optimization has a wide range of applications in combinatorial optimization problems such as MaxCut, MIMO detection, and MaxSAT. However, these problems are typically NP-hard due to the binary constraints. We develop a novel…

Optimization and Control · Mathematics 2023-07-04 Cheng Chen , Ruitao Chen , Tianyou Li , Ruichen Ao , Zaiwen Wen

Online-learning research has mainly been focusing on minimizing one objective function. In many real-world applications, however, several objective functions have to be considered simultaneously. Recently, an algorithm for dealing with…

Machine Learning · Computer Science 2017-03-21 Guy Uziel , Ran El-Yaniv

Computational design problems arise in a number of settings, from synthetic biology to computer architectures. In this paper, we aim to solve data-driven model-based optimization (MBO) problems, where the goal is to find a design input that…

Machine Learning · Computer Science 2021-07-15 Brandon Trabucco , Aviral Kumar , Xinyang Geng , Sergey Levine

Real-world applications are now processing big-data sets, often bottlenecked by the data movement between the compute units and the main memory. Near-memory computing (NMC), a modern data-centric computational paradigm, can alleviate these…

Hardware Architecture · Computer Science 2021-06-30 Stefano Corda , Madhurya Kumaraswamy , Ahsan Javed Awan , Roel Jordans , Akash Kumar , Henk Corporaal