English
Related papers

Related papers: Hardness as randomness: a survey of universal dera…

200 papers

In this paper we consider a nondeterministic computation by deterministic multi-head 2-way automata having a read-only access to an auxiliary memory. The memory contains additional data (a guess) and computation is successful iff it is…

Computational Complexity · Computer Science 2008-11-18 M. N. Vyalyi

This paper considers the computational hardness of computing expected outcomes and deciding (universal) (positive) almost-sure termination of probabilistic programs. It is shown that computing lower and upper bounds of expected outcomes is…

Logic in Computer Science · Computer Science 2015-06-08 Benjamin Lucien Kaminski , Joost-Pieter Katoen

We show how complexity theory can be introduced in machine learning to help bring together apparently disparate areas of current research. We show that this new approach requires less training data and is more generalizable as it shows…

Machine Learning · Computer Science 2019-10-10 Santiago Hernández-Orozco , Hector Zenil , Jürgen Riedel , Adam Uccello , Narsis A. Kiani , Jesper Tegnér

We consider the problem of finding nearly optimal solutions of optimization problems with random objective functions. Two concrete problems we consider are (a) optimizing the Hamiltonian of a spherical or Ising $p$-spin glass model, and (b)…

Computational Complexity · Computer Science 2022-01-27 David Gamarnik , Aukosh Jagannath , Alexander S. Wein

We consider robust optimization problems, where the goal is to optimize in the worst case over a class of objective functions. We develop a reduction from robust improper optimization to Bayesian optimization: given an oracle that returns…

Machine Learning · Computer Science 2017-07-05 Robert Chen , Brendan Lucier , Yaron Singer , Vasilis Syrgkanis

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

Machine Learning · Computer Science 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Despite extensive progress on image generation, common deep generative model architectures are not easily applied to lossless compression. For example, VAEs suffer from a compression cost overhead due to their latent variables. This…

Machine Learning · Computer Science 2022-03-17 Anji Liu , Stephan Mandt , Guy Van den Broeck

An important objective of research in counting complexity is to understand which counting problems are approximable. In this quest, the complexity class TotP, a hard subclass of #P, is of key importance, as it contains self-reducible…

Computational Complexity · Computer Science 2020-06-02 Eleni Bakali , Aggeliki Chalki , Aris Pagourtzis

Many real life optimization problems contain both hard and soft constraints, as well as qualitative conditional preferences. However, there is no single formalism to specify all three kinds of information. We therefore propose a framework,…

Artificial Intelligence · Computer Science 2009-05-26 Carmel Domshlak , Francesca Rossi , Kristen Brent Venable , Toby Walsh

We survey a collective achievement of a group of researchers: the PCP Theorems. They give new definitions of the class \np, and imply that computing approximate solutions to many \np-hard problems is itself \np-hard. Techniques developed to…

Computational Complexity · Computer Science 2008-12-15 Sanjeev Arora

Probabilistic circuits compute multilinear polynomials that represent multivariate probability distributions. They are tractable models that support efficient marginal inference. However, various polynomial semantics have been considered in…

Artificial Intelligence · Computer Science 2024-08-09 Oliver Broadrick , Honghua Zhang , Guy Van den Broeck

The emergent field of probabilistic numerics has thus far lacked clear statistical principals. This paper establishes Bayesian probabilistic numerical methods as those which can be cast as solutions to certain inverse problems within the…

Methodology · Statistics 2019-11-15 Jon Cockayne , Chris Oates , Tim Sullivan , Mark Girolami

We present a new proof rule for verifying lower bounds on quantities of probabilistic programs. Our proof rule is not confined to almost-surely terminating programs -- as is the case for existing rules -- and can be used to establish…

Logic in Computer Science · Computer Science 2023-02-14 Shenghua Feng , Mingshuai Chen , Han Su , Benjamin Lucien Kaminski , Joost-Pieter Katoen , Naijun Zhan

We present RSLR, an implicit higher-order characterization of the class PP of those problems which can be decided in probabilistic polynomial time with error probability smaller than 1/2. Analogously, a (less implicit) characterization of…

Logic in Computer Science · Computer Science 2012-02-16 Ugo Dal Lago , Paolo Parisen Toldin

The problem $\textrm{PosSLP}$ involves determining whether an integer computed by a given straight-line program is positive. This problem has attracted considerable attention within the field of computational complexity as it provides a…

Computational Complexity · Computer Science 2023-07-18 Peter Bürgisser , Gorav Jindal

The lower and upper bound of any given algorithm is one of the most crucial pieces of information needed when evaluating the computational effectiveness for said algorithm. Here a novel method of Boolean Algebraic Programming for symbolic…

Data Structures and Algorithms · Computer Science 2014-07-14 Daniel McCormack

Probabilistic circuits (PCs) are a family of generative models which allows for the computation of exact likelihoods and marginals of its probability distributions. PCs are both expressive and tractable, and serve as popular choices for…

Machine Learning · Computer Science 2021-12-03 Andy Shih , Dorsa Sadigh , Stefano Ermon

This survey is focused on certain sequential decision-making problems that involve optimizing over probability functions. We discuss the relevance of these problems for learning and control. The survey is organized around a framework that…

Optimization and Control · Mathematics 2023-01-13 Emiland Garrabe , Giovanni Russo

Considering the problem of sampling from the output photon-counting probability distribution of a linear-optical network for input Gaussian states, we obtain results that are of interest from both quantum theory and the computational…

Quantum Physics · Physics 2015-02-16 Saleh Rahimi-Keshari , Austin P. Lund , Timothy C. Ralph

Probabilistic classifiers output a probability distribution on target classes rather than just a class prediction. Besides providing a clear separation of prediction and decision making, the main advantage of probabilistic models is their…

Machine Learning · Computer Science 2019-02-20 Juozas Vaicenavicius , David Widmann , Carl Andersson , Fredrik Lindsten , Jacob Roll , Thomas B. Schön