English
Related papers

Related papers: Learning Hard-Constrained Models with One Sample

200 papers

This paper introduces new efficient algorithms for two problems: sampling conditional on vertex degrees in unweighted graphs, and sampling conditional on vertex strengths in weighted graphs. The algorithms can sample conditional on the…

Methodology · Statistics 2018-09-19 James Scott , Axel Gandy

Randomized experiments are the gold standard for estimating the average treatment effect (ATE). While covariate adjustment can reduce the asymptotic variances of the unbiased Horvitz-Thompson estimators for the ATE, it suffers from…

Methodology · Statistics 2025-08-22 Xin Lu , Lei Shi , Hanzhong Liu , Peng Ding

Using T=0 Monte Carlo simulation, we study the relaxation of graph coloring (K-COL) and satisfiability (K-SAT), two hard problems that have recently been shown to possess a phase transition in solvability as a parameter is varied. A change…

Disordered Systems and Neural Networks · Physics 2009-10-31 Pontus Svenson , Mats G. Nordahl

Though neural network models demonstrate impressive performance, we do not understand exactly how these black-box models make individual predictions. This drawback has led to substantial research devoted to understand these models in areas…

Machine Learning · Computer Science 2020-01-10 Serena Booth , Ankit Shah , Yilun Zhou , Julie Shah

In this paper, we formulate the colorization problem into a multinomial classification problem and then apply a weighted function to classes. We propose a set of formulas to transform color values into color classes and vice versa. To…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Mrityunjoy Gain , Avi Deb Raha , Rameswar Debnath

Constrained sampling and counting are two fundamental problems in artificial intelligence with a diverse range of applications, spanning probabilistic reasoning and planning to constrained-random verification. While the theory of these…

Artificial Intelligence · Computer Science 2015-12-22 Kuldeep S. Meel , Moshe Vardi , Supratik Chakraborty , Daniel J. Fremont , Sanjit A. Seshia , Dror Fried , Alexander Ivrii , Sharad Malik

This paper investigates the semi-streaming complexity of \textit{$k$-partial coloring}, a generalization of proper graph coloring. For $k \geq 1$, a $k$-partial coloring requires that each vertex $v$ in an $n$-node graph is assigned a color…

Data Structures and Algorithms · Computer Science 2026-02-24 Avinandan Das

Many NP-complete constraint satisfaction problems appear to undergo a "phase transition'' from solubility to insolubility when the constraint density passes through a critical threshold. In all such cases it is easy to derive upper bounds…

Statistical Mechanics · Physics 2007-05-23 Dimitris Achlioptas , Cristopher Moore

Towards understanding the statistical complexity of learning from heterogeneous sources, we study the problem of multi-distribution learning. Given $k$ data sources, the goal is to output a classifier for each source by exploiting shared…

Machine Learning · Statistics 2026-02-25 Rafael Hanashiro , Abhishek Shetty , Patrick Jaillet

Most constraint-based causal learning algorithms provably return the correct causal graph under certain correctness conditions, such as faithfulness. By representing any constraint-based causal learning algorithm using the notion of a…

Artificial Intelligence · Computer Science 2026-04-02 Kai Z. Teh , Kayvan Sadeghi , Terry Soo

The $q$-Coloring problem asks whether the vertices of a graph can be properly colored with $q$ colors. Lokshtanov et al. [SODA 2011] showed that $q$-Coloring on graphs with a feedback vertex set of size $k$ cannot be solved in time…

Data Structures and Algorithms · Computer Science 2017-01-25 Lars Jaffke , Bart M. P. Jansen

We consider penalized estimation in hidden Markov models (HMMs) with multivariate Normal observations. In the moderate-to-large dimensional setting, estimation for HMMs remains challenging in practice, due to several concerns arising from…

Methodology · Statistics 2014-01-09 Nicolas Städler , Sach Mukherjee

Many data-fitting applications require the solution of an optimization problem involving a sum of large number of functions of high dimensional parameter. Here, we consider the problem of minimizing a sum of $n$ functions over a convex…

Optimization and Control · Mathematics 2016-02-29 Farbod Roosta-Khorasani , Michael W. Mahoney

The random k-SAT model is the most important and well-studied distribution over k-SAT instances. It is closely connected to statistical physics; it is used as a testbench for satisfiability algorithms, and average-case hardness over this…

Computational Complexity · Computer Science 2017-03-08 Noah Fleming , Denis Pankratov , Toniann Pitassi , Robert Robere

Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on…

Econometrics · Economics 2022-11-16 Qizhao Chen , Vasilis Syrgkanis , Morgane Austern

In this paper we consider large-scale smooth optimization problems with multiple linear coupled constraints. Due to the non-separability of the constraints, arbitrary random sketching would not be guaranteed to work. Thus, we first…

Optimization and Control · Mathematics 2018-08-09 Ion Necoara , Martin Takac

The random $k$-SAT problem serves as a model that represents the 'typical' $k$-SAT instances. This model is thought to undergo a phase transition as the clause density changes, and it is believed that the random $k$-SAT problem is primarily…

Probability · Mathematics 2025-05-23 Andreas Basse-O'Connor , Mette Skjøtt

State inference and parameter learning in sequential models can be successfully performed with approximation techniques that maximize the evidence lower bound to the marginal log-likelihood of the data distribution. These methods may be…

Machine Learning · Computer Science 2026-03-10 Helena Calatrava , Ricardo Augusto Borsoi , Tales Imbiriba , Pau Closas

We investigate the complex singlet extension of the Standard Model, which provides a scalar dark matter candidate. We impose the constraints from the observed relic abundance together with the most stringent limits from direct detection…

High Energy Physics - Phenomenology · Physics 2025-09-05 Koichi Funakubo , Chikako Idegawa

We present a very general approach to learning the structure of causal models based on d-separation constraints, obtained from any given set of overlapping passive observational or experimental data sets. The procedure allows for both…

Artificial Intelligence · Computer Science 2013-09-27 Antti Hyttinen , Patrik O. Hoyer , Frederick Eberhardt , Matti Jarvisalo