English

On the Fine-Grained Hardness of Inverting Generative Models

Machine Learning 2023-09-13 v1 Computational Complexity Machine Learning

Abstract

The objective of generative model inversion is to identify a size-nn latent vector that produces a generative model output that closely matches a given target. This operation is a core computational primitive in numerous modern applications involving computer vision and NLP. However, the problem is known to be computationally challenging and NP-hard in the worst case. This paper aims to provide a fine-grained view of the landscape of computational hardness for this problem. We establish several new hardness lower bounds for both exact and approximate model inversion. In exact inversion, the goal is to determine whether a target is contained within the range of a given generative model. Under the strong exponential time hypothesis (SETH), we demonstrate that the computational complexity of exact inversion is lower bounded by Ω(2n)\Omega(2^n) via a reduction from kk-SAT; this is a strengthening of known results. For the more practically relevant problem of approximate inversion, the goal is to determine whether a point in the model range is close to a given target with respect to the p\ell_p-norm. When pp is a positive odd integer, under SETH, we provide an Ω(2n)\Omega(2^n) complexity lower bound via a reduction from the closest vectors problem (CVP). Finally, when pp is even, under the exponential time hypothesis (ETH), we provide a lower bound of 2Ω(n)2^{\Omega (n)} via a reduction from Half-Clique and Vertex-Cover.

Keywords

Cite

@article{arxiv.2309.05795,
  title  = {On the Fine-Grained Hardness of Inverting Generative Models},
  author = {Feyza Duman Keles and Chinmay Hegde},
  journal= {arXiv preprint arXiv:2309.05795},
  year   = {2023}
}

Comments

19 pages

R2 v1 2026-06-28T12:18:36.267Z