English
Related papers

Related papers: Lower Bounds for Approximate Knowledge Compilation

200 papers

Achieving faster execution with shorter compilation time can enable further diversity and innovation in neural networks. However, the current paradigm of executing neural networks either relies on hand-optimized libraries, traditional…

Machine Learning · Computer Science 2019-05-31 Byung Hoon Ahn , Prannoy Pilligundla , Hadi Esmaeilzadeh

Motivated by recent connections to factorised databases, we analyse the efficiency of representations by context free grammars (CFGs). Concretely, we prove a recent conjecture by Kimelfeld, Martens, and Niewerth (ICDT 2025), that for finite…

Databases · Computer Science 2025-04-01 Stefan Mengel , Harry Vinall-Smeeth

The Boolean Nearest Neighbor (BNN) representation of Boolean functions was recently introduced by Hajnal, Liu and Turan. A BNN representation of $f$ is a pair $(P,N)$ of sets of Boolean vectors (called positive and negative prototypes)…

Artificial Intelligence · Computer Science 2024-10-30 Ondřej Čepek , Jelena Glišić

A wide variety of nonmonotonic semantics can be expressed as approximators defined under AFT (Approximation Fixpoint Theory). Using traditional AFT theory, it is not possible to define approximators that rely on information computed in…

Artificial Intelligence · Computer Science 2023-07-24 Spencer Killen , Jia-Huai You

Deep neural networks (DNNs) have achieved significant success in a variety of real world applications, i.e., image classification. However, tons of parameters in the networks restrict the efficiency of neural networks due to the large model…

Machine Learning · Computer Science 2019-08-21 Yuzhe Ma , Ran Chen , Wei Li , Fanhua Shang , Wenjian Yu , Minsik Cho , Bei Yu

The recent successes and spread of large neural language models (LMs) call for a thorough understanding of their computational ability. Describing their computational abilities through LMs' \emph{representational capacity} is a lively area…

Computation and Language · Computer Science 2024-06-19 Anej Svete , Franz Nowak , Anisha Mohamed Sahabdeen , Ryan Cotterell

Judgment aggregation is a general framework for collective decision making that can be used to model many different settings. Due to its general nature, the worst case complexity of essentially all relevant problems in this framework is…

Artificial Intelligence · Computer Science 2018-08-10 Ronald de Haan

Logics for knowledge representation suffer from over-specialization: while each logic may provide an ideal representation formalism for some problems, it is less than optimal for others. A solution to this problem is to choose from several…

Artificial Intelligence · Computer Science 2007-05-23 G. Antoniou , D. Billigton , G. Governatori , M. J. Maher

In this introductory article we present the basics of an approach to implementing computational interpreting of natural language aiming to model the meanings of words and phrases. Unlike other approaches, we attempt to define the meanings…

Computation and Language · Computer Science 2019-08-12 Michael Kapustin , Pavlo Kapustin

In Natural Language Processing (NLP), finding data augmentation techniques that can produce high-quality human-interpretable examples has always been challenging. Recently, leveraging kNN such that augmented examples are retrieved from…

Computation and Language · Computer Science 2021-06-03 Ehsan Kamalloo , Mehdi Rezagholizadeh , Peyman Passban , Ali Ghodsi

We present a knowledge compilation approach for existential and universal quantification in alternating automata. Knowledge compilation transforms formulas into normal forms with special properties that enable efficient answering of…

Logic in Computer Science · Computer Science 2026-05-05 S. Akshay , Alfredo Cantarella , Supratik Chakraborty , Bernd Finkbeiner , Niklas Metzger

We investigate the space efficiency of a Propositional Knowledge Representation (PKR) formalism. Intuitively, the space efficiency of a formalism F in representing a certain piece of knowledge A, is the size of the shortest formula of F…

Artificial Intelligence · Computer Science 2011-06-02 M. Cadoli , F. M. Donini , P. Liberatore , M. Schaerf

Decomposable Negation Normal Forms (DNNFs) are Boolean circuits in negation normal form where the subcircuits leading into each AND gate are defined on disjoint sets of variables. We prove a strongly exponential lower bound on the size of…

Computational Complexity · Computer Science 2015-02-20 Simone Bova , Florent Capelli , Stefan Mengel , Friedrich Slivovsky

Although large language models (LLMs) store vast amount of knowledge in their parameters, they still have limitations in the memorization and utilization of certain knowledge, leading to undesired behaviors such as generating untruthful and…

Computation and Language · Computer Science 2025-05-28 Moxin Li , Yong Zhao , Wenxuan Zhang , Shuaiyi Li , Wenya Xie , See-Kiong Ng , Tat-Seng Chua , Yang Deng

Knowledge representation and reasoning systems represent knowledge as collections of facts and rules. KRRs can represent complex concepts and relations, and they can query and manipulate information in sophisticated ways. Unfortunately, the…

Artificial Intelligence · Computer Science 2024-11-12 Yuheng Wang

Speech denoising is a generally adopted and impactful task, appearing in many common and everyday-life use cases. Although there are very powerful methods published, most of those are too complex for deployment in everyday and low-resources…

Sound · Computer Science 2025-05-07 Diep Luong , Mikko Heikkinen , Konstantinos Drossos , Tuomas Virtanen

Language prediction is constrained by informational entropy intrinsic to language, such that there exists a limit to how accurate any language model can become and equivalently a lower bound to language compression. The most efficient…

Computation and Language · Computer Science 2025-11-14 Benjamin L. Badger , Matthew Neligeorge

Rule learning approaches for knowledge graph completion are efficient, interpretable and competitive to purely neural models. The rule aggregation problem is concerned with finding one plausibility score for a candidate fact which was…

Artificial Intelligence · Computer Science 2023-09-04 Patrick Betz , Stefan Lüdtke , Christian Meilicke , Heiner Stuckenschmidt

The logical negation property (LNP), which implies generating different predictions for semantically opposite inputs, is an important property that a trustworthy language model must satisfy. However, much recent evidence shows that…

Computation and Language · Computer Science 2022-08-12 Myeongjun Jang , Frank Mtumbuka , Thomas Lukasiewicz

Decision \textsc{dnnf} (a.k.a. $\wedge_d$-\textsc{fbdd}) is an important special case of Decomposable Negation Normal Form (\textsc{dnnf}), a landmark knowledge compilation model. Like other known \textsc{dnnf} restrictions, Decision…

Computational Complexity · Computer Science 2026-03-06 Andrea Calí , Igor Razgon