English
Related papers

Related papers: Differentiable Learning of Logical Rules for Knowl…

200 papers

We study the problem of learning differentiable functions expressed as programs in a domain-specific language. Such programmatic models can offer benefits such as composability and interpretability; however, learning them requires…

Machine Learning · Computer Science 2021-03-30 Ameesh Shah , Eric Zhan , Jennifer J. Sun , Abhinav Verma , Yisong Yue , Swarat Chaudhuri

Discovering interpretable patterns for classification of sequential data is of key importance for a variety of fields, ranging from genomics to fraud detection or more generally interpretable decision-making. In this paper, we propose a…

Machine Learning · Computer Science 2023-02-23 Marine Collery , Philippe Bonnard , François Fages , Remy Kusters

We explore end-to-end trained differentiable models that integrate natural logic with neural networks, aiming to keep the backbone of natural language reasoning based on the natural logic formalism while introducing subsymbolic vector…

Computation and Language · Computer Science 2020-11-11 Yufei Feng , Zi'ou Zheng , Quan Liu , Michael Greenspan , Xiaodan Zhu

Deep reinforcement learning (RL) methods often require many trials before convergence, and no direct interpretability of trained policies is provided. In order to achieve fast convergence and interpretability for the policy in RL, we…

We introduce DeepPSL a variant of probabilistic soft logic (PSL) to produce an end-to-end trainable system that integrates reasoning and perception. PSL represents first-order logic in terms of a convex graphical model -- hinge-loss Markov…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Sridhar Dasaratha , Sai Akhil Puranam , Karmvir Singh Phogat , Sunil Reddy Tiyyagura , Nigel P. Duffy

Traditional neural networks have an impressive classification performance, but what they learn cannot be inspected, verified or extracted. Neural Logic Networks on the other hand have an interpretable structure that enables them to learn a…

Machine Learning · Computer Science 2026-01-26 Vincent Perreault , Katsumi Inoue , Richard Labib , Alain Hertz

Logical rules are a popular knowledge representation language in many domains, representing background knowledge and encoding information that can be derived from given facts in a compact form. However, rule formulation is a complex process…

Artificial Intelligence · Computer Science 2020-02-13 Cristina Cornelio , Veronika Thost

Rule-based explanation methods offer rigorous and globally interpretable insights into neural network behavior. However, existing approaches are mostly limited to small fully connected networks and depend on costly layerwise rule extraction…

Machine Learning · Computer Science 2025-10-16 Chuqin Geng , Anqi Xing , Li Zhang , Ziyu Zhao , Yuhe Jiang , Xujie Si

While neural models show remarkable accuracy on individual predictions, their internal beliefs can be inconsistent across examples. In this paper, we formalize such inconsistency as a generalization of prediction error. We propose a…

Artificial Intelligence · Computer Science 2019-09-16 Tao Li , Vivek Gupta , Maitrey Mehta , Vivek Srikumar

Rule-based decision models are attractive due to their interpretability. However, existing rule induction methods often result in long and consequently less interpretable rule models. This problem can often be attributed to the lack of…

Machine Learning · Statistics 2022-07-29 Remy Kusters , Yusik Kim , Marine Collery , Christian de Sainte Marie , Shubham Gupta

The ability to conduct logical reasoning is a fundamental aspect of intelligent human behavior, and thus an important problem along the way to human-level artificial intelligence. Traditionally, logic-based symbolic methods from the field…

Artificial Intelligence · Computer Science 2021-01-11 Patrick Hohenecker , Thomas Lukasiewicz

A hallmark of human cognition is the ability to continually acquire and distill observations of the world into meaningful, predictive theories. In this paper we present a new mechanism for logical theory acquisition which takes a set of…

Artificial Intelligence · Computer Science 2018-09-14 Andres Campero , Aldo Pareja , Tim Klinger , Josh Tenenbaum , Sebastian Riedel

The goal of inductive logic programming is to induce a logic program (a set of logical rules) that generalises training examples. Inducing programs with many rules and literals is a major challenge. To tackle this challenge, we introduce an…

Machine Learning · Computer Science 2023-08-21 Andrew Cropper , Céline Hocquette

We propose Logic Tensor Networks: a uniform framework for integrating automatic learning and reasoning. A logic formalism called Real Logic is defined on a first-order language whereby formulas have truth-value in the interval [0,1] and…

Artificial Intelligence · Computer Science 2016-07-08 Luciano Serafini , Artur d'Avila Garcez

In inductive learning of a broad concept, an algorithm should be able to distinguish concept examples from exceptions and noisy data. An approach through recursively finding patterns in exceptions turns out to correspond to the problem of…

Logic in Computer Science · Computer Science 2017-07-11 Farhad Shakerin , Elmer Salazar , Gopal Gupta

Rule-based reasoning, a fundamental type of legal reasoning, enables us to draw conclusions by accurately applying a rule to a set of facts. We explore causal language models as rule-based reasoners, specifically with respect to…

Computation and Language · Computer Science 2024-02-26 Sergio Servantez , Joe Barrow , Kristian Hammond , Rajiv Jain

A key feature of inductive logic programming (ILP) is its ability to learn first-order programs, which are intrinsically more expressive than propositional programs. In this paper, we introduce techniques to learn higher-order programs.…

Machine Learning · Computer Science 2019-07-26 Andrew Cropper , Rolf Morel , Stephen H. Muggleton

One important challenge for probabilistic logics is reasoning with very large knowledge bases (KBs) of imperfect information, such as those produced by modern web-scale information extraction systems. One scalability problem shared by many…

Artificial Intelligence · Computer Science 2014-04-15 William Yang Wang , Kathryn Mazaitis , Ni Lao , Tom Mitchell , William W. Cohen

We consider the problem of answering queries about formulas of first-order logic based on background knowledge partially represented explicitly as other formulas, and partially represented as examples independently drawn from a fixed…

Artificial Intelligence · Computer Science 2019-06-25 Vaishak Belle , Brendan Juba

Large language models (LLMs) have achieved impressive human-like performance across various reasoning tasks. However, their mastery of underlying inferential rules still falls short of human capabilities. To investigate this, we propose a…

Computation and Language · Computer Science 2024-06-24 Siyuan Wang , Zhongyu Wei , Yejin Choi , Xiang Ren