English
Related papers

Related papers: On Neural Architecture Inductive Biases for Relati…

200 papers

Rule-based decision models are attractive due to their interpretability. However, existing rule induction methods often result in long and consequently less interpretable rule models. This problem can often be attributed to the lack of…

Machine Learning · Statistics 2022-07-29 Remy Kusters , Yusik Kim , Marine Collery , Christian de Sainte Marie , Shubham Gupta

Natural logic offers a powerful relational conception of meaning that is a natural counterpart to distributed semantic representations, which have proven valuable in a wide range of sophisticated language tasks. However, it remains an open…

Computation and Language · Computer Science 2014-10-16 Samuel R. Bowman , Christopher Potts , Christopher D. Manning

Layered neural networks have greatly improved the performance of various applications including image processing, speech recognition, natural language processing, and bioinformatics. However, it is still difficult to discover or interpret…

Machine Learning · Statistics 2017-10-05 Chihiro Watanabe , Kaoru Hiramatsu , Kunio Kashino

Out-of-distribution (OOD) generalisation is considered a hallmark of human and animal intelligence. To achieve OOD through composition, a system must discover the environment-invariant properties of experienced input-output mappings and…

Machine Learning · Computer Science 2025-05-19 George Dimitriadis , Spyridon Samothrakis

Reasoning about objects, relations, and physics is central to human intelligence, and a key goal of artificial intelligence. Here we introduce the interaction network, a model which can reason about how objects in complex systems interact,…

Artificial Intelligence · Computer Science 2016-12-02 Peter W. Battaglia , Razvan Pascanu , Matthew Lai , Danilo Rezende , Koray Kavukcuoglu

Existing subset selection methods for efficient learning predominantly employ discrete combinatorial and model-specific approaches which lack generalizability. For an unseen architecture, one cannot use the subset chosen for a different…

Machine Learning · Computer Science 2024-09-20 Eeshaan Jain , Tushar Nandy , Gaurav Aggarwal , Ashish Tendulkar , Rishabh Iyer , Abir De

An unaddressed challenge in multi-agent coordination is to enable AI agents to exploit the semantic relationships between the features of actions and the features of observations. Humans take advantage of these relationships in highly…

Machine Learning · Computer Science 2023-06-07 Mingwei Ma , Jizhou Liu , Samuel Sokota , Max Kleiman-Weiner , Jakob Foerster

Modern deep learning models generalize remarkably well in-distribution, despite being overparametrized and trained with little to no explicit regularization. Instead, current theory credits implicit regularization imposed by the choice of…

Machine Learning · Computer Science 2026-03-17 Jonathan Wenger , Beau Coker , Juraj Marusic , John P. Cunningham

Using graph models with relational information in recommender systems has shown promising results. Yet, most methods are transductive, i.e., they are based on dimensionality reduction architectures. Hence, they require heavy retraining…

Information Retrieval · Computer Science 2022-09-14 Theis E. Jendal , Matteo Lissandrini , Peter Dolog , Katja Hose

Massive data collection holds the promise of a better understanding of complex phenomena and, ultimately, better decisions. Representation learning has become a key driver of deep learning applications, as it allows learning latent spaces…

Machine Learning · Computer Science 2025-11-10 Caroline Uhler , Jiaqi Zhang

We investigate the prominent class of fair representation learning methods for bias mitigation. Using causal reasoning to define and formalise different sources of dataset bias, we reveal important implicit assumptions inherent to these…

Machine Learning · Computer Science 2025-02-11 Charles Jones , Fabio de Sousa Ribeiro , Mélanie Roschewitz , Daniel C. Castro , Ben Glocker

Despite achieving state-of-the-art performance, deep learning methods generally require a large amount of labeled data during training and may suffer from overfitting when the sample size is small. To ensure good generalizability of deep…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 Xiaoxu Li , Liyun Yu , Xiaochen Yang , Zhanyu Ma , Jing-Hao Xue , Jie Cao , Jun Guo

Deep neural networks use multiple layers of functions to map an object represented by an input vector progressively to different representations, and with sufficient training, eventually to a single score for each class that is the output…

Machine Learning · Computer Science 2022-09-02 Tin Kam Ho

In the context of classification problems, Deep Learning (DL) approaches represent state of art. Many DL approaches are based on variations of standard multi-layer feed-forward neural networks. These are also referred to as deep networks.…

Machine Learning · Computer Science 2023-11-21 Andrea Apicella , Francesco Isgrò , Roberto Prevete

We propose a method combining relational-logic representations with neural network learning. A general lifted architecture, possibly reflecting some background domain knowledge, is described through relational rules which may be handcrafted…

Artificial Intelligence · Computer Science 2015-10-14 Gustav Sourek , Vojtech Aschenbrenner , Filip Zelezny , Ondrej Kuzelka

Exploiting data invariances is crucial for efficient learning in both artificial and biological neural circuits. Understanding how neural networks can discover appropriate representations capable of harnessing the underlying symmetries of…

Disordered Systems and Neural Networks · Physics 2022-10-17 Alessandro Ingrosso , Sebastian Goldt

Relation prediction is a task designed for knowledge graph completion which aims to predict missing relationships between entities. Recent subgraph-based models for inductive relation prediction have received increasing attention, which can…

Machine Learning · Computer Science 2022-11-23 Jianfeng Wu , Sijie Mai , Haifeng Hu

Endowing robots with human-like physical reasoning abilities remains challenging. We argue that existing methods often disregard spatio-temporal relations and by using Graph Neural Networks (GNNs) that incorporate a relational inductive…

Machine Learning · Computer Science 2019-10-24 Fabio Ferreira , Lin Shao , Tamim Asfour , Jeannette Bohg

Neuro-symbolic methods integrate neural architectures, knowledge representation and reasoning. However, they have been struggling at both dealing with the intrinsic uncertainty of the observations and scaling to real-world applications.…

Artificial Intelligence · Computer Science 2025-01-16 Giuseppe Marra , Michelangelo Diligenti , Francesco Giannini

Formulating and answering logical queries is a standard communication interface for knowledge graphs (KGs). Alleviating the notorious incompleteness of real-world KGs, neural methods achieved impressive results in link prediction and…

Artificial Intelligence · Computer Science 2022-11-10 Mikhail Galkin , Zhaocheng Zhu , Hongyu Ren , Jian Tang