English
Related papers

Related papers: Understanding Inter-Concept Relationships in Conce…

200 papers

People acquire concepts through rich physical and social experiences and use them to understand and navigate the world. In contrast, large language models (LLMs), trained solely through next-token prediction on text, exhibit strikingly…

Computation and Language · Computer Science 2025-11-11 Ningyu Xu , Qi Zhang , Chao Du , Qiang Luo , Xipeng Qiu , Xuanjing Huang , Menghan Zhang

In this article we analyse the notion of knowledge role. First of all, we present how the relationship between problem solving methods and domain models is tackled in different approaches. We concentrate on how they cope with this issue in…

Artificial Intelligence · Computer Science 2023-02-21 Chantal Reynaud , Nathalie Aussenac-Gilles , Pierre Tchounikine , Franckie Trichet

As the field of quantum physics evolves, researchers naturally form subgroups focusing on specialized problems. While this encourages in-depth exploration, it can limit the exchange of ideas across structurally similar problems in different…

Machine Learning · Computer Science 2024-11-12 Felix Frohnert , Xuemei Gu , Mario Krenn , Evert van Nieuwenburg

Neural network models have achieved state-of-the-art performances in a wide range of natural language processing (NLP) tasks. However, a long-standing criticism against neural network models is the lack of interpretability, which not only…

Computation and Language · Computer Science 2021-10-26 Xiaofei Sun , Diyi Yang , Xiaoya Li , Tianwei Zhang , Yuxian Meng , Han Qiu , Guoyin Wang , Eduard Hovy , Jiwei Li

Relational knowledge bases (KBs) are commonly used to represent world knowledge in machines. However, while advantageous for their high degree of precision and interpretability, KBs are usually organized according to manually-defined…

Computation and Language · Computer Science 2021-09-13 Tara Safavi , Danai Koutra

In this introductory article we present the basics of an approach to implementing computational interpreting of natural language aiming to model the meanings of words and phrases. Unlike other approaches, we attempt to define the meanings…

Computation and Language · Computer Science 2019-08-12 Michael Kapustin , Pavlo Kapustin

Deep reinforcement learning (DRL), through learning policies or values represented by neural networks, has successfully addressed many complex control problems. However, the neural networks introduced by DRL lack interpretability and…

Machine Learning · Computer Science 2025-02-04 Zeyu Jiang , Hai Huang , Xingquan Zuo

Deep neural networks have demonstrated remarkable performance in many data-driven and prediction-oriented applications, and sometimes even perform better than humans. However, their most significant drawback is the lack of interpretability,…

Machine Learning · Computer Science 2023-02-22 Jiahui Li , Kun Kuang , Lin Li , Long Chen , Songyang Zhang , Jian Shao , Jun Xiao

The field of natural language understanding has experienced exponential progress in the last few years, with impressive results in several tasks. This success has motivated researchers to study the underlying knowledge encoded by these…

Artificial Intelligence · Computer Science 2021-06-03 Carlos Aspillaga , Marcelo Mendoza , Alvaro Soto

Model explainability is essential for the creation of trustworthy Machine Learning models in healthcare. An ideal explanation resembles the decision-making process of a domain expert and is expressed using concepts or terminology that is…

Machine Learning · Computer Science 2021-07-14 Sumedha Singla , Stephen Wallace , Sofia Triantafillou , Kayhan Batmanghelich

Deep learning currently dominates the benchmarks for various NLP tasks and, at the basis of such systems, words are frequently represented as embeddings --vectors in a low dimensional space-- learned from large text corpora and various…

Computation and Language · Computer Science 2019-09-25 Ronald Denaux , Jose Manuel Gomez-Perez

With the advent of semantic web, various tools and techniques have been introduced for presenting and organizing knowledge. Concept hierarchies are one such technique which gained significant attention due to its usefulness in creating…

Artificial Intelligence · Computer Science 2016-11-30 V. S. Anoop , S. Asharaf , P. Deepak

Discussion of AI alignment (alignment between humans and AI systems) has focused on value alignment, broadly referring to creating AI systems that share human values. We argue that before we can even attempt to align values, it is…

Machine Learning · Computer Science 2024-01-18 Sunayana Rane , Polyphony J. Bruna , Ilia Sucholutsky , Christopher Kello , Thomas L. Griffiths

Concept Bottleneck Models (CBMs) improve the explainability of black-box Deep Learning (DL) by introducing intermediate semantic concepts. However, standard CBMs often overlook domain-specific relationships and causal mechanisms, and their…

Machine Learning · Computer Science 2026-01-16 Reza M. Asiyabi , SEOSAW Partnership , Steven Hancock , Casey Ryan

The interpretability of machine learning models has been an essential area of research for the safe deployment of machine learning systems. One particular approach is to attribute model decisions to high-level concepts that humans can…

Machine Learning · Computer Science 2022-09-14 Varsha Pendyala , Jihye Choi

Deep learning models are notoriously opaque. Existing explanation methods often focus on localized visual explanations for individual images. Concept-based explanations, while offering global insights, require extensive annotations,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Kunal Rathore , Prasad Tadepalli

In conceptual modeling (CM), humans apply abstraction to represent excerpts of reality for means of understanding and communication, and processing by machines. Artificial Intelligence (AI) is applied to vast amounts of data to…

Software Engineering · Computer Science 2023-03-14 Dominik Bork , Syed Juned Ali , Ben Roelens

While the embedding of words has revolutionized the field of Natural Language Processing, the embedding of concepts has received much less attention so far. A dense and meaningful representation of concepts, however, could prove useful for…

Computation and Language · Computer Science 2025-02-17 Arne Rubehn , Johann-Mattis List

As an emerging interpretable technique, Generalized Additive Models (GAMs) adopt neural networks to individually learn non-linear functions for each feature, which are then combined through a linear model for final predictions. Although…

Machine Learning · Computer Science 2024-08-01 Viet Duong , Qiong Wu , Zhengyi Zhou , Hongjue Zhao , Chenxiang Luo , Eric Zavesky , Huaxiu Yao , Huajie Shao

Humans possess a remarkable ability to acquire knowledge efficiently and apply it across diverse modalities through a coherent and shared understanding of the world. Inspired by this cognitive capability, we introduce a concept-centric…

Artificial Intelligence · Computer Science 2026-01-26 Yuchong Geng , Ao Tang