English
Related papers

Related papers: On the Dynamics of Observation and Semantics

200 papers

Modern AI systems achieve remarkable capabilities at the cost of substantial energy consumption. To connect intelligence to physical efficiency, we propose two complementary bits-per-joule metrics under explicit accounting conventions: (1)…

Machine Learning · Computer Science 2026-02-06 Koichi Takahashi , Yusuke Hayashi

This white paper lays out a vision of research and development in the field of artificial intelligence for the next decade (and beyond). Its denouement is a cyber-physical ecosystem of natural and synthetic sense-making, in which humans are…

I argue that, contrary to the standard view, one cannot understand the structure and nature of our knowledge in physics without an analysis of the way that observers (and, more generally, measuring instruments and experimental arrangements)…

History and Philosophy of Physics · Physics 2020-06-05 Erik Curiel

We argue that an explainable artificial intelligence must possess a rationale for its decisions, be able to infer the purpose of observed behaviour, and be able to explain its decisions in the context of what its audience understands and…

Artificial Intelligence · Computer Science 2021-04-26 Michael Timothy Bennett , Yoshihiro Maruyama

Integrating symbolic knowledge and data-driven learning algorithms is a longstanding challenge in Artificial Intelligence. Despite the recognized importance of this task, a notable gap exists due to the discreteness of symbolic…

Artificial Intelligence · Computer Science 2024-05-24 Gaia Saveri , Laura Nenzi , Luca Bortolussi , Jan Křetínský

Language grounding is an active field aiming at enriching textual representations with visual information. Generally, textual and visual elements are embedded in the same representation space, which implicitly assumes a one-to-one…

Computation and Language · Computer Science 2020-02-10 Patrick Bordes , Eloi Zablocki , Laure Soulier , Benjamin Piwowarski , Patrick Gallinari

Semantic representations can be framed as a structured, dynamic knowledge space through which humans navigate to retrieve and manipulate meaning. To investigate how humans traverse this geometry, we introduce a framework that represents…

Computation and Language · Computer Science 2026-04-15 Felipe D. Toro-Hernández , Jesuino Vieira Filho , Rodrigo M. Cabral-Carvalho

The semantics and dynamics of `attention' are closely related to promise theoretic notions developed for autonomous agents and can thus easily be written down in promise framework. In this way one may establish a bridge between vectorized…

Artificial Intelligence · Computer Science 2025-12-23 Mark Burgess

Maintaining efficient semantic representations of the environment is a major challenge both for humans and for machines. While human languages represent useful solutions to this problem, it is not yet clear what computational principle…

Computation and Language · Computer Science 2018-08-13 Noga Zaslavsky , Charles Kemp , Terry Regier , Naftali Tishby

We revisit the classic signal-to-symbol barrier in light of the remarkable ability of deep neural networks to generate realistic synthetic data. DeepFakes and spoofing highlight the feebleness of the link between physical reality and its…

Machine Learning · Computer Science 2022-08-05 Alessandro Achille , Stefano Soatto

Using the previously developed concepts of semantic spacetime, I explore the interpretation of knowledge representations, and their structure, as a semantic system, within the framework of promise theory. By assigning interpretations to…

Artificial Intelligence · Computer Science 2017-08-02 Mark Burgess

Convolutional neural networks (CNN) are known to learn an image representation that captures concepts relevant to the task, but do so in an implicit way that hampers model interpretability. However, one could argue that such a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Diego Marcos , Ruth Fong , Sylvain Lobry , Remi Flamary , Nicolas Courty , Devis Tuia

Shannon information theory provides various measures of so-called "syntactic information", which reflect the amount of statistical correlation between systems. In contrast, the concept of "semantic information" refers to those correlations…

Statistical Mechanics · Physics 2022-11-22 Artemy Kolchinsky , David H. Wolpert

We consider a living organism as an observer of the evolution of its environment recording sensory information about the state space X of the environment in real time. Sensory information is sampled and then processed on two levels. On the…

Artificial Intelligence · Computer Science 2010-03-22 Dan Guralnik

There is a multitude of interpretations of quantum mechanics, but foundational principles are lacking. Relational quantum mechanics views the observer as a physical system, which allows for an unambiguous interpretation as all axioms are…

Quantum Physics · Physics 2025-06-16 Dorian Daimer , Susanne Still

Quantum information has suggested new forms of quantum logic, called quantum computational logics, where meanings of sentences are represented by pieces of quantum information (generally, density operators of some Hilbert spaces), which can…

Quantum Physics · Physics 2016-02-25 Giuseppe Sergioli , Roberto Leporini

Situation awareness is a crucial cognitive skill that enables individuals to perceive, comprehend, and project the current state of their environment accurately. It involves being conscious of relevant information, understanding its…

Information Retrieval · Computer Science 2023-07-26 Sumit Sharma , Sarika Jain

Thermodynamics and information have intricate interrelations. Often thermodynamics is considered to be the logical premise to justify that information is physical - through Landauer's principle -, thereby also linking information and…

We present a system for object recognition based on a semantic graph representation, which the system can learn from image examples. This graph is based on intrinsic properties of objects such as structure and geometry, so it is more robust…

Computer Vision and Pattern Recognition · Computer Science 2020-05-01 Isaac Weiss

We show here that what we call visual space of consciousness, the space of what we see, is a specific space different from the purely physical one and that its properties imply that it cannot be reduced to or deduced from physical laws.…

Neurons and Cognition · Quantitative Biology 2021-10-28 Iegor Reznikoff