English
Related papers

Related papers: Model Transformations for Ranking Functions and To…

200 papers

Transformer language models encode the notion of word order using positional information. Most commonly, this positional information is represented by absolute position embeddings (APEs), that are learned from the pretraining data. However,…

Computation and Language · Computer Science 2022-10-25 Koustuv Sinha , Amirhossein Kazemnejad , Siva Reddy , Joelle Pineau , Dieuwke Hupkes , Adina Williams

How can intelligent agents solve a diverse set of tasks in a data-efficient manner? The disentangled representation learning approach posits that such an agent would benefit from separating out (disentangling) the underlying structure of…

Machine Learning · Computer Science 2018-12-07 Irina Higgins , David Amos , David Pfau , Sebastien Racaniere , Loic Matthey , Danilo Rezende , Alexander Lerchner

With the power of large pretrained language models, various research works have integrated knowledge into dialogue systems. The traditional techniques treat knowledge as part of the input sequence for the dialogue system, prepending a set…

Computation and Language · Computer Science 2023-02-14 Hsuan Su , Shachi H Kumar , Sahisnu Mazumder , Wenda Chen , Ramesh Manuvinakurike , Eda Okur , Saurav Sahay , Lama Nachman , Shang-Tse Chen , Hung-yi Lee

To what extent can a neural network systematically reason over symbolic facts? Evidence suggests that large pre-trained language models (LMs) acquire some reasoning capacity, but this ability is difficult to control. Recently, it has been…

Computation and Language · Computer Science 2020-11-17 Alon Talmor , Oyvind Tafjord , Peter Clark , Yoav Goldberg , Jonathan Berant

Classical planning representation languages based on first-order logic have preliminarily been used to model and solve robotic task planning problems. Wider adoption of these representation languages, however, is hindered by the limitations…

Artificial Intelligence · Computer Science 2023-11-16 Angeline Aguinaldo , Evan Patterson , James Fairbanks , William Regli , Jaime Ruiz

We develop a framework for epistemic logic that combines relevant modal logic with classical propositional logic. In our framework the agent is modeled as reasoning in accordance with a relevant modal logic while the propositional fragment…

Logic in Computer Science · Computer Science 2022-06-08 Igor Sedlár , Pietro Vigiani

We introduce a model of negotiation dynamics whose aim is that of mimicking the mechanisms leading to opinion and convention formation in a population of individuals. The negotiation process, as opposed to ``herding-like'' or ``bounded…

Statistical Mechanics · Physics 2007-11-06 A. Baronchelli , L. Dall'Asta , A. Barrat , V. Loreto

AGM's belief revision is one of the main paradigms in the study of belief change operations. In this context, belief bases (prioritised bases) have been primarily used to specify the agent's belief state. While the connection of iterated…

Logic in Computer Science · Computer Science 2019-12-24 Marlo Souza , Álvaro Moreira

Subset models provide a new semantics for justifcation logic. The main idea of subset models is that evidence terms are interpreted as sets of possible worlds. A term then justifies a formula if that formula is true in each world of the…

Logic in Computer Science · Computer Science 2023-10-06 Eveline Lehmann , Thomas Studer

Comprehending procedural text, e.g., a paragraph describing photosynthesis, requires modeling actions and the state changes they produce, so that questions about entities at different timepoints can be answered. Although several recent…

Artificial Intelligence · Computer Science 2018-08-31 Niket Tandon , Bhavana Dalvi Mishra , Joel Grus , Wen-tau Yih , Antoine Bosselut , Peter Clark

World models, which encapsulate the dynamics of how actions affect environments, are foundational to the functioning of intelligent agents. In this work, we explore the potential of Large Language Models (LLMs) to operate as world models.…

Computation and Language · Computer Science 2024-10-04 Kaige Xie , Ian Yang , John Gunerli , Mark Riedl

Evolution of belief systems has always been in focus of cognitive research. In this paper we delineate a new model describing belief systems as a network of statements considered true. Testing the model a small number of parameters enabled…

Artificial Intelligence · Computer Science 2008-07-04 Miklos Antal , Laszlo Balogh

Epistemic planning is the sub-field of AI planning that focuses on changing knowledge and belief. It is important in both multi-agent domains where agents need to have knowledge/belief regarding the environment, but also the beliefs of…

Artificial Intelligence · Computer Science 2025-10-20 Guang Hu , Tim Miller , Nir Lipovetzky

We investigate the belief revision problem in epistemic planning, i.e., what will be the beliefs of all agents in a multi-agent system after an agent gains the belief in some state property. Based on the standard representation in epistemic…

Artificial Intelligence · Computer Science 2026-05-05 Michael Thielscher , Tran Cao Son

Beginning with McCarthy's Advice Taker (1959), AI has pursued the goal of providing a system with explicit, general knowledge and having the system reason over that knowledge. However, expressing the knowledge in a formal (logical or…

Computation and Language · Computer Science 2020-05-06 Peter Clark , Oyvind Tafjord , Kyle Richardson

This paper proposes a formal framework for modeling the interaction of causal and (qualitative) epistemic reasoning. To this purpose, we extend the notion of a causal model with a representation of the epistemic state of an agent. On the…

Artificial Intelligence · Computer Science 2020-11-02 Fausto Barbero , Katrin Schulz , Sonja Smets , Fernando R. Velázquez-Quesada , Kaibo Xie

Reordering is a challenge to machine translation (MT) systems. In MT, the widely used approach is to apply word based language model (LM) which considers the constituent units of a sentence as words. In speech recognition (SR), some phrase…

Computation and Language · Computer Science 2015-02-19 Geliang Chen

In this introductory article we present the basics of an approach to implementing computational interpreting of natural language aiming to model the meanings of words and phrases. Unlike other approaches, we attempt to define the meanings…

Computation and Language · Computer Science 2019-08-12 Michael Kapustin , Pavlo Kapustin

Reinforcement learning in partially observable environments is typically challenging, as it requires agents to learn an estimate of the underlying system state. These challenges are exacerbated in multi-agent settings, where agents learn…

Artificial Intelligence · Computer Science 2025-04-14 Paul J. Pritz , Kin K. Leung

Consider the following belief change/merging scenario. A group of information sources gives a sequence of reports about the state of the world at various instances (e.g. different points in time). The true states at these instances are…

Artificial Intelligence · Computer Science 2022-05-03 Joseph Singleton , Richard Booth