English
Related papers

Related papers: Using a Distributional Semantic Vector Space with …

200 papers

Language models (LMs) have already demonstrated remarkable abilities in understanding and generating both natural and formal language. Despite these advances, their integration with real-world environments such as large-scale knowledge…

Computation and Language · Computer Science 2024-02-12 Yiheng Shu , Zhiwei Yu

Existing question answering methods infer answers either from a knowledge base or from raw text. While knowledge base (KB) methods are good at answering compositional questions, their performance is often affected by the incompleteness of…

Computation and Language · Computer Science 2017-04-28 Rajarshi Das , Manzil Zaheer , Siva Reddy , Andrew McCallum

Knowledge bases (KB), both automatically and manually constructed, are often incomplete --- many valid facts can be inferred from the KB by synthesizing existing information. A popular approach to KB completion is to infer new relations by…

Computation and Language · Computer Science 2019-01-01 Rajarshi Das , Shehzaad Dhuliawala , Manzil Zaheer , Luke Vilnis , Ishan Durugkar , Akshay Krishnamurthy , Alex Smola , Andrew McCallum

This paper connects a vector-based composition model to a formal semantics, the Dependency-based Compositional Semantics (DCS). We show theoretical evidence that the vector compositions in our model conform to the logic of DCS.…

Computation and Language · Computer Science 2016-06-09 Ran Tian , Naoaki Okazaki , Kentaro Inui

Word Sense Disambiguation is an open problem in Natural Language Processing which is particularly challenging and useful in the unsupervised setting where all the words in any given text need to be disambiguated without using any labeled…

Computation and Language · Computer Science 2018-01-09 Devendra Singh Chaplot , Ruslan Salakhutdinov

Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge…

Computation and Language · Computer Science 2020-10-20 Sai Sharath Japa , Rekabdar Banafsheh

A sememe is defined as the minimum semantic unit of human languages. Sememe knowledge bases (KBs), which contain words annotated with sememes, have been successfully applied to many NLP tasks, and we believe that by learning the smallest…

Computation and Language · Computer Science 2022-08-11 Xiaoran Li , Toshiaki Takano

Semantic parsers convert natural language to logical forms, which can be evaluated on knowledge bases (KBs) to produce denotations. Recent semantic parsers have been developed with sequence-to-sequence (seq2seq) pre-trained language models…

Computation and Language · Computer Science 2026-01-01 Daehwan Nam , Gary Geunbae Lee

This paper presents the DLV system, which is widely considered the state-of-the-art implementation of disjunctive logic programming, and addresses several aspects. As for problem solving, we provide a formal definition of its kernel…

Artificial Intelligence · Computer Science 2008-02-21 Nicola Leone , Gerald Pfeifer , Wolfgang Faber , Thomas Eiter , Georg Gottlob , Simona Perri , Francesco Scarcello

Ambiguity is ubiquitous in natural language. Resolving ambiguous meanings is especially important in information retrieval tasks. While word embeddings carry semantic information, they fail to handle ambiguity well. Transformer models have…

Computation and Language · Computer Science 2023-07-26 Matthias Thurnbauer , Johannes Reisinger , Christoph Goller , Andreas Fischer

DCSP (Distributed Constraint Satisfaction Problem) has been a very important research area in AI (Artificial Intelligence). There are many application problems in distributed AI that can be formalized as DSCPs. With the increasing…

Artificial Intelligence · Computer Science 2010-10-01 Hong Jiang

In this paper, we applied a novel learning algorithm, namely, Deep Belief Networks (DBN) to word sense disambiguation (WSD). DBN is a probabilistic generative model composed of multiple layers of hidden units. DBN uses Restricted Boltzmann…

Computation and Language · Computer Science 2012-07-03 Peratham Wiriyathammabhum , Boonserm Kijsirikul , Hiroya Takamura , Manabu Okumura

Knowledge bases (KBs) contain plenty of structured world and commonsense knowledge. As such, they often complement distributional text-based information and facilitate various downstream tasks. Since their manual construction is resource-…

Computation and Language · Computer Science 2022-03-10 Wenxuan Zhou , Fangyu Liu , Ivan Vulić , Nigel Collier , Muhao Chen

Distributed representations of words learned from text have proved to be successful in various natural language processing tasks in recent times. While some methods represent words as vectors computed from text using predictive model…

Computation and Language · Computer Science 2018-02-20 Abhik Jana , Pawan Goyal

While transformers demonstrate impressive performance on many knowledge intensive (KI) tasks, their ability to serve as implicit knowledge bases (KBs) remains limited, as shown on several slot-filling, question-answering (QA), fact…

Computation and Language · Computer Science 2022-03-21 Nic Jedema , Thuy Vu , Manish Gupta , Alessandro Moschitti

In traditional Distributional Semantic Models (DSMs) the multiple senses of a polysemous word are conflated into a single vector space representation. In this work, we propose a DSM that learns multiple distributional representations of a…

Computation and Language · Computer Science 2019-04-12 Eleftheria Briakou , Nikos Athanasiou , Alexandros Potamianos

Knowledge bases (KBs) about notable entities and their properties are an important asset in applications such as search, question answering and dialogue. All popular KBs capture virtually only positive statements, and abstain from taking…

Information Retrieval · Computer Science 2021-11-29 Hiba Arnaout , Simon Razniewski , Gerhard Weikum , Jeff Z. Pan

Knowledge facts are typically represented by relational triples, while we observe that some commonsense facts are represented by the triples whose forms are inconsistent with the expression of language. This inconsistency puts forward a…

Computation and Language · Computer Science 2021-06-01 Yi Zhang , Lei Li , Yunfang Wu , Qi Su , Xu Sun

Semantic communication is widely touted as a key technology for propelling the sixth-generation (6G) wireless networks. However, providing effective semantic representation is quite challenging in practice. To address this issue, this…

Information Theory · Computer Science 2024-06-18 Jinke Ren , Zezhong Zhang , Jie Xu , Guanying Chen , Yaping Sun , Ping Zhang , Shuguang Cui

Reasoning with knowledge expressed in natural language and Knowledge Bases (KBs) is a major challenge for Artificial Intelligence, with applications in machine reading, dialogue, and question answering. General neural architectures that…

Machine Learning · Computer Science 2019-12-24 Pasquale Minervini , Matko Bošnjak , Tim Rocktäschel , Sebastian Riedel , Edward Grefenstette