English
Related papers

Related papers: Creating Causal Embeddings for Question Answering …

200 papers

Correlated topic modeling has been limited to small model and problem sizes due to their high computational cost and poor scaling. In this paper, we propose a new model which learns compact topic embeddings and captures topic correlations…

Machine Learning · Computer Science 2017-07-04 Junxian He , Zhiting Hu , Taylor Berg-Kirkpatrick , Ying Huang , Eric P. Xing

Neural models for question answering (QA) over documents have achieved significant performance improvements. Although effective, these models do not scale to large corpora due to their complex modeling of interactions between the document…

Computation and Language · Computer Science 2018-05-22 Sewon Min , Victor Zhong , Richard Socher , Caiming Xiong

The rapidly growing ecosystem of Large Language Models (LLMs) makes it increasingly challenging to manage and utilize the vast and dynamic pool of models effectively. We propose LOCUS, a method that produces low-dimensional vector…

Machine Learning · Computer Science 2026-01-30 Shivam Patel , William Cocke , Gauri Joshi

Causal questions inquire about causal relationships between different events or phenomena. They are important for a variety of use cases, including virtual assistants and search engines. However, many current approaches to causal question…

Artificial Intelligence · Computer Science 2024-03-26 Lukas Blübaum , Stefan Heindorf

We describe a modern deep learning system that automatically identifies informative contextual examples (\qu{contexts}) for first language vocabulary instruction for high school student. Our paper compares three modeling approaches: (i) an…

Computation and Language · Computer Science 2026-02-23 Tao Wu , Adam Kapelner

Answering logical queries over incomplete knowledge bases is challenging because: 1) it calls for implicit link prediction, and 2) brute force answering of existential first-order logic queries is exponential in the number of existential…

Artificial Intelligence · Computer Science 2021-03-02 Francois Luus , Prithviraj Sen , Pavan Kapanipathi , Ryan Riegel , Ndivhuwo Makondo , Thabang Lebese , Alexander Gray

Question Answering (QA) is in increasing demand as the amount of information available online and the desire for quick access to this content grows. A common approach to QA has been to fine-tune a pretrained language model on a…

Computation and Language · Computer Science 2020-04-27 Alexander R. Fabbri , Patrick Ng , Zhiguo Wang , Ramesh Nallapati , Bing Xiang

Word embedding has become essential for natural language processing as it boosts empirical performances of various tasks. However, recent research discovers that gender bias is incorporated in neural word embeddings, and downstream tasks…

Computation and Language · Computer Science 2019-11-26 Zekun Yang , Juan Feng

Knowledge Base, represents facts about the world, often in some form of subsumption ontology, rather than implicitly, embedded in procedural code, the way a conventional computer program does. While there is a rapid growth in knowledge…

Computation and Language · Computer Science 2020-10-20 Sai Sharath Japa , Rekabdar Banafsheh

Position embeddings, encoding the positional relationships among tokens in text sequences, make great contributions to modeling local context features in Transformer-based pre-trained language models. However, in Extractive Question…

Computation and Language · Computer Science 2023-11-21 Mingxu Tao , Yansong Feng , Dongyan Zhao

We explore the effectiveness of an LLM-guided query refinement paradigm for extending the usability of embedding models to challenging zero-shot search and classification tasks. Our approach refines the embedding representation of a user…

Computation and Language · Computer Science 2026-05-13 Ariel Gera , Shir Ashury-Tahan , Gal Bloch , Ohad Eytan , Assaf Toledo

QA models based on pretrained language mod-els have achieved remarkable performance on various benchmark datasets.However, QA models do not generalize well to unseen data that falls outside the training distribution, due to distributional…

Computation and Language · Computer Science 2021-06-25 Seanie Lee , Minki Kang , Juho Lee , Sung Ju Hwang

Word embeddings are substantially successful in capturing semantic relations among words. However, these lexical semantics are difficult to be interpreted. Definition modeling provides a more intuitive way to evaluate embeddings by…

Computation and Language · Computer Science 2020-07-21 Haitong Zhang , Yongping Du , Jiaxin Sun , Qingxiao Li

The deductive closure of an ideal knowledge base (KB) contains exactly the logical queries that the KB can answer. However, in practice KBs are both incomplete and over-specified, failing to answer some queries that have real-world answers.…

Machine Learning · Computer Science 2021-02-01 Haitian Sun , Andrew O. Arnold , Tania Bedrax-Weiss , Fernando Pereira , William W. Cohen

Nowadays, search engine users commonly rely on query suggestions to improve their initial inputs. Current systems are very good at recommending lexical adaptations or spelling corrections to users' queries. However, they often struggle to…

Information Retrieval · Computer Science 2023-01-24 Jorge Gabín , M. Eduardo Ares , Javier Parapar

Learning a high-dimensional dense representation for vocabulary terms, also known as a word embedding, has recently attracted much attention in natural language processing and information retrieval tasks. The embedding vectors are typically…

Information Retrieval · Computer Science 2017-07-18 Hamed Zamani , W. Bruce Croft

The first stage of every knowledge base question answering approach is to link entities in the input question. We investigate entity linking in the context of a question answering task and present a jointly optimized neural architecture for…

Computation and Language · Computer Science 2018-04-24 Daniil Sorokin , Iryna Gurevych

Causality has been recently introduced in databases, to model, characterize, and possibly compute causes for query answers. Connections between QA-causality and consistency-based diagnosis and database repairs (wrt. integrity constraint…

Databases · Computer Science 2017-08-01 Leopoldo Bertossi , Babak Salimi

In Embodied Question Answering (EmbodiedQA), an agent interacts with an environment to gather necessary information for answering user questions. Existing works have laid a solid foundation towards solving this interesting problem. But the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Yu Wu , Lu Jiang , Yi Yang

Biomedical Question Answering aims to obtain an answer to the given question from the biomedical domain. Due to its high requirement of biomedical domain knowledge, it is difficult for the model to learn domain knowledge from limited…

Computation and Language · Computer Science 2022-06-29 Yuxuan Lu , Jingya Yan , Zhixuan Qi , Zhongzheng Ge , Yongping Du