English
Related papers

Related papers: Learning Diverse Document Representations with Dee…

200 papers

With the development of computational power and techniques for data collection, deep learning demonstrates a superior performance over most existing algorithms on visual benchmark data sets. Many efforts have been devoted to studying the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-25 Yuanhong Xu , Qi Qian , Hao Li , Rong Jin , Juhua Hu

Reading Comprehension has received significant attention in recent years as high quality Question Answering (QA) datasets have become available. Despite state-of-the-art methods achieving strong overall accuracy, Multi-Hop (MH) reasoning…

Computation and Language · Computer Science 2019-05-24 Alex Long , Joel Mason , Alan Blair , Wei Wang

In knowledge graph construction, a challenging issue is how to extract complex (e.g., overlapping) entities and relationships from a small amount of unstructured historical data. The traditional pipeline methods are to divide the extraction…

Computation and Language · Computer Science 2024-05-24 Jian Cheng , Tian Zhang , Shuang Zhang , Huimin Ren , Guo Yu , Xiliang Zhang , Shangce Gao , Lianbo Ma

Variational autoencoders (VAEs) learn representations of data by jointly training a probabilistic encoder and decoder network. Typically these models encode all features of the data into a single variable. Here we are interested in learning…

This paper presents GEneric iNtent Encoder (GEN Encoder) which learns a distributed representation space for user intent in search. Leveraging large scale user clicks from Bing search logs as weak supervision of user intent, GEN Encoder…

Information Retrieval · Computer Science 2019-07-26 Hongfei Zhang , Xia Song , Chenyan Xiong , Corby Rosset , Paul N. Bennett , Nick Craswell , Saurabh Tiwary

This paper presents a new state-of-the-art for document image classification and retrieval, using features learned by deep convolutional neural networks (CNNs). In object and scene analysis, deep neural nets are capable of learning a…

Computer Vision and Pattern Recognition · Computer Science 2015-02-26 Adam W. Harley , Alex Ufkes , Konstantinos G. Derpanis

Recent works on representation learning for Knowledge Graphs have moved beyond the problem of link prediction, to answering queries of an arbitrary structure. Existing methods are based on ad-hoc mechanisms that require training with a…

Artificial Intelligence · Computer Science 2020-06-25 Daniel Daza , Michael Cochez

In this paper, we present a multi-lingual sentence encoder that can be used in search engines as a query and document encoder. This embedding enables a semantic similarity score between queries and documents that can be an important feature…

Computation and Language · Computer Science 2021-06-16 Mahdi Hajiaghayi , Monir Hajiaghayi , Mark Bolin

We introduce sub-sentence encoder, a contrastively-learned contextual embedding model for fine-grained semantic representation of text. In contrast to the standard practice with sentence embeddings, where the meaning of an entire sequence…

Computation and Language · Computer Science 2023-11-09 Sihao Chen , Hongming Zhang , Tong Chen , Ben Zhou , Wenhao Yu , Dian Yu , Baolin Peng , Hongwei Wang , Dan Roth , Dong Yu

In this paper, we develop a neural summarization model which can effectively process multiple input documents and distill Transformer architecture with the ability to encode documents in a hierarchical manner. We represent cross-document…

Computation and Language · Computer Science 2019-05-31 Yang Liu , Mirella Lapata

With the recent success of dense retrieval methods based on bi-encoders, studies have applied this approach to various interesting downstream retrieval tasks with good efficiency and in-domain effectiveness. Recently, we have also seen the…

Information Retrieval · Computer Science 2022-10-24 Wei Zhong , Jheng-Hong Yang , Yuqing Xie , Jimmy Lin

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. We propose a general encoder-decoder deep learning framework…

Materials Science · Physics 2023-04-04 Qing-Jie Li , Mahmut Nedim Cinbiz , Yin Zhang , Qi He , Geoffrey Beausoleil , Ju Li

Representations from large pretrained models such as BERT encode a range of features into monolithic vectors, affording strong predictive accuracy across a multitude of downstream tasks. In this paper we explore whether it is possible to…

Computation and Language · Computer Science 2021-09-14 Xiongyi Zhang , Jan-Willem van de Meent , Byron C. Wallace

Neural retrieval models have superseded classic bag-of-words methods such as BM25 as the retrieval framework of choice. However, neural systems lack the interpretability of bag-of-words models; it is not trivial to connect a query change to…

In Information Retrieval (IR), whether implicitly or explicitly, queries and documents are often represented as vectors. However, it may be more beneficial to consider documents and/or queries as multidimensional objects. Our belief is this…

Information Retrieval · Computer Science 2010-02-18 Benjamin Piwowarski , Ingo Frommholz , Mounia Lalmas , Keith van Rijsbergen

This paper aims at improving how machines can answer questions directly from text, with the focus of having models that can answer correctly multiple types of questions and from various types of texts, documents or even from large…

Computation and Language · Computer Science 2018-04-30 Martin Raison , Pierre-Emmanuel Mazaré , Rajarshi Das , Antoine Bordes

In document-level relation extraction (DocRE), graph structure is generally used to encode relation information in the input document to classify the relation category between each entity pair, and has greatly advanced the DocRE task over…

Computation and Language · Computer Science 2020-12-22 Wang Xu , Kehai Chen , Tiejun Zhao

In this paper, we focus on learning structure-aware document representations from data without recourse to a discourse parser or additional annotations. Drawing inspiration from recent efforts to empower neural networks with a structural…

Computation and Language · Computer Science 2018-02-06 Yang Liu , Mirella Lapata

We propose a Deep Texture Encoding Network (Deep-TEN) with a novel Encoding Layer integrated on top of convolutional layers, which ports the entire dictionary learning and encoding pipeline into a single model. Current methods build from…

Computer Vision and Pattern Recognition · Computer Science 2016-12-12 Hang Zhang , Jia Xue , Kristin Dana

In this paper, we propose a deep multiple description coding framework, whose quantizers are adaptively learned via the minimization of multiple description compressive loss. Firstly, our framework is built upon auto-encoder networks, which…

Multimedia · Computer Science 2019-02-07 Lijun Zhao , Huihui Bai , Anhong Wang , Yao Zhao