English
Related papers

Related papers: Generating Memorable Mnemonic Encodings of Numbers

200 papers

Semantic parsing is the problem of deriving machine interpretable meaning representations from natural language utterances. Neural models with encoder-decoder architectures have recently achieved substantial improvements over traditional…

Computation and Language · Computer Science 2019-09-30 Huseyin A. Inan , Gaurav Singh Tomar , Huapu Pan

This paper look at how the Hopfield neural network can be used to store and recall patterns constructed from natural language sentences. As a pattern recognition and storage tool, the Hopfield neural network has received much attention.…

cmp-lg · Computer Science 2008-02-03 Nigel Collier

Data representation is a fundamental task in machine learning. The representation of data affects the performance of the whole machine learning system. In a long history, the representation of data is done by feature engineering, and…

Computation and Language · Computer Science 2016-11-21 Siwei Lai

Language models have been shown to be rich enough to encode fMRI activations of certain Regions of Interest in our Brains. Previous works have explored transfer learning from representations learned for popular natural language processing…

Computation and Language · Computer Science 2023-11-10 Arvindh Arun , Jerrin John , Sanjai Kumaran

Sentence matching is a fundamental task of natural language processing with various applications. Most recent approaches adopt attention-based neural models to build word- or phrase-level alignment between two sentences. However, these…

Computation and Language · Computer Science 2021-10-22 Peng Cui , Le Hu , Yuanchao Liu

This paper introduces a sentence to vector encoding framework suitable for advanced natural language processing. Our latent representation is shown to encode sentences with common semantic information with similar vector representations.…

Computation and Language · Computer Science 2018-09-30 Chi Zhang , Shagan Sah , Thang Nguyen , Dheeraj Peri , Alexander Loui , Carl Salvaggio , Raymond Ptucha

Memorization in language models is typically treated as a homogenous phenomenon, neglecting the specifics of the memorized data. We instead model memorization as the effect of a set of complex factors that describe each sample and relate it…

Generative molecular design has moved from proof-of-concept to real-world applicability, as marked by the surge in very recent papers reporting experimental validation. Key challenges in explainability and sample efficiency present…

Biomolecules · Quantitative Biology 2024-03-05 Jeff Guo , Philippe Schwaller

We present a neural model for paraphrasing and train it to generate delexicalized sentences. We achieve this by creating training data in which each input is paired with a number of reference paraphrases. These sets of reference paraphrases…

Computation and Language · Computer Science 2020-12-07 Boya Yu , Konstantine Arkoudas , Wael Hamza

"How to generate a sentence" is the most critical and difficult problem in all the natural language processing technologies. In this paper, we present a new approach to explain the generation process of a sentence from the perspective of…

Computation and Language · Computer Science 2014-07-28 Chen Lijiang

We introduce quantitative usability and security models to guide the design of password management schemes --- systematic strategies to help users create and remember multiple passwords. In the same way that security proofs in cryptography…

Cryptography and Security · Computer Science 2013-09-11 Jeremiah Blocki , Manuel Blum , Anupam Datta

Source code summarization is the task of writing natural language descriptions of source code behavior. Code summarization underpins software documentation for programmers. Short descriptions of code help programmers understand the program…

Artificial Intelligence · Computer Science 2023-07-24 Aakash Bansal , Siyuan Jiang , Sakib Haque , Collin McMillan

Most recent approaches use the sequence-to-sequence model for paraphrase generation. The existing sequence-to-sequence model tends to memorize the words and the patterns in the training dataset instead of learning the meaning of the words.…

Computation and Language · Computer Science 2018-04-02 Shuming Ma , Xu Sun , Wei Li , Sujian Li , Wenjie Li , Xuancheng Ren

Sentences produced by abstractive summarization systems can be ungrammatical and fail to preserve the original meanings, despite being locally fluent. In this paper we propose to remedy this problem by jointly generating a sentence and its…

Computation and Language · Computer Science 2019-11-26 Kaiqiang Song , Logan Lebanoff , Qipeng Guo , Xipeng Qiu , Xiangyang Xue , Chen Li , Dong Yu , Fei Liu

Most existing Neural Machine Translation models use groups of characters or whole words as their unit of input and output. We propose a model with a hierarchical char2word encoder, that takes individual characters both as input and output.…

Computation and Language · Computer Science 2016-10-21 Alexander Rosenberg Johansen , Jonas Meinertz Hansen , Elias Khazen Obeid , Casper Kaae Sønderby , Ole Winther

Deep learning methods have recently achieved great empirical success on machine translation, dialogue response generation, summarization, and other text generation tasks. At a high level, the technique has been to train end-to-end neural…

Computation and Language · Computer Science 2017-11-28 Ziang Xie

Encoder-decoder models have been widely used to solve sequence to sequence prediction tasks. However current approaches suffer from two shortcomings. First, the encoders compute a representation of each word taking into account only the…

Computation and Language · Computer Science 2016-11-11 Wenyuan Zeng , Wenjie Luo , Sanja Fidler , Raquel Urtasun

Numeracy is the ability to understand and work with numbers. It is a necessary skill for composing and understanding documents in clinical, scientific, and other technical domains. In this paper, we explore different strategies for…

Computation and Language · Computer Science 2021-03-29 Georgios P. Spithourakis , Sebastian Riedel

The sequence to sequence architecture is widely used in the response generation and neural machine translation to model the potential relationship between two sentences. It typically consists of two parts: an encoder that reads from the…

Computation and Language · Computer Science 2016-08-22 Qingfu Zhu , Weinan Zhang , Lianqiang Zhou , Ting Liu

Auto-encoders compress input data into a latent-space representation and reconstruct the original data from the representation. This latent representation is not easily interpreted by humans. In this paper, we propose training an…

Computation and Language · Computer Science 2018-10-09 Yau-Shian Wang , Hung-Yi Lee