English

A Bi-Encoder LSTM Model For Learning Unstructured Dialogs

Computation and Language 2026-01-28 v1 Artificial Intelligence Information Retrieval

Abstract

Creating a data-driven model that is trained on a large dataset of unstructured dialogs is a crucial step in developing Retrieval-based Chatbot systems. This paper presents a Long Short Term Memory (LSTM) based architecture that learns unstructured multi-turn dialogs and provides results on the task of selecting the best response from a collection of given responses. Ubuntu Dialog Corpus Version 2 was used as the corpus for training. We show that our model achieves 0.8%, 1.0% and 0.3% higher accuracy for Recall@1, Recall@2 and Recall@5 respectively than the benchmark model. We also show results on experiments performed by using several similarity functions, model hyper-parameters and word embeddings on the proposed architecture

Keywords

Cite

@article{arxiv.2104.12269,
  title  = {A Bi-Encoder LSTM Model For Learning Unstructured Dialogs},
  author = {Danny Brahman and Pooran S. Negi and Mohammad Mahoor},
  journal= {arXiv preprint arXiv:2104.12269},
  year   = {2026}
}
R2 v1 2026-06-24T01:30:08.289Z