English

Representation Learning for Natural Language Processing

Computation and Language 2021-02-09 v1
Authors: Zhiyuan Liu , Yankai Lin , Maosong Sun
View on arXiv ↗ PDF ↗ DOI ↗

Abstract

This book aims to review and present the recent advances of distributed representation learning for NLP, including why representation learning can improve NLP, how representation learning takes part in various important topics of NLP, and what challenges are still not well addressed by distributed representation.

Keywords

representation learning natural language processing machine learning

Cite

@article{arxiv.2102.03732,
  title  = {Representation Learning for Natural Language Processing},
  author = {Zhiyuan Liu and Yankai Lin and Maosong Sun},
  journal= {arXiv preprint arXiv:2102.03732},
  year   = {2021}
}

Comments

Published in Springer

Related papers

View all related →
Machine Learning · Computer Science
Deep Learning of Representations: Looking Forward
Yoshua Bengio
2013-06-10
Computation and Language · Computer Science
Natural Language Processing Advancements By Deep Learning: A Survey
Amirsina Torfi, Rouzbeh A. Shirvani, Yaser Keneshloo, Nader Tavaf +1
2021-03-02
Computation and Language · Computer Science
Natural Language Understanding with Distributed Representation
Kyunghyun Cho
2015-11-26
Computation and Language · Computer Science
Recent Trends in Deep Learning Based Natural Language Processing
Tom Young, Devamanyu Hazarika, Soujanya Poria, Erik Cambria
2018-11-27
Computation and Language · Computer Science
Natural Language Processing - A Survey
Kevin Mote
2012-09-28
Computation and Language · Computer Science
Distributed Representations for Compositional Semantics
Karl Moritz Hermann
2014-11-13
Computation and Language · Computer Science
Operationalising Representation in Natural Language Processing
Jacqueline Harding
2023-11-21
Computation and Language · Computer Science
Learning Neural Models for Natural Language Processing in the Face of Distributional Shift
Paul Michel
2021-09-06
Computation and Language · Computer Science
Pre-trained Models for Natural Language Processing: A Survey
Xipeng Qiu, Tianxiang Sun, Yige Xu, Yunfan Shao +2
2021-06-24
Computation and Language · Computer Science
Survey on reinforcement learning for language processing
Victor Uc-Cetina, Nicolas Navarro-Guerrero, Anabel Martin-Gonzalez, Cornelius Weber +1
2026-04-29
Machine Learning · Computer Science
Representation Learning: A Review and New Perspectives
Yoshua Bengio, Aaron Courville, Pascal Vincent
2014-04-24
Neural and Evolutionary Computing · Computer Science
Combining Representation Learning with Logic for Language Processing
Tim Rocktäschel
2017-12-29
Machine Learning · Statistics
Representation Learning: A Statistical Perspective
Jianwen Xie, Ruiqi Gao, Erik Nijkamp, Song-Chun Zhu +1
2019-11-27
Computation and Language · Computer Science
Natural Language Processing for Human Resources: A Survey
Naoki Otani, Nikita Bhutani, Estevam Hruschka
2025-03-26
Computation and Language · Computer Science
Multilingual Distributed Representations without Word Alignment
Karl Moritz Hermann, Phil Blunsom
2014-03-21
Computation and Language · Computer Science
Symbolic, Distributed and Distributional Representations for Natural Language Processing in the Era of Deep Learning: a Survey
Lorenzo Ferrone, Fabio Massimo Zanzotto
2020-03-02
Artificial Intelligence · Computer Science
Distributed Linguistic Representations in Decision Making: Taxonomy, Key Elements and Applications, and Challenges in Data Science and Explainable Artificial Intelligence
Yuzhu Wu, Zhen Zhang, Gang Kou, Hengjie Zhang +4
2020-08-10
Computation and Language · Computer Science
Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning
Sandeep Subramanian, Adam Trischler, Yoshua Bengio, Christopher J Pal
2018-04-03
Machine Learning · Computer Science
Disentangled Representations in Neural Models
William Whitney
2016-02-09
Computation and Language · Computer Science
Survey of Natural Language Processing for Education: Taxonomy, Systematic Review, and Future Trends
Yunshi Lan, Xinyuan Li, Hanyue Du, Xuesong Lu +3
2025-10-14
Machine Learning · Computer Science
Deep representation learning: Fundamentals, Perspectives, Applications, and Open Challenges
Kourosh T. Baghaei, Amirreza Payandeh, Pooya Fayyazsanavi, Shahram Rahimi +2
2022-11-29
Machine Learning · Computer Science
Provable benefits of representation learning
Sanjeev Arora, Andrej Risteski
2017-06-15
Machine Learning · Computer Science
Representation Learning by Ranking across multiple tasks
Lifeng Gu
2025-04-22
Machine Learning · Computer Science
Learning to Represent Edits
Pengcheng Yin, Graham Neubig, Miltiadis Allamanis, Marc Brockschmidt +1
2019-02-25
Computation and Language · Computer Science
A Survey of the Usages of Deep Learning in Natural Language Processing
Daniel W. Otter, Julian R. Medina, Jugal K. Kalita
2019-12-24
R2 v1 2026-06-23T22:54:34.343Z