English
Related papers

Related papers: Analysis Methods in Neural Language Processing: A …

200 papers

Unsupervised representation learning for speech processing has matured greatly in the last few years. Work in computer vision and natural language processing has paved the way, but speech data offers unique challenges. As a result, methods…

Audio and Speech Processing · Electrical Eng. & Systems 2022-03-04 Lasse Borgholt , Jakob Drachmann Havtorn , Joakim Edin , Lars Maaløe , Christian Igel

Neural networks trained on natural language processing tasks capture syntax even though it is not provided as a supervision signal. This indicates that syntactic analysis is essential to the understating of language in artificial…

Computation and Language · Computer Science 2020-10-05 Tomasz Limisiewicz , David Mareček

Text Classification is the most essential and fundamental problem in Natural Language Processing. While numerous recent text classification models applied the sequential deep learning technique, graph neural network-based models can…

Computation and Language · Computer Science 2024-07-08 Kunze Wang , Yihao Ding , Soyeon Caren Han

In the last few years, deep learning has led to very good performance on a variety of problems, such as visual recognition, speech recognition and natural language processing. Among different types of deep neural networks, convolutional…

Computer Vision and Pattern Recognition · Computer Science 2017-10-20 Jiuxiang Gu , Zhenhua Wang , Jason Kuen , Lianyang Ma , Amir Shahroudy , Bing Shuai , Ting Liu , Xingxing Wang , Li Wang , Gang Wang , Jianfei Cai , Tsuhan Chen

In the past few years, machine learning-based approaches have had some great success for rendering animated feature films. This survey summarizes several of the most dramatic improvements in using deep neural networks over traditional…

Graphics · Computer Science 2020-05-27 Shilin Zhu

Computational morphology handles the language processing at the word level. It is one of the foundational tasks in the NLP pipeline for the development of higher level NLP applications. It mainly deals with the processing of words and word…

Computation and Language · Computer Science 2024-06-11 Jatayu Baxi , Brijesh Bhatt

Deep learning is increasingly used as a building block of security systems. Unfortunately, neural networks are hard to interpret and typically opaque to the practitioner. The machine learning community has started to address this problem by…

Machine Learning · Computer Science 2020-04-28 Alexander Warnecke , Daniel Arp , Christian Wressnegger , Konrad Rieck

Many natural language processing (NLP) tasks are naturally imbalanced, as some target categories occur much more frequently than others in the real world. In such scenarios, current NLP models still tend to perform poorly on less frequent…

Computation and Language · Computer Science 2023-02-23 Sophie Henning , William Beluch , Alexander Fraser , Annemarie Friedrich

With the ever-growing volume of online information, recommender systems have been an effective strategy to overcome such information overload. The utility of recommender systems cannot be overstated, given its widespread adoption in many…

Information Retrieval · Computer Science 2019-07-11 Shuai Zhang , Lina Yao , Aixin Sun , Yi Tay

While neural networks have been successfully applied to many natural language processing tasks, they come at the cost of interpretability. In this paper, we propose a general methodology to analyze and interpret decisions from a neural…

Computation and Language · Computer Science 2017-01-11 Jiwei Li , Will Monroe , Dan Jurafsky

The field of Deep Learning (DL) has undergone explosive growth during the last decade, with a substantial impact on Natural Language Processing (NLP) as well. Yet, compared to more established disciplines, a lack of common experimental…

In the rapidly evolving domain of Natural Language Generation (NLG) evaluation, introducing Large Language Models (LLMs) has opened new avenues for assessing generated content quality, e.g., coherence, creativity, and context relevance.…

Computation and Language · Computer Science 2024-06-13 Zhen Li , Xiaohan Xu , Tao Shen , Can Xu , Jia-Chen Gu , Yuxuan Lai , Chongyang Tao , Shuai Ma

This survey paper proposes a clearer view of natural language reasoning in the field of Natural Language Processing (NLP), both conceptually and practically. Conceptually, we provide a distinct definition for natural language reasoning in…

Computation and Language · Computer Science 2023-05-16 Fei Yu , Hongbo Zhang , Prayag Tiwari , Benyou Wang

Natural Language Processing (NLP) is a key technique for developing Medical Artificial Intelligence (AI) systems that leverage Electronic Health Record (EHR) data to build diagnostic and prognostic models. NLP enables the conversion of…

Text summarization research has undergone several significant transformations with the advent of deep neural networks, pre-trained language models (PLMs), and recent large language models (LLMs). This survey thus provides a comprehensive…

Computation and Language · Computer Science 2024-06-18 Haopeng Zhang , Philip S. Yu , Jiawei Zhang

The number of Language Models (LMs) dedicated to processing scientific text is on the rise. Keeping pace with the rapid growth of scientific LMs (SciLMs) has become a daunting task for researchers. To date, no comprehensive surveys on…

Computation and Language · Computer Science 2024-02-01 Xanh Ho , Anh Khoa Duong Nguyen , An Tuan Dao , Junfeng Jiang , Yuki Chida , Kaito Sugimoto , Huy Quoc To , Florian Boudin , Akiko Aizawa

Despite differing from the human language processing mechanism in implementation and algorithms, current language models demonstrate remarkable human-like or surpassing language capabilities. Should computational language models be employed…

Computation and Language · Computer Science 2024-03-21 Shaonan Wang , Jingyuan Sun , Yunhao Zhang , Nan Lin , Marie-Francine Moens , Chengqing Zong

Neural embedding approaches have become a staple in the fields of computer vision, natural language processing, and more recently, graph analytics. Given the pervasive nature of these algorithms, the natural question becomes how to exploit…

Computation and Language · Computer Science 2020-10-27 Alexander Kalinowski , Yuan An

In recent years, considerable research has been dedicated to the application of neural models in the field of natural language generation (NLG). The primary objective is to generate text that is both linguistically natural and human-like,…

Computation and Language · Computer Science 2023-06-13 Chen Tang , Frank Guerin , Chenghua Lin

State-of-the-art deep-learning-based approaches to Natural Language Processing (NLP) are credited with various capabilities that involve reasoning with natural language texts. In this paper we carry out a large-scale empirical study…

Computation and Language · Computer Science 2022-11-11 Viktor Schlegel , Kamen V. Pavlov , Ian Pratt-Hartmann