English
Related papers

Related papers: Evolution of Natural Language Processing Technolog…

200 papers

Smart healthcare has achieved significant progress in recent years. Emerging artificial intelligence (AI) technologies enable various smart applications across various healthcare scenarios. As an essential technology powered by AI, natural…

Computation and Language · Computer Science 2023-03-23 Binggui Zhou , Guanghua Yang , Zheng Shi , Shaodan Ma

In this paper, we present a study of the recent advancements which have helped bring Transfer Learning to NLP through the use of semi-supervised training. We discuss cutting-edge methods and architectures such as BERT, GPT, ELMo, ULMFit…

Computation and Language · Computer Science 2019-10-17 Aditya Malte , Pratik Ratadiya

The remarkable progress in Natural Language Processing (NLP) brought about by deep learning, particularly with the recent advent of large pre-trained neural language models, is brought into scrutiny as several studies began to discuss and…

Computation and Language · Computer Science 2023-01-25 Anoop K. , Manjary P. Gangan , Deepak P. , Lajish V. L

Natural Language Generation (NLG) has made great progress in recent years due to the development of deep learning techniques such as pre-trained language models. This advancement has resulted in more fluent, coherent and even properties…

Computation and Language · Computer Science 2022-03-11 Wei Li , Wenhao Wu , Moye Chen , Jiachen Liu , Xinyan Xiao , Hua Wu

Natural Language Processing offers new insights into language data across almost all disciplines and domains, and allows us to corroborate and/or challenge existing knowledge. The primary hurdles to widening participation in and use of…

Computation and Language · Computer Science 2021-05-31 Rebekah Baglini , Arthur Hjorth

Natural Language Processing (NLP) has witnessed a transformative leap with the advent of transformer-based architectures, which have significantly enhanced the ability of machines to understand and generate human-like text. This paper…

Computation and Language · Computer Science 2025-03-27 Tianhao Wu , Yu Wang , Ngoc Quach

Natural Language Processing (NLP) is now a cornerstone of requirements automation. One compelling factor behind the growing adoption of NLP in Requirements Engineering (RE) is the prevalent use of natural language (NL) for specifying…

Software Engineering · Computer Science 2024-07-17 Mehrdad Sabetzadeh , Chetan Arora

Many search systems work with large amounts of natural language data, e.g., search queries, user profiles and documents, where deep learning based natural language processing techniques (deep NLP) can be of great help. In this paper, we…

Computation and Language · Computer Science 2021-08-19 Weiwei Guo , Xiaowei Liu , Sida Wang , Michaeel Kazi , Zhoutong Fu , Huiji Gao , Jun Jia , Liang Zhang , Bo Long

In recent years, natural language processing (NLP) has got great development with deep learning techniques. In the sub-field of machine translation, a new approach named Neural Machine Translation (NMT) has emerged and got massive attention…

Computation and Language · Computer Science 2020-02-19 Shuoheng Yang , Yuxin Wang , Xiaowen Chu

A major obstacle to the development of Natural Language Processing (NLP) methods in the biomedical domain is data accessibility. This problem can be addressed by generating medical data artificially. Most previous studies have focused on…

Computation and Language · Computer Science 2019-08-09 Zixu Wang , Julia Ive , Sumithra Velupillai , Lucia Specia

While deep learning techniques have shown promising results in many natural language processing (NLP) tasks, it has not been widely applied to the clinical domain. The lack of large datasets and the pervasive use of domain-specific language…

Computation and Language · Computer Science 2019-06-20 Jiin Nam , Seunghyun Yoon , Kyomin Jung

Recent large language models (LLMs) have demonstrated remarkable performance on a variety of natural language processing (NLP) tasks, leading to intense excitement about their applicability across various domains. Unfortunately, recent work…

Computation and Language · Computer Science 2023-02-13 Yaqi Xie , Chen Yu , Tongyao Zhu , Jinbin Bai , Ze Gong , Harold Soh

As generative Artificial Intelligence (AI) technologies evolve, they offer unprecedented potential to automate and enhance various tasks, including coding. Natural Language-Oriented Programming (NLOP), a vision introduced in this paper,…

Software Engineering · Computer Science 2024-06-11 Amin Beheshti

This report synthesizes the outcomes of a recent interdisciplinary workshop that brought together leading experts in cognitive psychology, language learning, and artificial intelligence (AI)-based natural language processing (NLP). The…

Computation and Language · Computer Science 2025-07-02 Emily Dux Speltz

This paper provides a comprehensive review of the literature concerning the utilization of Natural Language Processing (NLP) techniques, with a particular focus on transformer-based large language models (LLMs) trained using Big Code,…

Software Engineering · Computer Science 2023-07-07 Man Fai Wong , Shangxin Guo , Ching Nam Hang , Siu Wai Ho , Chee Wei Tan

Language documentation is inherently a time-intensive process; transcription, glossing, and corpus management consume a significant portion of documentary linguists' work. Advances in natural language processing can help to accelerate this…

Computation and Language · Computer Science 2018-12-14 Graham Neubig , Patrick Littell , Chian-Yu Chen , Jean Lee , Zirui Li , Yu-Hsiang Lin , Yuyan Zhang

Continual learning (CL) aims to enable information systems to learn from a continuous data stream across time. However, it is difficult for existing deep learning architectures to learn a new task without largely forgetting previously…

Computation and Language · Computer Science 2021-01-11 Magdalena Biesialska , Katarzyna Biesialska , Marta R. Costa-jussà

Natural Language Processing is one of the leading application areas in the current resurgence of Artificial Intelligence, spearheaded by Artificial Neural Networks. We show that despite their many successes at performing linguistic tasks,…

Computation and Language · Computer Science 2022-05-17 Csaba Veres

Recent advances in deep learning have improved the performance of many Natural Language Processing (NLP) tasks such as translation, question-answering, and text classification. However, this improvement comes at the expense of model…

Computation and Language · Computer Science 2023-11-14 Sai Gurrapu , Ajay Kulkarni , Lifu Huang , Ismini Lourentzou , Laura Freeman , Feras A. Batarseh

Artificial Intelligence (AI) is a fast-growing area of study that stretching its presence to many business and research domains. Machine learning, deep learning, and natural language processing (NLP) are subsets of AI to tackle different…

Computation and Language · Computer Science 2023-01-24 Thanveer Shaik , Xiaohui Tao , Yan Li , Christopher Dann , Jacquie Mcdonald , Petrea Redmond , Linda Galligan