中文
相关论文

相关论文: Ad Text Classification with Transformer-Based Natu…

200 篇论文

Machine based text comprehension has always been a significant research field in natural language processing. Once a full understanding of the text context and semantics is achieved, a deep learning model can be trained to solve a large…

计算与语言 · 计算机科学 2020-09-03 Omar Mossad , Amgad Ahmed , Anandharaju Raju , Hari Karthikeyan , Zayed Ahmed

With the rapid proliferation of textual data, predicting long texts has emerged as a significant challenge in the domain of natural language processing. Traditional text prediction methods encounter substantial difficulties when grappling…

计算与语言 · 计算机科学 2024-01-24 Jiahui Zhao , Ziyi Meng , Stepan Gordeev , Zijie Pan , Dongjin Song , Sandro Steinbach , Caiwen Ding

This article presents an evaluation of several machine learning methods applied to automated text classification, alongside the design of a demonstrative system for unbalanced document categorization and distribution. The study focuses on…

计算与语言 · 计算机科学 2026-02-25 Radoslaw Roszczyk , Pawel Tecza , Maciej Stodolski , Krzysztof Siwek

Transformer-based language models, such as BERT and its variants, have achieved state-of-the-art performance in several downstream natural language processing (NLP) tasks on generic benchmark datasets (e.g., GLUE, SQUAD, RACE). However,…

计算与语言 · 计算机科学 2020-09-04 John Koutsikakis , Ilias Chalkidis , Prodromos Malakasiotis , Ion Androutsopoulos

The successful application of large pre-trained models such as BERT in natural language processing has attracted more attention from researchers. Since the BERT typically acts as an end-to-end black box, classification systems based on it…

计算与语言 · 计算机科学 2023-09-06 Shuai Jiang , Sayaka Kamei , Chen Li , Shengzhe Hou , Yasuhiko Morimoto

Modern urbanization is demanding smarter technologies to improve a variety of applications in intelligent transportation systems to relieve the increasing amount of vehicular traffic congestion and incidents. Existing incident detection…

计算与语言 · 计算机科学 2020-04-30 Xiangpeng Wan , Hakim Ghazzai , Yehia Massoud

Online shopping stores have grown steadily over the past few years. Due to the massive growth of these businesses, the detection of fake reviews has attracted attention. Fake reviews are seriously trying to mislead customers and thereby…

计算与语言 · 计算机科学 2023-01-10 Abrar Qadir Mir , Furqan Yaqub Khan , Mohammad Ahsan Chishti

Thanks to the state-of-the-art Large Language Models (LLMs), language generation has reached outstanding levels. These models are capable of generating high quality content, thus making it a challenging task to detect generated text from…

计算与语言 · 计算机科学 2023-10-27 Vijini Liyanage , Davide Buscaldi

Ranking is the most important component in a search system. Mostsearch systems deal with large amounts of natural language data,hence an effective ranking system requires a deep understandingof text semantics. Recently, deep learning based…

Targeted Sentiment Analysis aims to extract sentiment towards a particular target from a given text. It is a field that is attracting attention due to the increasing accessibility of the Internet, which leads people to generate an enormous…

计算与语言 · 计算机科学 2022-05-10 M. Melih Mutlu , Arzucan Özgür

We present an approach to automatically classify clinical text at a sentence level. We are using deep convolutional neural networks to represent complex features. We train the network on a dataset providing a broad categorization of health…

计算与语言 · 计算机科学 2017-04-25 Mark Hughes , Irene Li , Spyros Kotoulas , Toyotaro Suzumura

Pre-trained Language Models (PLMs) have been widely used in various natural language processing (NLP) tasks, owing to their powerful text representations trained on large-scale corpora. In this paper, we propose a new PLM called PERT for…

计算与语言 · 计算机科学 2022-03-15 Yiming Cui , Ziqing Yang , Ting Liu

Offensive language detection is one of the most challenging problem in the natural language processing field, being imposed by the rising presence of this phenomenon in online social media. This paper describes our Transformer-based…

计算与语言 · 计算机科学 2020-10-28 Mircea-Adrian Tanase , Dumitru-Clementin Cercel , Costin-Gabriel Chiru

Sentiment analysis is an important task in the field ofNature Language Processing (NLP), in which users' feedbackdata on a specific issue are evaluated and analyzed. Manydeep learning models have been proposed to tackle this task, including…

计算与语言 · 计算机科学 2020-11-23 Quoc Thai Nguyen , Thoai Linh Nguyen , Ngoc Hoang Luong , Quoc Hung Ngo

Text classification has been one of the earliest problems in NLP. Over time the scope of application areas has broadened and the difficulty of dealing with new areas (e.g., noisy social media content) has increased. The problem-solving…

计算与语言 · 计算机科学 2020-11-10 Tanvirul Alam , Akib Khan , Firoj Alam

Machine learning methods have recently achieved high-performance in biomedical text analysis. However, a major bottleneck in the widespread application of these methods is obtaining the required large amounts of annotated training data,…

机器学习 · 计算机科学 2019-12-06 Xing Meng , Craig H. Ganoe , Ryan T. Sieberg , Yvonne Y. Cheung , Saeed Hassanpour

Language is an outcome of our complex and dynamic human-interactions and the technique of natural language processing (NLP) is hence built on human linguistic activities. Bidirectional Encoder Representations from Transformers (BERT) has…

计算与语言 · 计算机科学 2022-12-06 Katsuma Inoue , Soh Ohara , Yasuo Kuniyoshi , Kohei Nakajima

We analyze various methods for single-label and multi-label text classification across well-known datasets, categorizing them into bag-of-words, sequence-based, graph-based, and hierarchical approaches. Despite the surge in methods like…

计算与语言 · 计算机科学 2025-01-22 Lukas Galke , Ansgar Scherp , Andor Diera , Fabian Karl , Bao Xin Lin , Bhakti Khera , Tim Meuser , Tushar Singhal

Text classification is a very common task nowadays and there are many efficient methods and algorithms that we can employ to accomplish it. Transformers have revolutionized the field of deep learning, particularly in Natural Language…

机器学习 · 计算机科学 2024-12-31 Christos Petridis

Contextual word embedding models such as ELMo (Peters et al., 2018) and BERT (Devlin et al., 2018) have dramatically improved performance for many natural language processing (NLP) tasks in recent months. However, these models have been…

计算与语言 · 计算机科学 2019-06-24 Emily Alsentzer , John R. Murphy , Willie Boag , Wei-Hung Weng , Di Jin , Tristan Naumann , Matthew B. A. McDermott