English
Related papers

Related papers: Ad Text Classification with Transformer-Based Natu…

200 papers

The automatic classification is a process of automatically assigning text documents to predefined categories. An accurate automatic patent classifier is crucial to patent inventors and patent examiners in terms of intellectual property…

Computation and Language · Computer Science 2019-11-15 Xiaolei Lu , Bin Ni

Text classification is an area of research which has been studied over the years in Natural Language Processing (NLP). Adapting NLP to multiple domains has introduced many new challenges for text classification and one of them is long…

Computation and Language · Computer Science 2023-07-20 Damith Premasiri , Tharindu Ranasinghe , Ruslan Mitkov

Natural Language Processing (NLP) relies heavily on training data. Transformers, as they have gotten bigger, have required massive amounts of training data. To satisfy this requirement, text augmentation should be looked at as a way to…

Computation and Language · Computer Science 2022-11-17 Matthew Ciolino , David Noever , Josh Kalin

Named entity recognition is a natural language processing task to recognize and extract spans of text associated with named entities and classify them in semantic Categories. Google BERT is a deep bidirectional language model, pre-trained…

Computation and Language · Computer Science 2020-03-20 Ehsan Taher , Seyed Abbas Hoseini , Mehrnoush Shamsfard

This tutorial demonstrates workflows to incorporate text data into actuarial classification and regression tasks. The main focus is on methods employing transformer-based models. A dataset of car accident descriptions with an average length…

Computation and Language · Computer Science 2023-09-26 Andreas Troxler , Jürg Schelldorfer

Text classification systems have been proven vulnerable to adversarial text examples, modified versions of the original text examples that are often unnoticed by human eyes, yet can force text classification models to alter their…

Computation and Language · Computer Science 2024-02-07 Norah Alshahrani , Saied Alshahrani , Esma Wali , Jeanna Matthews

AI-generated text detection plays an increasingly important role in various fields. In this study, we developed an efficient AI-generated text detection model based on the BERT algorithm, which provides new ideas and methods for solving…

Computation and Language · Computer Science 2024-10-15 Hao Wang , Jianwei Li , Zhengyu Li

As the volume of digital image data increases, the effectiveness of image classification intensifies. This study introduces a robust multi-label classification system designed to assign multiple labels to a single image, addressing the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-06 Haixu Liu , Penghao Jiang , Zerui Tao

This study introduces an AI-based methodology that utilizes natural language processing (NLP) to detect burnout from textual data. The approach relies on a RuBERT model originally trained for sentiment analysis and subsequently fine-tuned…

Computation and Language · Computer Science 2026-01-27 Marina Zavertiaeva , Petr Parshakov , Mikhail Usanin , Aleksei Smirnov , Sofia Paklina , Anastasiia Kibardina

Transformer-based models such as BERT, XLNET, and XLM-R have achieved state-of-the-art performance across various NLP tasks including the identification of offensive language and hate speech, an important problem in social media. In this…

Computation and Language · Computer Science 2021-09-14 Diptanu Sarkar , Marcos Zampieri , Tharindu Ranasinghe , Alexander Ororbia

Pre-trained transformer models such as BERT have shown massive gains across many text classification tasks. However, these models usually need enormous labeled data to achieve impressive performances. Obtaining labeled data is often…

Computation and Language · Computer Science 2025-01-15 Rohit Sharma , Shanu Kumar , Avinash Kumar

Sentiment classification is an important process in understanding people's perception towards a product, service, or topic. Many natural language processing models have been proposed to solve the sentiment classification problem. However,…

Computation and Language · Computer Science 2019-10-09 Manish Munikar , Sushil Shakya , Aakash Shrestha

The combined growth of available data and their unstructured nature has received increased interest in natural language processing (NLP) techniques to make value of these data assets since this format is not suitable for statistical…

Computation and Language · Computer Science 2023-04-07 Vitor Alcantara Batista , Alexandre Gonçalves Evsukoff

Recent advances in natural language processing (NLP) have been driven bypretrained language models like BERT, RoBERTa, T5, and GPT. Thesemodels excel at understanding complex texts, but biomedical literature, withits domain-specific…

Computation and Language · Computer Science 2025-07-28 K. Sahit Reddy , N. Ragavenderan , Vasanth K. , Ganesh N. Naik , Vishalakshi Prabhu , Nagaraja G. S

Semantic role labeling is a crucial task in natural language processing, enabling better comprehension of natural language. However, the lack of annotated data in multiple languages has posed a challenge for researchers. To address this, a…

Computation and Language · Computer Science 2024-08-29 Mohammad Ebrahimi , Behrouz Minaei Bidgoli , Nasim Khozouei

Biomedical Named Entity Recognition (NER) is a fundamental task of Biomedical Natural Language Processing for extracting relevant information from biomedical texts, such as clinical records, scientific publications, and electronic health…

Computation and Language · Computer Science 2023-12-27 Fahime Shahrokh , Nasser Ghadiri , Rasoul Samani , Milad Moradi

BERT has revolutionized the NLP field by enabling transfer learning with large language models that can capture complex textual patterns, reaching the state-of-the-art for an expressive number of NLP applications. For text classification…

Computation and Language · Computer Science 2022-01-11 Frederico Souza , João Filho

We focus on multi-turn response selection in a retrieval-based dialog system. In this paper, we utilize the powerful pre-trained language model Bi-directional Encoder Representations from Transformer (BERT) for a multi-turn dialog system…

Computation and Language · Computer Science 2020-07-28 Taesun Whang , Dongyub Lee , Chanhee Lee , Kisu Yang , Dongsuk Oh , HeuiSeok Lim

Entity linking, the task of mapping textual mentions to known entities, has recently been tackled using contextualized neural networks. We address the question whether these results -- reported for large, high-quality datasets such as…

Computation and Language · Computer Science 2020-05-20 Nadja Kurz , Felix Hamann , Adrian Ulges

Data augmentation is an effective technique for improving the performance of machine learning models. However, it has not been explored as extensively in natural language processing (NLP) as it has in computer vision. In this paper, we…

Computation and Language · Computer Science 2024-01-04 Himmet Toprak Kesgin , Mehmet Fatih Amasyali