English
Related papers

Related papers: Empowering Interdisciplinary Research with BERT-Ba…

200 papers

In this study, we compared the performance of four different methods for multi label text classification using a specific imbalanced business dataset. The four methods we evaluated were fine tuned BERT, Binary Relevance, Classifier Chains,…

Information Retrieval · Computer Science 2023-06-13 Muhammad Arslan , Christophe Cruz

Educational content labeled with proper knowledge components (KCs) are particularly useful to teachers or content organizers. However, manually labeling educational content is labor intensive and error-prone. To address this challenge,…

Computation and Language · Computer Science 2021-05-25 Jia Tracy Shen , Michiharu Yamashita , Ethan Prihar , Neil Heffernan , Xintao Wu , Sean McGrew , Dongwon Lee

In this study, we systematically investigate the impact of class imbalance on classification performance of convolutional neural networks (CNNs) and compare frequently used methods to address the issue. Class imbalance is a common problem…

Computer Vision and Pattern Recognition · Computer Science 2018-10-16 Mateusz Buda , Atsuto Maki , Maciej A. Mazurowski

In this paper, we propose an automatic brain tumor segmentation approach (e.g., PixelNet) using a pixel-level convolutional neural network (CNN). The model extracts feature from multiple convolutional layers and concatenate them to form a…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Mobarakol Islam , Hongliang Ren

Language models that utilize extensive self-supervised pre-training from unlabeled text, have recently shown to significantly advance the state-of-the-art performance in a variety of language understanding tasks. However, it is yet unclear…

Information Retrieval · Computer Science 2020-09-29 Itzik Malkiel , Oren Barkan , Avi Caciularu , Noam Razin , Ori Katz , Noam Koenigstein

Multi-Label Text Classification (MLTC) is a fundamental task in the field of Natural Language Processing (NLP) that involves the assignment of multiple labels to a given text. MLTC has gained significant importance and has been widely…

Computation and Language · Computer Science 2024-03-20 Bo Li , Yuyan Chen , Liang Zeng

With the rapid proliferation of textual data, predicting long texts has emerged as a significant challenge in the domain of natural language processing. Traditional text prediction methods encounter substantial difficulties when grappling…

Computation and Language · Computer Science 2024-01-24 Jiahui Zhao , Ziyi Meng , Stepan Gordeev , Zijie Pan , Dongjin Song , Sandro Steinbach , Caiwen Ding

The automatic identification of propaganda has gained significance in recent years due to technological and social changes in the way news is generated and consumed. That this task can be addressed effectively using BERT, a powerful new…

Computation and Language · Computer Science 2020-03-27 Harish Tayyar Madabushi , Elena Kochkina , Michael Castelle

Because large, human-annotated datasets suffer from labeling errors, it is crucial to be able to train deep neural networks in the presence of label noise. While training image classification models with label noise have received much…

Machine Learning · Computer Science 2019-03-19 Ishan Jindal , Daniel Pressel , Brian Lester , Matthew Nokleby

The field of natural language processing (NLP) has made significant progress with the rapid development of deep learning technologies. One of the research directions in text sentiment analysis is sentiment analysis of medical texts, which…

Computation and Language · Computer Science 2024-12-04 Yinan Chen

This paper presents a novel multi modal deep learning framework for enhanced agricultural pest detection, combining tiny-BERT's natural language processing with R-CNN and ResNet-18's image processing. Addressing limitations of traditional…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Jinli Duan , Haoyu Ding , Sung Kim

In the field of medical imaging, the advent of deep learning, especially the application of convolutional neural networks (CNNs) has revolutionized the analysis and interpretation of medical images. Nevertheless, deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Xin Li , Wenhui Zhu , Peijie Qiu , Oana M. Dumitrascu , Amal Youssef , Yalin Wang

Text classification, a core component of task-oriented dialogue systems, attracts continuous research from both the research and industry community, and has resulted in tremendous progress. However, existing method does not consider the use…

Computation and Language · Computer Science 2022-12-16 Yifeng Xie

We analyze various methods for single-label and multi-label text classification across well-known datasets, categorizing them into bag-of-words, sequence-based, graph-based, and hierarchical approaches. Despite the surge in methods like…

Computation and Language · Computer Science 2025-01-22 Lukas Galke , Ansgar Scherp , Andor Diera , Fabian Karl , Bao Xin Lin , Bhakti Khera , Tim Meuser , Tushar Singhal

This paper studies continual learning (CL) of a sequence of aspect sentiment classification (ASC) tasks. Although some CL techniques have been proposed for document sentiment classification, we are not aware of any CL work on ASC. A CL…

Computation and Language · Computer Science 2021-12-21 Zixuan Ke , Hu Xu , Bing Liu

As the number of open and shared scientific datasets on the Internet increases under the open science movement, efficiently retrieving these datasets is a crucial task in information retrieval (IR) research. In recent years, the development…

Information Retrieval · Computer Science 2023-03-31 Xintao Chu , Jianping Liu , Jian Wang , Xiaofeng Wang , Yingfei Wang , Meng Wang , Xunxun Gu

Natural language understanding (NLU) has two core tasks: intent classification and slot filling. The success of pre-training language models resulted in a significant breakthrough in the two tasks. One of the promising solutions called BERT…

Computation and Language · Computer Science 2023-02-03 Yu Guo , Zhilong Xie , Xingyan Chen , Huangen Chen , Leilei Wang , Huaming Du , Shaopeng Wei , Yu Zhao , Qing Li , Gang Wu

This study aims at improving the performance of scoring student responses in science education automatically. BERT-based language models have shown significant superiority over traditional NLP models in various language-related tasks.…

Artificial Intelligence · Computer Science 2023-11-21 Zhengliang Liu , Xinyu He , Lei Liu , Tianming Liu , Xiaoming Zhai

Recently, pre-trained contextual models, such as BERT, have shown to perform well in language related tasks. We revisit the design decisions that govern the applicability of these models for the passage re-ranking task in open-domain…

Information Retrieval · Computer Science 2021-08-31 Jurek Leonhardt , Fabian Beringer , Avishek Anand

In this paper, we focus on the classification of books using short descriptive texts (cover blurbs) and additional metadata. Building upon BERT, a deep neural language model, we demonstrate how to combine text representations with metadata…

Computation and Language · Computer Science 2019-09-19 Malte Ostendorff , Peter Bourgonje , Maria Berger , Julian Moreno-Schneider , Georg Rehm , Bela Gipp