English
Related papers

Related papers: COVID-Twitter-BERT: A Natural Language Processing …

200 papers

The most effective of the solutions against Covid-19 is the various vaccines developed. Distrust of vaccines can hinder the rapid and effective use of this remedy. One of the means of expressing the thoughts of society is social media.…

Computation and Language · Computer Science 2022-02-02 Ülkü Tuncer Küçüktaş , Fatih Uysal , Fırat Hardalaç , İsmail Biri

This paper presents the approach that we employed to tackle the EMNLP WNUT-2020 Shared Task 2 : Identification of informative COVID-19 English Tweets. The task is to develop a system that automatically identifies whether an English Tweet…

Computation and Language · Computer Science 2020-12-17 Anshul Wadhawan

We experiment with COVID-Twitter-BERT and RoBERTa models to identify informative COVID-19 tweets. We further experiment with adversarial training to make our models robust. The ensemble of COVID-Twitter-BERT and RoBERTa obtains a F1-score…

Computation and Language · Computer Science 2020-10-12 Priyanshu Kumar , Aadarsh Singh

Since the classification of COVID-19 as a global pandemic, there have been many attempts to treat and contain the virus. Although there is no specific antiviral treatment recommended for COVID-19, there are several drugs that can…

Information Retrieval · Computer Science 2020-10-12 Ramya Tekumalla , Juan M. Banda

We present a novel approach incorporating transformer-based language models into infectious disease modelling. Text-derived features are quantified by tracking high-density clusters of sentence-level representations of Reddit posts within…

Computation and Language · Computer Science 2022-05-25 Felix Drinkall , Stefan Zohren , Janet B. Pierrehumbert

The ubiquity of the contemporary language understanding tasks gives relevance to the development of generalized, yet highly efficient models that utilize all knowledge, provided by the data source. In this work, we present SocialBERT - the…

Computation and Language · Computer Science 2021-11-16 Ilia Karpov , Nick Kartashev

As the COVID-19 outbreak continues to spread throughout the world, more and more information about the pandemic has been shared publicly on social media. For example, there are a huge number of COVID-19 English Tweets daily on Twitter.…

Computation and Language · Computer Science 2020-09-01 Anh Tuan Nguyen

The recent global outbreak of the coronavirus disease (COVID-19) has spread to all corners of the globe. The international travel ban, panic buying, and the need for self-quarantine are among the many other social challenges brought about…

Information Retrieval · Computer Science 2022-12-20 Ankita Agarwal , Preetham Salehundam , Swati Padhee , William L. Romine , Tanvi Banerjee

Language model pre-training has proven to be useful in learning universal language representations. As a state-of-the-art language model pre-training model, BERT (Bidirectional Encoder Representations from Transformers) has achieved amazing…

Computation and Language · Computer Science 2020-02-06 Chi Sun , Xipeng Qiu , Yige Xu , Xuanjing Huang

This paper describes the participation of the QMUL-SDS team for Task 1 of the CLEF 2020 CheckThat! shared task. The purpose of this task is to determine the check-worthiness of tweets about COVID-19 to identify and prioritise tweets that…

Computation and Language · Computer Science 2020-09-01 Rabab Alkhalifa , Theodore Yoong , Elena Kochkina , Arkaitz Zubiaga , Maria Liakata

The rapid growth of biomedical literature poses a significant challenge for curation and interpretation. This has become more evident during the COVID-19 pandemic. LitCovid, a literature database of COVID-19 related papers in PubMed, has…

Computation and Language · Computer Science 2022-04-20 Qingyu Chen , Jingcheng Du , Alexis Allot , Zhiyong Lu

In this paper, a BERT based neural network model is applied to the JIGSAW data set in order to create a model identifying hateful and toxic comments (strictly seperated from offensive language) in online social platforms (English language),…

Computation and Language · Computer Science 2021-10-12 Aygul Zagidullina , Georgios Patoulidis , Jonas Bokstaller

We build a sentence-level political discourse classifier using existing human expert annotated corpora of political manifestos from the Manifestos Project (Volkens et al., 2020a) and applying them to a corpus ofCOVID-19Press Briefings…

Computation and Language · Computer Science 2020-11-03 Kakia Chatsiou

Medical imaging technologies, including computed tomography (CT) or chest X-Ray (CXR), are largely employed to facilitate the diagnosis of the COVID-19. Since manual report writing is usually too time-consuming, a more intelligent auxiliary…

Computer Vision and Pattern Recognition · Computer Science 2021-08-19 Guangyi Liu , Yinghong Liao , Fuyu Wang , Bin Zhang , Lu Zhang , Xiaodan Liang , Xiang Wan , Shaolin Li , Zhen Li , Shuixing Zhang , Shuguang Cui

In this paper, we describe our approach in the shared task: COVID-19 event extraction from Twitter. The objective of this task is to extract answers from COVID-related tweets to a set of predefined slot-filling questions. Our approach…

Computation and Language · Computer Science 2021-02-19 Congcong Wang , David Lillis

Obtaining large-scale annotated data for NLP tasks in the scientific domain is challenging and expensive. We release SciBERT, a pretrained language model based on BERT (Devlin et al., 2018) to address the lack of high-quality, large-scale…

Computation and Language · Computer Science 2019-09-12 Iz Beltagy , Kyle Lo , Arman Cohan

The objective of this work is to explore popular discourse about the COVID-19 pandemic and policies implemented to manage it. Using Natural Language Processing, Text Mining, and Network Analysis to analyze corpus of tweets that relate to…

Social and Information Networks · Computer Science 2020-03-24 Christian E. Lopez , Malolan Vasu , Caleb Gallemore

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional…

Computation and Language · Computer Science 2019-05-28 Jacob Devlin , Ming-Wei Chang , Kenton Lee , Kristina Toutanova

Transformer-based machine learning models have become an essential tool for many natural language processing (NLP) tasks since the introduction of the method. A common objective of these projects is to classify text data. Classification…

Computation and Language · Computer Science 2025-02-18 Zoltán Kmetty , Bence Kollányi , Krisztián Boros

The spread of COVID-19 has become a significant and troubling aspect of society in 2020. With millions of cases reported across countries, new outbreaks have occurred and followed patterns of previously affected areas. Many disease…

Computation and Language · Computer Science 2020-10-19 Sharon Levy , William Yang Wang