English
Related papers

Related papers: Transfer Learning for Scientific Data Chain Extrac…

200 papers

In recent times, transformer networks have achieved state-of-the-art performance in a wide range of natural language processing tasks. Here we present a workflow based on the fine-tuning of BERT models for different downstream tasks, which…

Materials Science · Physics 2024-02-07 Luke P. J. Gilligan , Matteo Cobelli , Valentin Taufour , Stefano Sanvito

Bioinformatics workflows are essential for complex biological data analyses and are often described in scientific articles with source code in public repositories. Extracting detailed workflow information from articles can improve…

Computation and Language · Computer Science 2025-03-11 Clémence Sebe , Sarah Cohen-Boulakia , Olivier Ferret , Aurélie Névéol

Intelligently extracting and linking complex scientific information from unstructured text is a challenging endeavor particularly for those inexperienced with natural language processing. Here, we present a simple sequence-to-sequence…

Computation and Language · Computer Science 2022-12-13 Alexander Dunn , John Dagdelen , Nicholas Walker , Sanghoon Lee , Andrew S. Rosen , Gerbrand Ceder , Kristin Persson , Anubhav Jain

We present KPI-BERT, a system which employs novel methods of named entity recognition (NER) and relation extraction (RE) to extract and link key performance indicators (KPIs), e.g. "revenue" or "interest expenses", of companies from…

Computation and Language · Computer Science 2022-08-04 Lars Hillebrand , Tobias Deußer , Tim Dilmaghani , Bernd Kliem , Rüdiger Loitz , Christian Bauckhage , Rafet Sifa

We present data augmentation techniques for process extraction tasks in scientific publications. We cast the process extraction task as a sequence labeling task where we identify all the entities in a sentence and label them according to…

Computation and Language · Computer Science 2025-04-16 Yuni Susanti

The rapid growth of research publications has placed great demands on digital libraries (DL) for advanced information management technologies. To cater to these demands, techniques relying on knowledge-graph structures are being advocated.…

Digital Libraries · Computer Science 2023-05-04 Ming Jiang , Jennifer D'Souza , Sören Auer , J. Stephen Downie

In this paper we address the challenge of extracting scientific references from patents. We approach the problem as a sequence labelling task and investigate the merits of BERT models to the extraction of these long sequences. References in…

Information Retrieval · Computer Science 2021-03-11 Ken Voskuil , Suzan Verberne

The Clinical E-Science Framework (CLEF) project was used to extract important information from medical texts by building a system for the purpose of clinical research, evidence-based healthcare and genotype-meets-phenotype informatics. The…

Information Retrieval · Computer Science 2013-06-24 Wafaa Tawfik Abdel-moneim , Mohamed Hashem Abdel-Aziz , Mohamed Monier Hassan

Text mining and information extraction for the medical domain has focused on scientific text generated by researchers. However, their direct access to individual patient experiences or patient-doctor interactions can be limited. Information…

Computation and Language · Computer Science 2022-04-22 Amelie Wührl , Roman Klinger

Chemical-disease relation (CDR) extraction is significantly important to various areas of biomedical research and health care. Nowadays, many large-scale biomedical knowledge bases (KBs) containing triples about entity pairs and their…

Computation and Language · Computer Science 2020-01-03 Huiwei Zhou , Shixian Ning , Yunlong Yang , Zhuang Liu , Chengkun Lang , Yingyu Lin

The rapid development of quantum computing has demonstrated many unique characteristics of quantum advantages, such as richer feature representation and more secured protection on model parameters. This work proposes a vertical federated…

Computation and Language · Computer Science 2022-03-08 Chao-Han Huck Yang , Jun Qi , Samuel Yen-Chi Chen , Yu Tsao , Pin-Yu Chen

Causal relation extraction of biomedical entities is one of the most complex tasks in biomedical text mining, which involves two kinds of information: entity relations and entity functions. One feasible approach is to take relation…

Computation and Language · Computer Science 2022-08-03 Dongling Li , Pengchao Wu , Yuehu Dong , Jinghang Gu , Longhua Qian , Guodong Zhou

In this paper, we present FoodChem, a new Relation Extraction (RE) model for identifying chemicals present in the composition of food entities, based on textual information provided in biomedical peer-reviewed scientific literature. The RE…

Computation and Language · Computer Science 2021-10-11 Gjorgjina Cenikj , Barbara Koroušić Seljak , Tome Eftimov

Natural language processing (NLP) of clinical trial documents can be useful in new trial design. Here we identify entity types relevant to clinical trial design and propose a framework called CT-BERT for information extraction from clinical…

Quantitative Methods · Quantitative Biology 2021-10-20 Xiong Liu , Greg L. Hersch , Iya Khalil , Murthy Devarakonda

Timely feedback is an important part of teaching and learning. Here we describe how a readily available neural network transformer (machine-learning) model (BERT) can be used to give feedback on the structure of the response to an…

Computation and Language · Computer Science 2023-05-31 Oscar Morris , Russell Morris

With the explosive growth of biomedical literature, designing automatic tools to extract information from the literature has great significance in biomedical research. Recently, transformer-based BERT models adapted to the biomedical domain…

Computation and Language · Computer Science 2020-11-03 Peng Su , K. Vijay-Shanker

Automatically extracting the relationships between chemicals and diseases is significantly important to various areas of biomedical research and health care. Biomedical experts have built many large-scale knowledge bases (KBs) to advance…

Computation and Language · Computer Science 2019-12-24 Huiwei Zhou , Yunlong Yang , Shixian Ning , Zhuang Liu , Chengkun Lang , Yingyu Lin , Degen Huang

Recently many studies have been conducted on the topic of relation extraction. The DrugProt track at BioCreative VII provides a manually-annotated corpus for the purpose of the development and evaluation of relation extraction systems, in…

Computation and Language · Computer Science 2021-12-07 Anfu Tang , Louise Deléger , Robert Bossy , Pierre Zweigenbaum , Claire Nédellec

Background : Knowledge is evolving over time, often as a result of new discoveries or changes in the adopted methods of reasoning. Also, new facts or evidence may become available, leading to new understandings of complex phenomena. This is…

Computation and Language · Computer Science 2023-04-24 Ayoub Harnoune , Maryem Rhanoui , Mounia Mikram , Siham Yousfi , Zineb Elkaimbillah , Bouchra El Asri

We investigate the incorporation of character-based word representations into a standard CNN-based relation extraction model. We experiment with two common neural architectures, CNN and LSTM, to learn word vector representations from…

Computation and Language · Computer Science 2018-05-29 Dat Quoc Nguyen , Karin Verspoor