English
Related papers

Related papers: A Joint Learning Approach based on Self-Distillati…

200 papers

Document-level joint entity and relation extraction is a challenging information extraction problem that requires a unified approach where a single neural network performs four sub-tasks: mention detection, coreference resolution, entity…

Computation and Language · Computer Science 2023-07-25 Witold Kosciukiewicz , Mateusz Wojcik , Tomasz Kajdanowicz , Adam Gonczarek

We examine the novel task of domain-independent scientific concept extraction from abstracts of scholarly articles and present two contributions. First, we suggest a set of generic scientific concepts that have been identified in a…

Information Retrieval · Computer Science 2020-11-24 Arthur Brack , Jennifer D'Souza , Anett Hoppe , Sören Auer , Ralph Ewerth

In this paper, we present a supervised framework for automatic keyword extraction from single document. We model the text as complex network, and construct the feature set by extracting select node properties from it. Several node…

Information Retrieval · Computer Science 2019-09-27 Swagata Duari , Vasudha Bhatnagar

Knowledge distillation is a technique for improving the performance of a simple "student" model by replacing its one-hot training labels with a distribution over labels obtained from a complex "teacher" model. While this simple approach has…

Machine Learning · Computer Science 2020-05-22 Aditya Krishna Menon , Ankit Singh Rawat , Sashank J. Reddi , Seungyeon Kim , Sanjiv Kumar

Information extraction can support novel and effective access paths for digital libraries. Nevertheless, designing reliable extraction workflows can be cost-intensive in practice. On the one hand, suitable extraction methods rely on…

Computation and Language · Computer Science 2022-05-03 Hermann Kroll , Jan Pirklbauer , Florian Plötzky , Wolf-Tilo Balke

When designing circuits, engineers obtain the information of electronic devices by browsing a large number of documents, which is low efficiency and heavy workload. The use of artificial intelligence technology to automatically parse…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Hong Cai Chen , Longchang Wu , Yang Zhang

The exponential increase in academic papers has significantly increased the time required for researchers to access relevant literature. Keyphrase Extraction (KPE) offers a solution to this situation by enabling researchers to efficiently…

Computation and Language · Computer Science 2025-05-21 Chengzhi Zhang , Xinyi Yan , Lei Zhao , Yingyi Zhang

Automated multi-document extractive text summarization is a widely studied research problem in the field of natural language understanding. Such extractive mechanisms compute in some form the worthiness of a sentence to be included into the…

Computation and Language · Computer Science 2019-12-30 Abhishek Kumar Singh , Manish Gupta , Vasudeva Varma

Pre-trained models like BERT (Devlin et al., 2018) have dominated NLP / IR applications such as single sentence classification, text pair classification, and question answering. However, deploying these models in real systems is highly…

Computation and Language · Computer Science 2021-05-06 Jiecao Chen , Liu Yang , Karthik Raman , Michael Bendersky , Jung-Jung Yeh , Yun Zhou , Marc Najork , Danyang Cai , Ehsan Emadzadeh

In the rapidly evolving field of scientific research, efficiently extracting key information from the burgeoning volume of scientific papers remains a formidable challenge. This paper introduces an innovative framework designed to automate…

Information Retrieval · Computer Science 2024-01-31 Yangyang Liu , Shoubin Li

This study presents OpenExtract, an open-source pipeline for automated data extraction in large-scale systematic literature reviews. The pipeline queries large language models (LLMs) to predict data entries based on relevant sections of…

Keyphrases are crucial for searching and systematizing scholarly documents. Most current methods for keyphrase extraction are aimed at the extraction of the most significant words in the text. But in practice, the list of keyphrases often…

Computation and Language · Computer Science 2024-10-23 Anna Glazkova , Dmitry Morozov

Knowledge distillation has been widely used to compress existing deep learning models while preserving the performance on a wide range of applications. In the specific context of Automatic Speech Recognition (ASR), distillation from…

Machine Learning · Computer Science 2021-07-06 Yan Gao , Titouan Parcollet , Nicholas Lane

Efficiently identifying keyphrases that represent a given document is a challenging task. In the last years, plethora of keyword detection approaches were proposed. These approaches can be based on statistical (frequency-based) properties…

Information Retrieval · Computer Science 2023-12-25 Blaž Škrlj , Boshko Koloski , Senja Pollak

Automated methods for granular categorization of large corpora of text documents have become increasingly more important with the rate scientific, news, medical, and web documents are growing in the last few years. Automatic keyphrase…

Information Retrieval · Computer Science 2020-05-21 Javad Rafiei Asl , Juan M. Banda

In this paper, a supervised learning technique for extracting keyphrases of Arabic documents is presented. The extractor is supplied with linguistic knowledge to enhance its efficiency instead of relying only on statistical information such…

Computation and Language · Computer Science 2012-03-22 Tarek El-shishtawy , Abdulwahab Al-sammak

Knowledge distillation, the technique of transferring knowledge from large, complex models to smaller ones, marks a pivotal step towards efficient AI deployment. Distilling Step-by-Step~(DSS), a novel method utilizing chain-of-thought~(CoT)…

Computation and Language · Computer Science 2024-06-11 Xin Chen , Hanxian Huang , Yanjun Gao , Yi Wang , Jishen Zhao , Ke Ding

The work herein describes a system for automatic news category and keyphrase labeling, presented in the context of our motivation to improve the speed at which a user can find relevant and interesting content within an aggregation platform.…

Information Retrieval · Computer Science 2018-12-11 Pranav A , Nick Sukiennik , Pan Hui

The availability of metadata for scientific documents is pivotal in propelling scientific knowledge forward and for adhering to the FAIR principles (i.e. Findability, Accessibility, Interoperability, and Reusability) of research findings.…

Information Retrieval · Computer Science 2025-01-10 Zeyd Boukhers , Cong Yang

The scientific literature is growing faster than ever. Finding an expert in a particular scientific domain has never been as hard as today because of the increasing amount of publications and because of the ever growing diversity of…

Information Retrieval · Computer Science 2020-04-09 Robin Brochier , Antoine Gourru , Adrien Guille , Julien Velcin