English
Related papers

Related papers: SEBERTNets: Sequence Enhanced BERT Networks for Ev…

200 papers

Temporal sequences have become pervasive in various real-world applications. Consequently, the volume of data generated in the form of continuous time-event sequence(s) or CTES(s) has increased exponentially in the past few years. Thus, a…

Machine Learning · Computer Science 2023-07-20 Vinayak Gupta , Srikanta Bedathur , Abir De

It is reported that financial news, especially financial events expressed in news, provide information to investors' long/short decisions and influence the movements of stock markets. Motivated by this, we leverage financial event streams…

Statistical Finance · Quantitative Finance 2020-10-30 Xianchao Wu

Both performance and efficiency are crucial factors for sequence labeling tasks in many real-world scenarios. Although the pre-trained models (PTMs) have significantly improved the performance of various sequence labeling tasks, their…

Computation and Language · Computer Science 2021-06-15 Xiaonan Li , Yunfan Shao , Tianxiang Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

Named Entity Recognition (NER) is a critical task in natural language processing, yet it remains particularly challenging for discontinuous entities. The primary difficulty lies in text segmentation, as traditional methods often missegment…

Computation and Language · Computer Science 2026-01-01 Wen-Fang Su , Hsiao-Wei Chou , Wen-Yang Lin

In this work, we propose a two-stage method for named entity recognition (NER), especially for nested NER. We borrowed the idea from the two-stage Object Detection in computer vision and the way how they construct the loss function. First,…

Computation and Language · Computer Science 2021-01-28 Bing Li

We present KPI-BERT, a system which employs novel methods of named entity recognition (NER) and relation extraction (RE) to extract and link key performance indicators (KPIs), e.g. "revenue" or "interest expenses", of companies from…

Computation and Language · Computer Science 2022-08-04 Lars Hillebrand , Tobias Deußer , Tim Dilmaghani , Bernd Kliem , Rüdiger Loitz , Christian Bauckhage , Rafet Sifa

Entity linking, the task of mapping textual mentions to known entities, has recently been tackled using contextualized neural networks. We address the question whether these results -- reported for large, high-quality datasets such as…

Computation and Language · Computer Science 2020-05-20 Nadja Kurz , Felix Hamann , Adrian Ulges

Event extraction in commodity news is a less researched area as compared to generic event extraction. However, accurate event extraction from commodity news is useful in abroad range of applications such as under-standing event chains and…

Computation and Language · Computer Science 2021-09-28 Meisin Lee , Lay-Ki Soon , Eu-Gene Siew

In this paper, we propose a new strategy for the task of named entity recognition (NER). We cast the task as a query-based machine reading comprehension task: e.g., the task of extracting entities with PER is formalized as answering the…

Computation and Language · Computer Science 2019-11-05 Yuxian Meng , Xiaoya Li , Zijun Sun , Jiwei Li

There has been a growing academic interest in the recognition of nested named entities in many domains. We tackle the task with a novel local hypergraph-based method: We first propose start token candidates and generate corresponding…

Computation and Language · Computer Science 2022-05-24 Yukun Yan , Sen Song

Named entity recognition (NER) is highly sensitive to sentential syntactic and semantic properties where entities may be extracted according to how they are used and placed in the running text. To model such properties, one could rely on…

Computation and Language · Computer Science 2020-10-30 Yuyang Nie , Yuanhe Tian , Yan Song , Xiang Ao , Xiang Wan

We introduce SetBERT, a fine-tuned BERT-based model designed to enhance query embeddings for set operations and Boolean logic queries, such as Intersection (AND), Difference (NOT), and Union (OR). SetBERT significantly improves retrieval…

Computation and Language · Computer Science 2024-06-27 Quan Mai , Susan Gauch , Douglas Adams

This paper describes our systems for the sub-task I in the Software Mention Detection in Scholarly Publications shared-task. We propose three approaches leveraging different pre-trained language models (BERT, SciBERT, and XLM-R) to tackle…

Software Engineering · Computer Science 2024-05-06 Thuy Nguyen Thi , Anh Nguyen Viet , Thin Dang Van , Ngan Nguyen Luu Thuy

Event coreference continues to be a challenging problem in information extraction. With the absence of any external knowledge bases for events, coreference becomes a clustering task that relies on effective representations of the context in…

Computation and Language · Computer Science 2024-04-09 Shafiuddin Rehan Ahmed , James H. Martin

In the last two decades, automatic extractive text summarization on lectures has demonstrated to be a useful tool for collecting key phrases and sentences that best represent the content. However, many current approaches utilize dated…

Computation and Language · Computer Science 2019-06-12 Derek Miller

Unsupervised learning of low-dimensional, semantic representations of words and entities has recently gained attention. In this paper we describe the Semantic Entity Retrieval Toolkit (SERT) that provides implementations of our previously…

Computation and Language · Computer Science 2017-07-18 Christophe Van Gysel , Maarten de Rijke , Evangelos Kanoulas

Pre-trained transformer models are the current state-of-the-art for natural language models processing. seBERT is such a model, that was developed based on the BERT architecture, but trained from scratch with software engineering data. We…

Software Engineering · Computer Science 2022-05-04 Alexander Trautsch , Steffen Herbold

Motivated by the promising performance of pre-trained language models, we investigate BERT in an evidence retrieval and claim verification pipeline for the FEVER fact extraction and verification challenge. To this end, we propose to use two…

Computation and Language · Computer Science 2019-10-08 Amir Soleimani , Christof Monz , Marcel Worring

Event-based semantic segmentation has great potential in autonomous driving and robotics due to the advantages of event cameras, such as high dynamic range, low latency, and low power cost. Unfortunately, current artificial neural network…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Xianlei Long , Xiaxin Zhu , Fangming Guo , Wanyi Zhang , Qingyi Gu , Chao Chen , Fuqiang Gu

Financial dialogue transcripts pose a unique challenge for sentence-level information extraction due to their informal structure, domain-specific vocabulary, and variable intent density. We introduce Fin-ExBERT, a lightweight and modular…

Computation and Language · Computer Science 2025-09-30 Soumick Sarker , Abhijit Kumar Rai