English
Related papers

Related papers: ThreatCrawl: A BERT-based Focused Crawler for the …

200 papers

Recent years have witnessed a substantial increase in the use of deep learning to solve various natural language processing (NLP) problems. Early deep learning models were constrained by their sequential or unidirectional nature, such that…

Information Retrieval · Computer Science 2024-03-05 Jiajia Wang , Jimmy X. Huang , Xinhui Tu , Junmei Wang , Angela J. Huang , Md Tahmid Rahman Laskar , Amran Bhuiyan

A focused crawler aims at discovering as many web pages and web sites relevant to a target topic as possible, while avoiding irrelevant ones. Reinforcement Learning (RL) has been a promising direction for optimizing focused crawling,…

Information Retrieval · Computer Science 2025-05-20 Andreas Kontogiannis , Dimitrios Kelesis , Vasilis Pollatos , George Giannakopoulos , Georgios Paliouras

The two significant tasks of a focused Web crawler are finding relevant topic-specific documents on the Web and analytically prioritizing them for later effective and reliable download. For the first task, we propose a sophisticated custom…

Information Retrieval · Computer Science 2015-10-02 Ali Seyfi

Analyzing Open Source Intelligence (OSINT) from large volumes of data is critical for drafting and publishing comprehensive CTI reports. This process usually follows a three-stage workflow -- triage, deep search and TI drafting. While Large…

Cryptography and Security · Computer Science 2026-03-11 Xiangsen Chen , Xuan Feng , Shuo Chen , Matthieu Maitre , Sudipto Rakshit , Diana Duvieilh , Ashley Picone , Nan Tang

In response to the escalating cyber threats, the efficiency of Cyber Threat Intelligence (CTI) data collection has become paramount in ensuring robust cybersecurity. However, existing works encounter significant challenges in preprocessing…

Cryptography and Security · Computer Science 2025-06-05 Jamal H. Al-Yasiri , Mohamad Fadli Bin Zolkipli , Nik Fatinah N Mohd Farid , Mohammed Alsamman , Zainab Ali Mohammed

Cybersecurity researchers have contributed to the automated extraction of CTI from textual sources, such as threat reports and online articles, where cyberattack strategies, procedures, and tools are described. The goal of this article is…

Cryptography and Security · Computer Science 2024-01-04 Md Rayhanur Rahman , Rezvan Mahdavi-Hezaveh , Laurie Williams

Threat detection in Natural Language Processing lacks consistent definitions and standardized benchmarks, and is often conflated with broader phenomena such as toxicity, hate speech, or offensive language. In this work, we introduce…

Computation and Language · Computer Science 2026-05-12 Davide Bruni , Carlo Bardazzi , Maurizio Tesconi

Crawling parallel texts -- texts that are mutual translations -- from the Internet is usually done following a brute-force approach: documents are massively downloaded in an unguided process, and only a fraction of them end up leading to…

Computation and Language · Computer Science 2026-04-22 Cristian García-Romero , Miquel Esplà-Gomis , Felipe Sánchez-Martínez

Cyber threat intelligence (CTI) is being used to search for indicators of attacks that might have compromised an enterprise network for a long time without being discovered. To have a more effective analysis, CTI open standards have…

Cryptography and Security · Computer Science 2019-10-02 Sadegh M. Milajerdi , Birhanu Eshete , Rigel Gjomemo , V. N. Venkatakrishnan

Natural Language Processing (NLP) has recently gained wide attention in cybersecurity, particularly in Cyber Threat Intelligence (CTI) and cyber automation. Increased connection and automation have revolutionized the world's economic and…

Computation and Language · Computer Science 2022-10-24 Ehsan Aghaei , Xi Niu , Waseem Shadid , Ehab Al-Shaer

Cyber Threat Intelligence (CTI) is information describing threat vectors, vulnerabilities, and attacks and is often used as training data for AI-based cyber defense systems such as Cybersecurity Knowledge Graphs (CKG). There is a strong…

Computation and Language · Computer Science 2022-08-04 Casey Hanks , Michael Maiden , Priyanka Ranade , Tim Finin , Anupam Joshi

Indexing the Web is becoming a laborious task for search engines as the Web exponentially grows in size and distribution. Presently, the most effective known approach to overcome this problem is the use of focused crawlers. A focused…

Information Retrieval · Computer Science 2015-10-02 Ali Seyfi

Open-source cyber threat intelligence (OSCTI) has become essential for keeping up with the rapidly changing threat landscape. However, current OSCTI gathering and management solutions mainly focus on structured Indicators of Compromise…

Cryptography and Security · Computer Science 2024-11-01 Peng Gao , Xiaoyuan Liu , Edward Choi , Sibo Ma , Xinyu Yang , Dawn Song

To address the increasing complexity and frequency of cybersecurity incidents emphasized by the recent cybersecurity threat reports with over 10 billion instances, cyber threat intelligence (CTI) plays a critical role in the modern…

Cryptography and Security · Computer Science 2024-06-04 Hangyuan Ji , Jian Yang , Linzheng Chai , Chaoren Wei , Liqun Yang , Yunlong Duan , Yunli Wang , Tianzhen Sun , Hongcheng Guo , Tongliang Li , Changyu Ren , Zhoujun Li

Cyber Threat Intelligence (CTI) has emerged as a vital complementary approach that operates in the early phases of the cyber threat lifecycle. CTI involves collecting, processing, and analyzing threat data to provide a more accurate and…

Cryptography and Security · Computer Science 2026-05-25 Samaneh Shafee , Alysson Bessani , Pedro M. Ferreira

The automation of Cyber Threat Intelligence (CTI) relies heavily on Named Entity Recognition (NER) to extract critical entities from unstructured text. Currently, Large Language Models (LLMs) primarily address this task through…

Cryptography and Security · Computer Science 2025-12-23 Jiaren Peng , Hongda Sun , Xuan Tian , Cheng Huang , Zeqing Li , Rui Yan

Cyber Threat Intelligence (CTI) is the knowledge of cyber and physical threats that help mitigate potential cyber attacks. The rapid evolution of the current threat landscape has seen many organisations share CTI to strengthen their…

Cryptography and Security · Computer Science 2022-08-26 Kealan Dunnett , Shantanu Pal , Guntur Dharma Putra , Zahra Jadidi , Raja Jurdak

The swift spread of fake news and disinformation campaigns poses a significant threat to public trust, political stability, and cybersecurity. Traditional Cyber Threat Intelligence (CTI) approaches, which rely on low-level indicators such…

Cryptography and Security · Computer Science 2025-10-20 Domenico Cotroneo , Roberto Natella , Vittorio Orbinato

Collections of Web documents about specific topics are needed for many areas of current research. Focused crawling enables the creation of such collections on demand. Current focused crawlers require the user to manually specify starting…

Digital Libraries · Computer Science 2016-12-20 Gerhard Gossen , Elena Demidova , Thomas Risse

In the ever-evolving landscape of cybersecurity, the rapid identification and mitigation of Advanced Persistent Threats (APTs) is crucial. Security practitioners rely on detailed threat reports to understand the tactics, techniques, and…

Cryptography and Security · Computer Science 2025-07-11 Faissal Ahmadou , Sepehr Ghaffarzadegan , Boubakr Nour , Makan Pourzandi , Mourad Debbabi , Chadi Assi