English

Cybersecurity Data Extraction from Common Crawl

Cryptography and Security 2026-02-27 v1 Information Retrieval
Authors: Ashim Mahara
View on arXiv ↗ PDF ↗

Abstract

Alpha-Root is a cybersecurity-focused dataset collected in a single shot from the Common Crawl web graph using community detection. Unlike iterative content-scoring approaches like DeepSeekMath, we mine quality domains directly from the web graph, starting from just 20 trusted seed domains.

Cite

@article{arxiv.2602.22218,
  title  = {Cybersecurity Data Extraction from Common Crawl},
  author = {Ashim Mahara},
  journal= {arXiv preprint arXiv:2602.22218},
  year   = {2026}
}

Related papers

View all related →
Cryptography and Security · Computer Science
ThreatCrawl: A BERT-based Focused Crawler for the Cybersecurity Domain
Philipp Kuehn, Mike Schmidt, Markus Bayer, Christian Reuter
2025-03-25
Information Retrieval · Computer Science
THREAT/crawl: a Trainable, Highly-Reusable, and Extensible Automated Method and Tool to Crawl Criminal Underground Forums
Michele Campobasso, Luca Allodi
2022-12-08
Cryptography and Security · Computer Science
CARONTE: Crawling Adversarial Resources Over Non-Trusted, High-Profile Environments
Michele Campobasso, Pavlo Burda, Luca Allodi
2020-09-18
Social and Information Networks · Computer Science
Detecting cyber threats through social network analysis: short survey
Lyudmyla Kirichenko, Tamara Radivilova, Anders Carlsson
2018-05-18
Information Retrieval · Computer Science
Using Google Analytics to Support Cybersecurity Forensics
Han Qin, Kit Riehle, Haozhen Zhao
2019-04-04
Networking and Internet Architecture · Computer Science
Improved methodology for longitudinal Web analytics using Common Crawl
Henry S. Thompson
2024-04-16
Cryptography and Security · Computer Science
CGraph: Graph Based Extensible Predictive Domain Threat Intelligence Platform
Wathsara Daluwatta, Ravindu De Silva, Sanduni Kariyawasam, Mohamed Nabeel +3
2022-02-17
Cryptography and Security · Computer Science
Cybersecurity Threat Hunting and Vulnerability Analysis Using a Neo4j Graph Database of Open Source Intelligence
Elijah Pelofske, Lorie M. Liebrock, Vincent Urias
2024-10-10
Cryptography and Security · Computer Science
Leveraging Sharing Communities to Achieve Federated Learning for Cybersecurity
Frank W. Bentrem, Michael A. Corsello, Joshua J. Palm
2021-04-29
Cryptography and Security · Computer Science
A Crawler Architecture for Harvesting the Clear, Social, and Dark Web for IoT-Related Cyber-Threat Intelligence
Paris Koloveas, Thanasis Chantzios, Christos Tryfonopoulos, Spiros Skiadopoulos
2021-09-16
Computer Vision and Pattern Recognition · Computer Science
AlphaRotate: A Rotation Detection Benchmark using TensorFlow
Xue Yang, Yue Zhou, Junchi Yan
2021-11-15
Cryptography and Security · Computer Science
Insider Threat Detection Through Attributed Graph Clustering
Anagi Gamachchi, Serdar Boztas
2018-09-10
Databases · Computer Science
A Selectivity based approach to Continuous Pattern Detection in Streaming Graphs
Sutanay Choudhury, Lawrence Holder, George Chin, Khushbu Agarwal +1
2015-03-04
Information Retrieval · Computer Science
Combining Language and Graph Models for Semi-structured Information Extraction on the Web
Zhi Hong, Kyle Chard, Ian Foster
2024-02-23
Computation and Language · Computer Science
CC-GPX: Extracting High-Quality Annotated Geospatial Data from Common Crawl
Ilya Ilyankou, Meihui Wang, Stefano Cavazzi, James Haworth
2026-05-07
Information Retrieval · Computer Science
Exploratory Analysis of a Terabyte Scale Web Corpus
Vasilis Kolias, Ioannis Anagnostopoulos, Eleftherios Kayafas
2014-09-30
Computation and Language · Computer Science
Extracting Parallel Paragraphs from Common Crawl
Jakub Kúdela, Irena Holubová, Ondřej Bojar
2018-04-30
Cryptography and Security · Computer Science
CRATOR: a Dark Web Crawler
Daniel De Pascale, Giuseppe Cascavilla, Damian A. Tamburri, Willem-Jan Van Den Heuvel
2024-05-13
Cryptography and Security · Computer Science
Graph Mining for Cybersecurity: A Survey
Bo Yan, Cheng Yang, Chuan Shi, Yong Fang +3
2024-02-20
Cryptography and Security · Computer Science
Dynamic Graph-based Fingerprinting of In-browser Cryptomining
Tanapoom Sermchaiwong, Jiasi Shen
2025-05-06
Machine Learning · Computer Science
Cyberthreat Detection from Twitter using Deep Neural Networks
Nuno Dionísio, Fernando Alves, Pedro M. Ferreira, Alysson Bessani
2019-04-03
Cryptography and Security · Computer Science
A Review of Topological Data Analysis for Cybersecurity
Thomas Davies
2022-02-17
Social and Information Networks · Computer Science
Crawling political communities in Twitter and extracting political affiliations
Muhammad Umer Gurchani
2021-02-02
Cryptography and Security · Computer Science
DeepHunter: A Graph Neural Network Based Approach for Robust Cyber Threat Hunting
Renzheng Wei, Lijun Cai, Aimin Yu, Dan Meng
2021-04-21
Cryptography and Security · Computer Science
LookAhead: Augmenting Crowdsourced Website Reputation Systems With Predictive Modeling
Sourav Bhattacharya, Otto Huhta, N. Asokan
2015-04-21
R2 v1 2026-07-01T10:52:37.060Z