English
Related papers

Related papers: BUbiNG: Massive Crawling for the Masses

200 papers

Browsing is a way of finding documents in a large amount of data which is complementary to querying and which is particularly suitable for multimedia documents. Locating particular documents in a very large collection of multimedia…

Information Retrieval · Computer Science 2009-07-07 Julien Cohen

BCI algorithm development has long been hampered by two major issues: small sample sets and a lack of reproducibility. We offer a solution to both of these problems via a software suite that streamlines both the issues of finding and…

Human-Computer Interaction · Computer Science 2018-09-11 Vinay Jayaram , Alexandre Barachant

GitHub is the most popular social coding platform and widely used by developers and organizations to host their open-source projects around the world. Besides that, the platform has a web API that allow developers collect information from…

Software Engineering · Computer Science 2025-05-27 Hudson Silva Borges , Marco Tulio Valente

With few exceptions, the field of Machine Learning (ML) research has largely ignored the browser as a computational engine. Beyond an educational resource for ML, the browser has vast potential to not only improve the state-of-the-art in ML…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-18 Edward Meeds , Remco Hendriks , Said Al Faraby , Magiel Bruntink , Max Welling

The performance of CBIR algorithms is usually measured on an isolated workstation. In a real-world environment the algorithms would only constitute a minor component among the many interacting components. The Internet dramati-cally changes…

Information Retrieval · Computer Science 2015-06-25 Neil J. Gunther , Giordano B. Beretta

With the increase in size of web, the information is also spreading at large scale. Search Engines are the medium to access this information. Crawler is the module of search engine which is responsible for download the web pages. In order…

Information Retrieval · Computer Science 2016-11-07 Deepika , Ashutosh Dixit

Modern web agents possess computer use abilities that allow them to interact with webpages by sending commands to a virtual keyboard and mouse. While such agents have considerable potential to assist human users with complex tasks,…

Artificial Intelligence · Computer Science 2025-07-25 Yixiao Song , Katherine Thai , Chau Minh Pham , Yapei Chang , Mazin Nadaf , Mohit Iyyer

In this paper we review studies of the growth of the Internet and technologies that are useful for information search and retrieval on the Web. Search engines are retrieve the efficient information. We collected data on the Internet from…

Information Retrieval · Computer Science 2013-10-18 Avinash N Bhute , B. B. Meshram

Petabytes of archival high time resolution observations have been captured with the Murchison Widefield Array. The search for Fast Radio Bursts within these using established software has been limited by its inability to scale on…

Instrumentation and Methods for Astrophysics · Physics 2026-03-05 Cristian Di Pietrantonio , Marcin Sokolowski , Christopher Harris , Daniel Price , Randall Wayth

Phishing is an increasingly sophisticated form of cyberattack that is inflicting huge financial damage to corporations throughout the globe while also jeopardizing individuals' privacy. Attackers are constantly devising new methods of…

Cryptography and Security · Computer Science 2024-03-18 Asif Newaz , Farhan Shahriyar Haq , Nadim Ahmed

The once mythological 51% attack has moved beyond the hypothetical and now poses a legitimate widespread threat to blockchain technology. Current blockchains provide inferior throughput capacity when compared to that of centralized systems,…

Cryptography and Security · Computer Science 2024-12-03 Minjun Kim , Sina Falaki

In recent years, the study of complex networks has received a lot of attention. Real systems have gained importance in scientific publications, despite of an important drawback: the difficulty of retrieving and manage such great quantity of…

Computers and Society · Computer Science 2007-10-29 Massimiliano Zanin

There is a growing need for distributed graph processing systems that are capable of gracefully scaling to very large graph datasets. Unfortunately, this challenge has not been easily met due to the intense memory pressure imposed by…

Databases · Computer Science 2014-07-03 Yingyi Bu , Vinayak Borkar , Jianfeng Jia , Michael J. Carey , Tyson Condie

This work presents a systematic study of navigational tracking, the latest development in the cat-and-mouse game between browsers and online trackers. Navigational tracking allows trackers to 'aggregate users' activities and behaviors…

Cryptography and Security · Computer Science 2022-07-14 Audrey Randall , Peter Snyder , Alisha Ukani , Alex Snoeren , Geoff Voelker , Stefan Savage , Aaron Schulman

Existing techniques for efficiently crawling social media sites rely on URL patterns, query logs, and human supervision. This paper describes SOUrCe, a structure-oriented unsupervised crawler that uses page structures to learn how to crawl…

Information Retrieval · Computer Science 2018-04-10 Keyang Xu , Kyle Yingkai Gao , Jamie Callan

This paper proposes a general system for compute-intensive graph mining tasks that find from a big graph all subgraphs that satisfy certain requirements (e.g., graph matching and community detection). Due to the broad range of applications…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-12 Da Yan , Hongzhi Chen , James Cheng , M. Tamer Özsu , Qizhen Zhang , John C. S. Lui

The migration process between different third-party libraries is hard, complex and error-prone. Typically, during a library migration, developers need to find methods in the new library that are most adequate in replacing the old methods of…

Software Engineering · Computer Science 2019-06-07 Hussein Alrubaye , Mohamed Wiem Mkaouer , Ali Ouni

Nowadays, more and more people use the Web as their primary source of up-to-date information. In this context, fast crawling and indexing of newly created Web pages has become crucial for search engines, especially because user traffic to a…

Information Retrieval · Computer Science 2013-07-25 Damien Lefortier , Liudmila Ostroumova , Egor Samosvat , Pavel Serdyukov

Publicly available information contains valuable information for Cyber Threat Intelligence (CTI). This can be used to prevent attacks that have already taken place on other systems. Ideally, only the initial attack succeeds and all…

Cryptography and Security · Computer Science 2025-03-25 Philipp Kuehn , Mike Schmidt , Markus Bayer , Christian Reuter

The last decade has witnessed many successes of deep learning-based models for industry-scale recommender systems. These models are typically trained offline in a batch manner. While being effective in capturing users' past interactions…