English
Related papers

Related papers: Comparative analysis of various web crawler algori…

200 papers

Web crawling is the problem of keeping a cache of webpages fresh, i.e., having the most recent copy available when a page is requested. This problem is usually coupled with the natural restriction that the bandwidth available to the web…

Machine Learning · Computer Science 2019-11-26 Utkarsh Upadhyay , Robert Busa-Fekete , Wojciech Kotlowski , David Pal , Balazs Szorenyi

For providing quick and accurate results, a search engine maintains a local snapshot of the entire web. And, to keep this local cache fresh, it employs a crawler for tracking changes across various web pages. However, finite bandwidth…

Information Retrieval · Computer Science 2020-04-07 Konstantin Avrachenkov , Kishor Patil , Gugan Thoppe

Web page categorization is one of the challenging tasks in the world of ever increasing web technologies. There are many ways of categorization of web pages based on different approach and features. This paper proposes a new dimension in…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman

The existing search engines sometimes give unsatisfactory search result for lack of any categorization of search result. If there is some means to know the preference of user about the search result and rank pages according to that…

Information Retrieval · Computer Science 2011-02-04 Debajyoti Mukhopadhyay , Pradipta Biswas , Young-Chon Kim

In recent years, the study of complex networks has received a lot of attention. Real systems have gained importance in scientific publications, despite of an important drawback: the difficulty of retrieving and manage such great quantity of…

Computers and Society · Computer Science 2007-10-29 Massimiliano Zanin

Tables are a powerful and popular tool for organizing and manipulating data. A vast number of tables can be found on the Web, which represents a valuable knowledge resource. The objective of this survey is to synthesize and present two…

Information Retrieval · Computer Science 2020-02-06 Shuo Zhang , Krisztian Balog

Social networks have ensured the expanding disproportion between the face of WWW stored traditionally in search engine repositories and the actual ever changing face of Web. Exponential growth of web users and the ease with which they can…

Social and Information Networks · Computer Science 2012-04-09 Pushpa R. Suri , Harmunish Taneja

Nowadays, more and more people use the Web as their primary source of up-to-date information. In this context, fast crawling and indexing of newly created Web pages has become crucial for search engines, especially because user traffic to a…

Information Retrieval · Computer Science 2013-07-25 Damien Lefortier , Liudmila Ostroumova , Egor Samosvat , Pavel Serdyukov

The last decade has seen a revolution in the theory and application of machine learning and pattern recognition. Through these advancements, variable ranking has emerged as an active and growing research area and it is now beginning to be…

Computer Vision and Pattern Recognition · Computer Science 2017-06-20 Giorgio Roffo

In this world, globalization has become a basic and most popular human trend. To globalize information, people are going to publish the documents in the internet. As a result, information volume of internet has become huge. To handle that…

Information Retrieval · Computer Science 2013-11-26 Sukanta Sinha , Rana Dattagupta , Debajyoti Mukhopadhyay

We argue that relationships between Web pages are functions of the user's intent. We identify a class of Web tasks - information-gathering - that can be facilitated by a search engine that provides links to pages which are related to the…

Information Retrieval · Computer Science 2010-05-20 Amitabha Bagchi , Garima Lahoti

This paper presents an approach to identify efficient techniques used in Web Search Engine Optimization (SEO). Understanding SEO factors which can influence page ranking in search engine is significant for webmasters who wish to attract…

Information Retrieval · Computer Science 2015-09-29 Jai Manral , Mohammed Alamgir Hossain

This essay provides a comprehensive analysis of the optimization and performance evaluation of various routing algorithms within the context of computer networks. Routing algorithms are critical for determining the most efficient path for…

Networking and Internet Architecture · Computer Science 2024-02-27 Xunchi Ma

Search engines are nowadays one of the most important entry points for Internet users and a central tool to solve most of their information needs. Still, there exist a substantial amount of users' searches which obtain unsatisfactory…

Information Retrieval · Computer Science 2009-11-23 Daniel Gayo-Avello , David J. Brenes

The two significant tasks of a focused Web crawler are finding relevant topic-specific documents on the Web and analytically prioritizing them for later effective and reliable download. For the first task, we propose a sophisticated custom…

Information Retrieval · Computer Science 2015-10-02 Ali Seyfi

The PageRank algorithm employed at Google assigns a measure of importance to each web page for rankings in search results. In our recent papers, we have proposed a distributed randomized approach for this algorithm, where web pages are…

Systems and Control · Computer Science 2016-11-15 Hideaki Ishii , Roberto Tempo , Er-Wei Bai

The clear, social, and dark web have lately been identified as rich sources of valuable cyber-security information that -given the appropriate tools and methods-may be identified, crawled and subsequently leveraged to actionable…

Cryptography and Security · Computer Science 2021-09-16 Paris Koloveas , Thanasis Chantzios , Christos Tryfonopoulos , Spiros Skiadopoulos

Traditional methods for crawling and parsing web applications predominantly rely on extracting hyperlinks from initial pages and recursively following linked resources. This approach constructs a graph where nodes represent unstructured…

Information Retrieval · Computer Science 2024-10-24 Yogesh Chandrasekharuni

PageRank is arguably the most popular ranking algorithm which is being applied in real systems ranging from information to biological and infrastructure networks. Despite its outstanding popularity and broad use in different areas of…

Physics and Society · Physics 2015-12-09 Manuel Sebastian Mariani , Matus Medo , Yi-Cheng Zhang

Complex networks are formal frameworks capturing the interdependencies between the elements of large systems and databases. This formalism allows to use network navigation methods to rank the importance that each constituent has on the…

Quantum Physics · Physics 2012-09-07 Eduardo Sánchez-Burillo , Jordi Duch , Jesús Gómez-Gardenes , David Zueco