English
Related papers

Related papers: URL ordering policies for distributed crawlers: a …

200 papers

Online learning to rank is a sequential decision-making problem where in each round the learning agent chooses a list of items and receives feedback in the form of clicks from the user. Many sample-efficient algorithms have been proposed…

Machine Learning · Statistics 2019-03-20 Tor Lattimore , Branislav Kveton , Shuai Li , Csaba Szepesvari

Nowadays, the huge amount of information distributed through the Web motivates studying techniques to be adopted in order to extract relevant data in an efficient and reliable way. Both academia and enterprises developed several approaches…

Artificial Intelligence · Computer Science 2013-06-06 Emilio Ferrara , Robert Baumgartner

Many online shops offer functionality that help their customers navigate the available alternatives. For instance, options to filter and to sort goods are wide-spread. In this paper we show that sorting and filtering can be used by rational…

Theoretical Economics · Economics 2021-09-10 Paulo Oliva , Philipp Zahn

A significant part of human activity today consists of searching for a piece of information online, utilizing knowledge repositories. This endeavor may be time-consuming if the individual searching for the information is unfamiliar with the…

Information Retrieval · Computer Science 2021-08-31 Rohit Negi

Event collections are frequently built by crawling the live web on the basis of seed URIs nominated by human experts. Focused web crawling is a technique where the crawler is guided by reference content pertaining to the event. Given the…

Digital Libraries · Computer Science 2018-04-06 Martin Klein , Lyudmila Balakireva , Herbert Van de Sompel

We analyze different strategies aimed at optimizing routing policies in the Internet. We first show that for a simple deterministic algorithm the local properties of the network deeply influence the time needed for packet delivery between…

Other Condensed Matter · Physics 2007-12-19 Pablo Echenique , Jesus Gomez-Gardenes , Yamir Moreno

Web archives preserve portions of the web, but quantifying their completeness remains challenging. Prior approaches have estimated the coverage of a crawl by either comparing the outcomes of multiple crawlers, or by comparing the results of…

Physics and Society · Physics 2026-04-07 Michael Paris , Grigori Paris , Fabian Baumann

Email Retrieval task has recently taken much attention to help the user retrieve the email(s) related to the submitted query. Up to our knowledge, existing email retrieval ranking approaches sort the retrieved emails based on some heuristic…

Information Retrieval · Computer Science 2010-11-02 Samir AbdelRahman , Basma Hassan , Reem Bahgat

Geographic location search engines allow users to constrain and order search results in an intuitive manner by focusing a query on a particular geographic region. Geographic search technology, also called location search, has recently…

Information Retrieval · Computer Science 2010-05-07 M. Umamaheswari , S. Sivasubramanian

Decentralized search aims to find the target node in a large network by using only local information. The applications of it include peer-to-peer file sharing, web search and anything else that requires locating a specific target in a…

Performance · Computer Science 2007-05-23 Shi Xiao , Gaoxi Xiao

Higher-order networks are efficient representations of sequential data. Unlike the classic first-order network approach, they capture indirect dependencies between items composing the input sequences by the use of \textit{memory-nodes}. We…

Physics and Society · Physics 2021-09-08 Célestin Coquidé , Julie Queiros , François Queyroi

The increasing adoption of econometric and machine-learning approaches by empirical researchers has led to a widespread use of one data collection method: web scraping. Web scraping refers to the use of automated computer programs to access…

General Economics · Economics 2023-08-07 Jens Foerderer

Email Retrieval task has recently taken much attention to help the user retrieve the email(s) related to the submitted query. Up to our knowledge, existing email retrieval ranking approaches sort the retrieved emails based on some heuristic…

Information Retrieval · Computer Science 2010-11-03 Samir AbdelRahman , Basma Hassan , Reem Bahgat

Many known planning tasks have inherent constraints concerning the best order in which to achieve the goals. A number of research efforts have been made to detect such constraints and to use them for guiding search, in the hope of speeding…

Artificial Intelligence · Computer Science 2011-07-04 J. Hoffmann , J. Porteous , L. Sebastia

In temporal ordered clustering, given a single snapshot of a dynamic network in which nodes arrive at distinct time instants, we aim at partitioning its nodes into $K$ ordered clusters $\mathcal{C}_1 \prec \cdots \prec \mathcal{C}_K$ such…

Social and Information Networks · Computer Science 2020-08-10 Krzysztof Turowski , Jithin K. Sreedharan , Wojciech Szpankowski

The PageRank algorithm employed by Google quantifies the importance of each page by the link structure of the web. To reduce the computational burden the distributed randomized PageRank algorithms (DRPA) recently appeared in literature…

Systems and Control · Computer Science 2013-05-15 Wenxiao Zhao , Han-Fu Chen , Hai-Tao Fang

Web spam refers to some techniques, which try to manipulate search engine ranking algorithms in order to raise web page position in search engine results. In the best case, spammers encourage viewers to visit their sites, and provide…

Information Retrieval · Computer Science 2012-10-12 Shekoofeh Ghiam , Alireza Nemaney Pour

The area of online machine learning in big data streams covers algorithms that are (1) distributed and (2) work from data streams with only a limited possibility to store past data. The first requirement mostly concerns software…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-02-19 András A. Benczúr , Levente Kocsis , Róbert Pálovics

Finding efficient algorithms to explore large networks with the aim of recovering information about their structure is an open problem. Here, we investigate this challenge by proposing a model in which random walkers with previously…

Adaptation and Self-Organizing Systems · Physics 2015-06-04 Luce Prignano , Yamir Moreno , Albert Diaz-Guilera

Basically information means selection within a domain (value or definition set) of possibilities. For objectifiable, comparable and precise information the domain should be the same for all. Therefore the global (online) definition of the…

Information Retrieval · Computer Science 2016-03-04 Wolfgang Orthuber