English
Related papers

Related papers: Change Rate Estimation and Optimal Freshness in We…

200 papers

In this note, we first recall the nonconvex problem setting and introduce the optimal PAGE algorithm (Li et al., ICML'21). Then we provide a simple and clean convergence analysis of PAGE for achieving optimal convergence rates. Moreover,…

Optimization and Control · Mathematics 2021-06-18 Zhize Li

Web archives preserve portions of the web, but quantifying their completeness remains challenging. Prior approaches have estimated the coverage of a crawl by either comparing the outcomes of multiple crawlers, or by comparing the results of…

Physics and Society · Physics 2026-04-07 Michael Paris , Grigori Paris , Fabian Baumann

Nowadays, the huge amount of information distributed through the Web motivates studying techniques to be adopted in order to extract relevant data in an efficient and reliable way. Both academia and enterprises developed several approaches…

Artificial Intelligence · Computer Science 2013-06-06 Emilio Ferrara , Robert Baumgartner

Mobile edge caching enables content delivery within the radio access network, which effectively alleviates the backhaul burden and reduces response time. To fully exploit edge storage resources, the most popular contents should be…

Networking and Internet Architecture · Computer Science 2018-09-05 Peng Yang , Ning Zhang , Shan Zhang , Li Yu , Junshan Zhang , Xuemin Shen

Several real-time delay-sensitive applications pose varying degrees of freshness demands on the requested content. The performance of cache replacement policies that are agnostic to these demands is likely to be sub-optimal. Motivated by…

Networking and Internet Architecture · Computer Science 2018-01-01 Pawan Poojary , Sharayu Moharir , Krishna Jagannathan

The growth of world-wide-web (WWW) spreads its wings from an intangible quantities of web-pages to a gigantic hub of web information which gradually increases the complexity of crawling process in a search engine. A search engine handles a…

Information Retrieval · Computer Science 2012-08-14 Sudarshan Nandy , Partha Pratim Sarkar , Achintya Das

In this paper, we investigate a cache updating system with a server containing $N$ files, $K$ relays and $M$ users. The server keeps the freshest versions of the files which are updated with fixed rates. Each relay can download the fresh…

Information Theory · Computer Science 2020-12-29 Haibin Xie , Minquan Cheng , Yongbing Zhang

World Wide Web consists of more than 50 billion pages online. It is highly dynamic i.e. the web continuously introduces new capabilities and attracts many people. Due to this explosion in size, the effective information retrieval system or…

Information Retrieval · Computer Science 2012-05-15 Sk. AbdulNabi , P. Premchand

We consider a system consisting of a server, which receives updates for $N$ files according to independent Poisson processes. The goal of the server is to deliver the latest version of the files to the user through a parallel network of $K$…

Information Theory · Computer Science 2021-05-12 Priyanka Kaswan , Melih Bastopcu , Sennur Ulukus

The internet contains large amounts of low-quality content, yet users expect web search engines to deliver high-quality, relevant results. The abundant presence of low-quality pages can negatively impact retrieval and crawling processes by…

Information Retrieval · Computer Science 2025-04-16 Francesca Pezzuti , Ariane Mueller , Sean MacAvaney , Nicola Tonellotto

The growth of world-wide-web (WWW) spreads its wings from an intangible quantities of web-pages to a gigantic hub of web information which gradually increases the complexity of crawling process in a search engine. A search engine handles a…

Machine Learning · Computer Science 2012-08-15 Sudarshan Nandy , Partha Pratim Sarkar , Achintya Das

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

{\em Personalized PageRank (PPR)} stands as a fundamental proximity measure in graph mining. Since computing an exact SSPPR query answer is prohibitive, most existing solutions turn to approximate queries with guarantees. The…

Databases · Computer Science 2022-12-27 Guanhao Hou , Qintian Guo , Fangyuan Zhang , Sibo Wang , Zhewei Wei

We study the problem of conformal prediction in a novel online framework that directly optimizes efficiency. In our problem, we are given a target miscoverage rate $\alpha > 0$, and a time horizon $T$. On each day $t \le T$ an algorithm…

Machine Learning · Computer Science 2025-10-23 Vaidehi Srinivas

This paper studies an online service caching problem, where an edge server, equipped with a prediction window of future service request arrivals, needs to decide which services to host locally subject to limited storage capacity. The edge…

Networking and Internet Architecture · Computer Science 2023-01-11 Siqi Fan , I-Hong Hou , Van Sy Mai

Caching is a technique to reduce peak traffic rates by prefetching popular content into memories at the end users. Conventionally, these memories are used to deliver requested content in part from a locally cached copy rather than through…

Information Theory · Computer Science 2014-05-06 Mohammad Ali Maddah-Ali , Urs Niesen

We consider a task of scheduling a crawler to retrieve content from several sites with ephemeral content. A user typically loses interest in ephemeral content, like news or posts at social network groups, after several days or hours. Thus,…

Information Retrieval · Computer Science 2015-03-31 Konstantin Avrachenkov , Vivek Borkar

Graphs are found in a plethora of domains, including online social networks, the World Wide Web and the study of epidemics, to name a few. With the advent of greater volumes of information and the need for continuously updated results under…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-19 Miguel E. Coimbra , Sérgio Esteves , Alexandre P. Francisco , Luís Veiga

This paper considers the problem of refreshing a dataset. More precisely , given a collection of nodes gathered at some time (Web pages, users from an online social network) along with some structure (hyperlinks, social relationships), we…

Social and Information Networks · Computer Science 2016-01-07 The Dang Huynh , Fabien Mathieu , Laurent Viennot

The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for…

Networking and Internet Architecture · Computer Science 2022-09-28 Naram Mhaisen , George Iosifidis , Douglas Leith