English
Related papers

Related papers: Learning to Crawl

200 papers

The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for…

Networking and Internet Architecture · Computer Science 2022-09-28 Naram Mhaisen , George Iosifidis , Douglas Leith

The vastness of the web imposes a prohibitive cost on building large-scale search engines with limited resources. Crawl frontiers thus need to be optimized to improve the coverage and freshness of crawled content. In this paper, we propose…

We study the well-known coded caching problem in an online learning framework, wherein requests arrive sequentially, and an online policy can update the cache contents based on the history of requests seen thus far. We introduce a caching…

Information Theory · Computer Science 2024-09-20 Anupam Nayak , Kota Srinivas Reddy , Nikhil Karamchandani

The design of effective online caching policies is an increasingly important problem for content distribution networks, online social networks and edge computing services, among other areas. This paper proposes a new algorithmic toolbox for…

Networking and Internet Architecture · Computer Science 2022-10-21 Naram Mhaisen , George Iosifidis , Douglas Leith

Most classification methods are based on the assumption that data conforms to a stationary distribution. The machine learning domain currently suffers from a lack of classification techniques that are able to detect the occurrence of a…

Machine Learning · Statistics 2012-01-05 Alzennyr Da Silva , Yves Lechevallier , Fabrice Rossi , Francisco De A. T. De Carvahlo

With the ever proliferating size and scale of the WWW [1] efficient ways of exploring content are of increasing importance. How can we efficiently retrieve information from it through crawling? And in this era of tera and multi-core…

Information Retrieval · Computer Science 2014-06-24 Sonali Gupta , Komal kumar Bhatia , Pikakshi Manchanda

We revisit the online dynamic acknowledgment problem. In the problem, a sequence of requests arrive over time to be acknowledged, and all outstanding requests can be satisfied simultaneously by one acknowledgement. The goal of the problem…

Data Structures and Algorithms · Computer Science 2023-05-30 Sungjin Im , Benjamin Moseley , Chenyang Xu , Ruilong Zhang

This paper studies a problem of jointly optimizing two important operations in mobile edge computing without knowing future requests, namely service caching, which determines which services to be hosted at the edge, and service routing,…

Networking and Internet Architecture · Computer Science 2022-02-01 Siqi Fan , I-Hong Hou , Van Sy Mai , Lotfi Benmohamed

We consider online learning problems under a partial observability model capturing situations where the information conveyed to the learner is between full information and bandit feedback. In the simplest variant, we assume that in addition…

Machine Learning · Computer Science 2026-04-28 Tomas Kocak , Gergely Neu , Michal Valko , Remi Munos

The problem of online checkpointing is a classical problem with numerous applications which had been studied in various forms for almost 50 years. In the simplest version of this problem, a user has to maintain $k$ memorized checkpoints…

Cryptography and Security · Computer Science 2019-06-20 Achiya Bar-On , Itai Dinur , Orr Dunkelman , Rani Hod , Nathan Keller , Eyal Ronen , Adi Shamir

Continual learning is the problem of learning and retaining knowledge through time over multiple tasks and environments. Research has primarily focused on the incremental classification setting, where new tasks/classes are added at discrete…

Machine Learning · Computer Science 2021-09-23 Zhipeng Cai , Ozan Sener , Vladlen Koltun

We address the problem of learning-augmented online caching in the scenario when each request is accompanied by a prediction of the next occurrence of the requested page. We improve currently known bounds on the competitive ratio of the…

Databases · Computer Science 2025-07-29 Daniel Skachkov , Denis Ponomaryov , Yuri Dorn , Alexander Demin

Studies of networked phenomena, such as interactions in online social media, often rely on incomplete data, either because these phenomena are partially observed, or because the data is too large or expensive to acquire all at once.…

Machine Learning · Computer Science 2020-01-22 Timothy LaRock , Timothy Sakharov , Sahely Bhadra , Tina Eliassi-Rad

In order for an e-commerce platform to maximize its revenue, it must recommend customers items they are most likely to purchase. However, the company often has business constraints on these items, such as the number of each item in stock.…

Optimization and Control · Mathematics 2019-11-19 Andrea Boskovic , Qinyi Chen , Dominik Kufel , Zijie Zhou

Majority of the computer or mobile phone enthusiasts make use of the web for searching activity. Web search engines are used for the searching; The results that the search engines get are provided to it by a software module known as the Web…

Information Retrieval · Computer Science 2014-11-18 Prashant Dahiwale , M M Raghuwanshi , Latesh malik

With the increase in size of web, the information is also spreading at large scale. Search Engines are the medium to access this information. Crawler is the module of search engine which is responsible for download the web pages. In order…

Information Retrieval · Computer Science 2016-11-07 Deepika , Ashutosh Dixit

In the on-line file-caching problem problem, the input is a sequence of requests for files, given on-line (one at a time). Each file has a non-negative size and a non-negative retrieval cost. The problem is to decide which files to keep in…

Data Structures and Algorithms · Computer Science 2015-06-02 Neal E. Young

This paper studies an online service caching problem, where an edge server, equipped with a prediction window of future service request arrivals, needs to decide which services to host locally subject to limited storage capacity. The edge…

Networking and Internet Architecture · Computer Science 2023-01-11 Siqi Fan , I-Hong Hou , Van Sy Mai

Getting informed of what is registered in the Web space on time, can greatly help the psychologists, marketers and political analysts to familiarize, analyse, make decision and act correctly based on the society`s different needs. The great…

Information Retrieval · Computer Science 2012-02-10 Mehdi Naghavi , Mohsen Sharifi

Online learning algorithms for dynamical systems provide finite time guarantees for control in the presence of sequentially revealed cost functions. We pose the classical linear quadratic tracking problem in the framework of online…

Systems and Control · Electrical Eng. & Systems 2024-10-18 Aren Karapetyan , Diego Bolliger , Anastasios Tsiamis , Efe C. Balta , John Lygeros