English
Related papers

Related papers: ArcLink: Optimization Techniques to Build and Retr…

200 papers

As web technologies evolve, web archivists work to keep up so that our digital history is preserved. Recent advances in web technologies have introduced client-side executed scripts that load data without a referential identifier or that…

Digital Libraries · Computer Science 2019-05-17 Mat Kelly , Justin F. Brunelle , Michele C. Weigle , Michael L. Nelson

The WARC file format is widely used by web archives to preserve collected web content for future use. With the rapid growth of web archives and the increasing interest to reuse these archives as big data sources for statistical and…

Digital Libraries · Computer Science 2020-05-28 Xinyue Wang , Zhiwu Xie

Recovering accurate architecture from large-scale legacy software is hindered by architectural drift, missing relations, and the limited context of Large Language Models (LLMs). We present ArchAgent, a scalable agent-based framework that…

Software Engineering · Computer Science 2026-01-21 Rusheng Pan , Bingcheng Mao , Tianyi Ma , Zhenhua Ling

Attack graphs are a tool for analyzing security vulnerabilities that capture different and prospective attacks on a system. As a threat modeling tool, it shows possible paths that an attacker can exploit to achieve a particular goal.…

Archive collections are nowadays mostly available through search engines interfaces, which allow a user to retrieve documents by issuing queries. The study of these collections may be, however, impaired by some aspects of search engines,…

Computation and Language · Computer Science 2023-02-01 Nicolas Gutehrlé , Antoine Doucet , Adam Jatowt

Social graph construction from various sources has been of interest to researchers due to its application potential and the broad range of technical challenges involved. The World Wide Web provides a huge amount of continuously updated data…

Social and Information Networks · Computer Science 2017-01-13 Miroslav Shaltev , Jan-Hendrik Zab , Philipp Kemkes , Stefan Siersdorfer , Sergej Zerr

The Web graph is a giant social network whose properties have been measured and modeled extensively in recent years. Most such studies concentrate on the graph structure alone, and do not consider textual properties of the nodes.…

Information Retrieval · Computer Science 2018-02-15 Soumen Chakrabarti , Mukul M. Joshi , Kunal Punera , David M. Pennock

Many applications need up-to-date copies of collections of changing Web resources. Such synchronization is currently achieved using ad-hoc or proprietary solutions. We propose ResourceSync, a general Web resource synchronization protocol…

Good websites should be easy to navigate via hyperlinks, yet maintaining a high-quality link structure is difficult. Identifying pairs of pages that should be linked may be hard for human editors, especially if the site is large and changes…

Social and Information Networks · Computer Science 2018-02-28 Ashwin Paranjape , Robert West , Leila Zia , Jure Leskovec

There are several ideas being used today for Web information retrieval, and specifically in Web search engines. The PageRank algorithm is one of those that introduce a content-neutral ranking function over Web pages. This ranking is applied…

Distributed, Parallel, and Cluster Computing · Computer Science 2007-05-23 Giorgos Kollias , Efstratios Gallopoulos , Daniel B. Szyld

We describe challenges related to web archiving, replaying archived web resources, and verifying their authenticity. We show that Web Packaging has significant potential to help address these challenges and identify areas in which changes…

Networking and Internet Architecture · Computer Science 2019-06-18 Sawood Alam , Michele C. Weigle , Michael L. Nelson , Martin Klein , Herbert Van de Sompel

Web archives have grown to petabytes. In addition to providing invaluable background knowledge on many social and cultural developments over the last 30 years, they also provide vast amounts of training data for machine learning. To benefit…

Digital Libraries · Computer Science 2022-09-27 Niklas Deckers , Martin Potthast

Peer-to-peer (P2P) Data-sharing systems now generate a significant portion of Internet traffic. P2P systems have emerged as an accepted way to share enormous volumes of data. Needs for widely distributed information systems supporting…

Databases · Computer Science 2011-08-08 Anis Ismail , Mohamed Quafafou , Nicolas Durand , Mohammad Hajjar

The growing volume of video data and the introduction of complex retrieval challenges, such as the Temporal Retrieval and Alignment of Key Events (TRAKE) task at the Ho Chi Minh City AI Challenge 2025, expose critical limitations in…

Multimedia · Computer Science 2025-12-16 Thanh-Danh Luu , Le-Vu Nguyen Dinh , Duc-Thien Tran , Duy-Bao Bui , Nam-Tien Le , Tinh-Anh Nguyen Nhu

We document strategies and lessons learned from sampling the web by collecting 27.3 million URLs with 3.8 billion archived pages spanning 26 years (1996-2021) from the Internet Archive's (IA) Wayback Machine. Our goal is to revisit…

Digital Libraries · Computer Science 2025-07-22 Kritika Garg , Sawood Alam , Dietrich Ayala , Mark Graham , Michele C. Weigle , Michael L. Nelson

The Web is ephemeral. Many resources have representations that change over time, and many of those representations are lost forever. A lucky few manage to reappear as archived resources that carry their own URIs. For example, some content…

The field of web archiving provides a unique mix of human and automated agents collaborating to achieve the preservation of the web. Centuries old theories of archival appraisal are being transplanted into the sociotechnical environment of…

Digital Libraries · Computer Science 2016-11-09 Ed Summers , Ricardo Punzalan

Deep Research systems based on web agents have shown strong potential in solving complex information-seeking tasks, yet their search efficiency remains underexplored. We observe that many state-of-the-art open-source web agents rely on long…

Artificial Intelligence · Computer Science 2026-05-11 Junjie Wang , Zequn Xie , Dan Yang , Jie Feng , Yue Shen , Duolin Sun , Meixiu Long , Yihan Jiao , Zhehao Tan , Jian Wang , Peng Wei , Jinjie Gu

Application programming interfaces (APIs) offer a plethora of functionalities for developers to reuse without reinventing the wheel. Identifying the appropriate APIs given a project requirement is critical for the success of a project, as…

Information Retrieval · Computer Science 2018-03-02 Ferdian Thung , Richard J. Oentaryo , David Lo , Yuan Tian

Autonomous agents increasingly interact with the web, yet most websites remain designed for human browsers -- a fundamental mismatch that the emerging ``Agentic Web'' must resolve. Agents must repeatedly browse pages, inspect DOMs, and…

Emerging Technologies · Computer Science 2026-04-02 Lewis Tham , Nicholas Mac Gregor Garcia , Jungpil Hahn