English
Related papers

Related papers: Web Page Classification using LLMs for Crawling Su…

200 papers

World Wide Web is a huge repository of information and there is a tremendous increase in the volume of information daily. The number of users are also increasing day by day. To reduce users browsing time lot of research is taken place. Web…

Information Retrieval · Computer Science 2014-05-22 V. Chitraa , Antony Selvadoss Thanamani

Classification tasks are typically handled using Machine Learning (ML) models, which lack a balance between accuracy and interpretability. This paper introduces a new approach for classification tasks using Large Language Models (LLMs) in…

Computation and Language · Computer Science 2025-01-03 Praneeth Vadlapati

In recent years, the use of large language models (LLMs) for text classification has attracted widespread attention. Despite this, the classification accuracy of LLMs has not yet universally surpassed that of smaller models. LLMs can…

Computation and Language · Computer Science 2024-12-11 Min Zeng , Caiquan Liu , Shiqi Zhang , Li Xie , Chen Sang , Xiaoxin Chen

The Hidden Web is the vast repository of informational databases available only through search form interfaces, accessible by therein typing a set of keywords in the search forms. Typically, a Hidden Web crawler is employed to autonomously…

Information Retrieval · Computer Science 2013-11-05 Sonali Gupta , Komal Kumar Bhatia

The advent of Large Language Models (LLMs) has significantly revolutionized web search. The emergence of LLM-based Search Agents marks a pivotal shift towards deeper, dynamic, autonomous information seeking. These agents can comprehend user…

Information Retrieval · Computer Science 2025-08-20 Yunjia Xi , Jianghao Lin , Yongzhao Xiao , Zheli Zhou , Rong Shan , Te Gao , Jiachen Zhu , Weiwen Liu , Yong Yu , Weinan Zhang

In this study, we propose a structured methodology that utilizes large language models (LLMs) in a cost-efficient and parsimonious manner, integrating the strengths of scholars and machines while offsetting their respective weaknesses. Our…

Computation and Language · Computer Science 2025-12-30 Navid Asgari , Benjamin M. Cole

Large Language Models (LLMs) have greatly contributed to the development of adaptive intelligent agents and are positioned as an important way to achieve Artificial General Intelligence (AGI). However, LLMs are prone to produce factually…

Computation and Language · Computer Science 2024-08-29 Weijian Xie , Xuefeng Liang , Yuhui Liu , Kaihua Ni , Hong Cheng , Zetian Hu

Crawling parallel texts -- texts that are mutual translations -- from the Internet is usually done following a brute-force approach: documents are massively downloaded in an unguided process, and only a fraction of them end up leading to…

Computation and Language · Computer Science 2026-04-22 Cristian García-Romero , Miquel Esplà-Gomis , Felipe Sánchez-Martínez

Charts represent an essential source of visual information in documents and facilitate a deep understanding and interpretation of information typically conveyed numerically. In the scientific literature, there are many charts, each with its…

Computer Vision and Pattern Recognition · Computer Science 2023-07-11 Anurag Dhote , Mohammed Javed , David S Doermann

In this paper, we examine how large language models (LLMs) solve multi-step problems under a language agent framework with three components: a generator, a discriminator, and a planning method. We investigate the practical utility of two…

Computation and Language · Computer Science 2024-06-07 Ziru Chen , Michael White , Raymond Mooney , Ali Payani , Yu Su , Huan Sun

Exponential growth of the web increased the importance of web document classification and data mining. To get the exact information, in the form of knowing what classes a web document belongs to, is expensive. Automatic classification of…

Information Retrieval · Computer Science 2014-06-24 R. K. Roul , S. K. Sahay

Social media influence campaigns pose significant challenges to public discourse and democracy. Traditional detection methods fall short due to the complexity and dynamic nature of social media. Addressing this, we propose a novel detection…

Social and Information Networks · Computer Science 2023-11-15 Luca Luceri , Eric Boniardi , Emilio Ferrara

The powerful ability to understand, follow, and generate complex language emerging from large language models (LLMs) makes LLM-generated text flood many areas of our daily lives at an incredible speed and is widely accepted by humans. As…

Computation and Language · Computer Science 2024-04-22 Junchao Wu , Shu Yang , Runzhe Zhan , Yulin Yuan , Derek F. Wong , Lidia S. Chao

This article gives an overview of the field of LLM text recognition. Different approaches and implemented detectors for the recognition of LLM-generated text are presented. In addition to discussing the implementations, the article focuses…

Computation and Language · Computer Science 2024-06-18 Thorsten Pröhl , Erik Putzier , Rüdiger Zarnekow

Search engines are the most important tools for web data acquisition. Web pages are crawled and indexed by search Engines. Users typically locate useful web pages by querying a search engine. One of the challenges in search engines…

Information Retrieval · Computer Science 2016-05-11 Seyed Hamid Reza Mohammadi , Mohammad Ali Zare Chahooki

Identifying critical nodes in networks is a classical decision-making task, and many methods struggle to strike a balance between adaptability and utility. Therefore, we propose an approach that empowers Evolutionary Algorithm (EA) with…

Social and Information Networks · Computer Science 2024-03-08 Jinzhu Mao , Dongyun Zou , Li Sheng , Siyi Liu , Chen Gao , Yue Wang , Yong Li

Ranking systems form the basis for online search engines and recommendation services. They process large collections of items, for instance web pages or e-commerce products, and present the user with a small ordered selection. The goal of a…

Information Retrieval · Computer Science 2020-12-14 Harrie Oosterhuis

This study proposes a method to diversify queries in existing test collections to reflect some of the diversity of search engine users, aligning with an earlier vision of an 'ideal' test collection. A Large Language Model (LLM) is used to…

Information Retrieval · Computer Science 2025-08-26 Marwah Alaofi , Nicola Ferro , Paul Thomas , Falk Scholer , Mark Sanderson

We introduce iterative retrieval, a novel framework that empowers retrievers to make iterative decisions through policy optimization. Finding an optimal portfolio of retrieved items is a combinatorial optimization problem, generally…

Computation and Language · Computer Science 2024-06-24 Yunmo Chen , Tongfei Chen , Harsh Jhamtani , Patrick Xia , Richard Shin , Jason Eisner , Benjamin Van Durme

Recommender systems have become integral to our digital experiences, from online shopping to streaming platforms. Still, the rationale behind their suggestions often remains opaque to users. While some systems employ a graph-based approach,…