中文
相关论文

相关论文: Evaluating Verifiability in Generative Search Engi…

200 篇论文

High-stakes decision systems increasingly require structured justification, traceability, and auditability to ensure accountability and regulatory compliance. Formal arguments commonly used in the certification of safety-critical systems…

人工智能 · 计算机科学 2026-04-07 Mahyar T. Moghaddam

With the widespread consumption of AI-generated content, there has been an increased focus on developing automated tools to verify the factual accuracy of such content. However, prior research and tools developed for fact verification treat…

计算与语言 · 计算机科学 2025-03-20 Varich Boonsanong , Vidhisha Balachandran , Xiaochuang Han , Shangbin Feng , Lucy Lu Wang , Yulia Tsvetkov

With the information explosion on the Web, search and recommendation are foundational infrastructures to satisfying users' information needs. As the two sides of the same coin, both revolve around the same core research problem, matching…

信息检索 · 计算机科学 2024-04-29 Yongqi Li , Xinyu Lin , Wenjie Wang , Fuli Feng , Liang Pang , Wenjie Li , Liqiang Nie , Xiangnan He , Tat-Seng Chua

Evaluating retrieval-augmented generation (RAG) systems remains challenging, particularly for open-ended questions that lack definitive answers and require coverage of multiple sub-topics. In this paper, we introduce a novel evaluation…

计算与语言 · 计算机科学 2024-10-22 Kaige Xie , Philippe Laban , Prafulla Kumar Choubey , Caiming Xiong , Chien-Sheng Wu

As generative AI (GenAI) is increasingly applied in persona development to represent real users, understanding the implications and limitations of this technology is essential for establishing robust practices. This scoping review analyzes…

人机交互 · 计算机科学 2026-04-20 Danial Amin , Joni Salminen , Farhan Ahmed , Sonja M. H. Tervola , Sankalp Sethi , Bernard J. Jansen

Automated fact checking systems have been proposed that quickly provide veracity prediction at scale to mitigate the negative influence of fake news on people and on public opinion. However, most studies focus on veracity classifiers of…

计算与语言 · 计算机科学 2022-06-15 Shih-Chieh Dai , Yi-Li Hsu , Aiping Xiong , Lun-Wei Ku

The advent of Large Language Models (LLMs) has shown the potential to improve relevance and provide direct answers in web searches. However, challenges arise in validating the reliability of generated results and the credibility of…

信息检索 · 计算机科学 2023-10-20 Xiang Shi , Jiawei Liu , Yinpeng Liu , Qikai Cheng , Wei Lu

A key task in certain democratic processes is to produce a concise slate of statements that proportionally represents the full spectrum of user opinions. This task is similar to committee elections, but unlike traditional settings, the…

计算机科学与博弈论 · 计算机科学 2025-05-30 Niclas Boehmer , Sara Fish , Ariel D. Procaccia

In fighting against fake news, many fact-checking systems comprised of human-based fact-checking sites (e.g., snopes.com and politifact.com) and automatic detection systems have been developed in recent years. However, online users still…

计算与语言 · 计算机科学 2019-11-12 Nguyen Vo , Kyumin Lee

Search engine retrieval effectiveness studies are usually small-scale, using only limited query samples. Furthermore, queries are selected by the researchers. We address these issues by taking a random representative sample of 1,000…

信息检索 · 计算机科学 2014-05-12 Dirk Lewandowski

Users of search-augmented LLMs rely on citations as evidence that responses are grounded in real sources, and rarely verify the cited pages themselves. Millions of queries per day now pass through these systems, making citation quality a…

数字图书馆 · 计算机科学 2026-05-28 Yongsik Seo , Wooseok Jeong , Eunyoung Kim , Hyeonseo Jang , Dongha Lee

Fact-checking-specific search tools such as Google Fact Check are a promising way to combat misinformation on social media, especially during events bringing significant social influence, such as the COVID-19 pandemic and the U.S.…

社会与信息网络 · 计算机科学 2025-05-27 Qiangeng Yang , Tess Christensen , Shlok Gilda , Juliana Fernandes , Daniela Oliveira , Ronald Wilson , Damon Woodard

Conversational artificial intelligence (AI) provides an efficient and convenient gateway to information access. However, it can cause overreliance when users blindly trust AI and accept its answers without fact-checking. Information search…

人机交互 · 计算机科学 2026-05-28 Mert Yazan , Frederik Bungaran Ishak Situmeang , Suzan Verberne

Language models (LMs) are known to suffer from hallucinations and misinformation. Retrieval augmented generation (RAG) that retrieves verifiable information from an external knowledge corpus to complement the parametric knowledge in LMs…

计算与语言 · 计算机科学 2024-10-14 Zhuohang Li , Jiaxin Zhang , Chao Yan , Kamalika Das , Sricharan Kumar , Murat Kantarcioglu , Bradley A. Malin

As large language model-based chat systems become increasingly widely used, generative engine optimization (GEO) has emerged as an important problem for information access and retrieval. In classical search engines, results are…

信息检索 · 计算机科学 2026-04-10 Julius Schulte , Malte Bleeker , Philipp Kaufmann

The proliferation of misinformation poses a significant threat to society, exacerbated by the capabilities of generative AI. This demo paper introduces Veracity, an open-source AI system designed to empower individuals to combat…

The recent explosion of "foundation" generative AI models has been built upon the extensive extraction of value from online sources, often without corresponding reciprocation. This pattern mirrors and intensifies the extractive practices of…

计算机与社会 · 计算机科学 2025-02-13 Philip Feldman , James R. Foulds , Shimei Pan

Generative models for Information Retrieval, where ranking of documents is viewed as the task of generating a query from a document's language model, were very successful in various IR tasks in the past. However, with the advent of modern…

计算与语言 · 计算机科学 2020-10-08 Cicero Nogueira dos Santos , Xiaofei Ma , Ramesh Nallapati , Zhiheng Huang , Bing Xiang

While often assumed a gold standard, effective human evaluation of text generation remains an important, open area for research. We revisit this problem with a focus on producing consistent evaluations that are reproducible -- over time and…

With the rise of voice assistants and an increase in mobile search usage, natural language has become an important query language. So far, most of the current systems are not able to process these queries because of the vagueness and…

人机交互 · 计算机科学 2020-08-06 Andrea Papenmeier , Alfred Sliwa , Dagmar Kern , Daniel Hienert , Ahmet Aker , Norbert Fuhr