English

CHEW: A Dataset of CHanging Events in Wikipedia

Computation and Language 2024-06-28 v1 Artificial Intelligence Machine Learning
Authors: Hsuvas Borkakoty , Luis Espinosa-Anke
View on arXiv ↗ PDF ↗

Abstract

We introduce CHEW, a novel dataset of changing events in Wikipedia expressed in naturally occurring text. We use CHEW for probing LLMs for their timeline understanding of Wikipedia entities and events in generative and classification experiments. Our results suggest that LLMs, despite having temporal information available, struggle to construct accurate timelines. We further show the usefulness of CHEW-derived embeddings for identifying meaning shift.

Keywords

dataset changing events Wikipedia timeline understanding large language models

Cite

@article{arxiv.2406.19116,
  title  = {CHEW: A Dataset of CHanging Events in Wikipedia},
  author = {Hsuvas Borkakoty and Luis Espinosa-Anke},
  journal= {arXiv preprint arXiv:2406.19116},
  year   = {2024}
}

Comments

Short Paper

Related papers

View all related →
Computation and Language · Computer Science
Event Linking: Grounding Event Mentions to Wikipedia
Xiaodong Yu, Wenpeng Yin, Nitish Gupta, Dan Roth
2023-02-17
Computation and Language · Computer Science
WEC: Deriving a Large-scale Cross-document Event Coreference dataset from Wikipedia
Alon Eirew, Arie Cattan, Ido Dagan
2021-05-03
Computation and Language · Computer Science
Generating Timelines by Modeling Semantic Change
Guy D. Rosin, Kira Radinsky
2019-09-24
Computation and Language · Computer Science
Named Entity Evolution Analysis on Wikipedia
Helge Holzmann, Thomas Risse
2017-03-20
Computation and Language · Computer Science
Wikipedia in the Era of LLMs: Evolution and Risks
Siming Huang, Yuliang Xu, Mingmeng Geng, Yao Wan +1
2026-03-03
Physics and Society · Physics
The Detection and effect of social events on Wikipedia data-set for studying human preferences
Julien Assuied, Yérali Gandica
2022-05-17
Computation and Language · Computer Science
Insights into Entity Name Evolution on Wikipedia
Helge Holzmann, Thomas Risse
2017-02-07
Computation and Language · Computer Science
Capturing Evolution in Word Usage: Just Add More Clusters?
Matej Martinc, Syrielle Montariol, Elaine Zosa, Lidia Pivovarova
2020-04-21
Information Retrieval · Computer Science
Embed2Detect: Temporally Clustered Embedded Words for Event Detection in Social Media
Hansi Hettiarachchi, Mariam Adedoyin-Olowe, Jagdev Bhogal, Mohamed Medhat Gaber
2021-05-27
Computers and Society · Computer Science
Ongoing Events in Wikipedia: A Cross-lingual Case Study
Simon Gottschalk, Elena Demidova, Viola Bernacchi, Richard Rogers
2018-01-23
Computation and Language · Computer Science
Creating Custom Event Data Without Dictionaries: A Bag-of-Tricks
Andrew Halterman, Philip A. Schrodt, Andreas Beger, Benjamin E. Bagozzi +1
2023-04-05
Information Retrieval · Computer Science
How much is Wikipedia Lagging Behind News?
Besnik Fetahu, Abhijit Anand, Avishek Anand
2017-03-31
Computation and Language · Computer Science
Wikipedia2Vec: An Efficient Toolkit for Learning and Visualizing the Embeddings of Words and Entities from Wikipedia
Ikuya Yamada, Akari Asai, Jin Sakuma, Hiroyuki Shindo +3
2020-09-29
Social and Information Networks · Computer Science
Wikipedia traffic data and electoral prediction: towards theoretically informed models
Taha Yasseri, Jonathan Bright
2023-01-05
Computation and Language · Computer Science
WETBench: A Benchmark for Detecting Task-Specific Machine-Generated Text on Wikipedia
Gerrit Quaremba, Elizabeth Black, Denny Vrandečić, Elena Simperl
2025-07-08
Computation and Language · Computer Science
WINELL: Wikipedia Never-Ending Updating with LLM Agents
Revanth Gangi Reddy, Tanay Dixit, Jiaxin Qin, Cheng Qian +6
2025-08-07
Social and Information Networks · Computer Science
Quality change: norm or exception? Measurement, Analysis and Detection of Quality Change in Wikipedia
Paramita Das, Bhanu Prakash Reddy Guda, Sasi Bhusan Seelaboyina, Soumya Sarkar +1
2021-11-03
Computation and Language · Computer Science
TempEL: Linking Dynamically Evolving and Newly Emerging Entities
Klim Zaporojets, Lucie-Aimee Kaffee, Johannes Deleu, Thomas Demeester +2
2023-02-07
Computation and Language · Computer Science
Drafting Event Schemas using Language Models
Anisha Gunjal, Greg Durrett
2023-05-25
Computation and Language · Computer Science
QUEST: A Retrieval Dataset of Entity-Seeking Queries with Implicit Set Operations
Chaitanya Malaviya, Peter Shaw, Ming-Wei Chang, Kenton Lee +1
2023-06-01
Computation and Language · Computer Science
Event Detection Explorer: An Interactive Tool for Event Detection Exploration
Wenlong Zhang, Bhagyashree Ingale, Hamza Shabir, Tianyi Li +2
2022-04-27
Machine Learning · Computer Science
Detecting Events and Patterns in Large-Scale User Generated Textual Streams with Statistical Learning Methods
Vasileios Lampos
2012-08-15
Computer Vision and Pattern Recognition · Computer Science
Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipedia
Khanh Nguyen, Ali Furkan Biten, Andres Mafla, Lluis Gomez +1
2022-09-22
Computation and Language · Computer Science
WiCE: Real-World Entailment for Claims in Wikipedia
Ryo Kamoi, Tanya Goyal, Juan Diego Rodriguez, Greg Durrett
2023-10-24
Information Retrieval · Computer Science
The Links Have It: Infobox Generation by Summarization over Linked Entities
Kezun Zhang, Yanghua Xiao, Hanghang Tong, Haixun Wang +1
2014-06-26