English
Related papers

Related papers: LogLog-Beta and More: A New Algorithm for Cardinal…

200 papers

This work focuses on the development of a new family of decision-making algorithms for adaptation and learning, which are specifically tailored to decision problems and are constructed by building up on first principles from decision…

Signal Processing · Electrical Eng. & Systems 2020-12-16 Stefano Marano , Ali H. Sayed

Effective alert diagnosis is essential for ensuring the reliability of large-scale online service systems. However, on-call engineers are often burdened with manually inspecting massive volumes of logs to identify root causes. While various…

Software Engineering · Computer Science 2025-10-01 Zhihan Jiang , Jinyang Liu , Yichen Li , Haiyu Huang , Xiao He , Tieying Zhang , Jianjun Chen , Yi Li , Rui Shi , Michael R. Lyu

This work introduces ExaLogLog, a new data structure for approximate distinct counting, which has the same practical properties as the popular HyperLogLog algorithm. It is commutative, idempotent, mergeable, reducible, has a constant-time…

Data Structures and Algorithms · Computer Science 2025-02-28 Otmar Ertl

Cardinality estimation (CardEst) is an essential component in query optimizers and a fundamental problem in DBMS. A desired CardEst method should attain good algorithm performance, be stable to varied data settings, and be friendly to…

Databases · Computer Science 2021-02-03 Ziniu Wu , Amir Shaikhha , Rong Zhu , Kai Zeng , Yuxing Han , Jingren Zhou

Software systems usually record important runtime information in their logs. Logs help practitioners understand system runtime behaviors and diagnose field failures. As logs are usually very large in size, automated log analysis is needed…

Software Engineering · Computer Science 2020-01-10 Hetong Dai , Heng Li , Weiyi Shang , Tse-Hsun Chen , Che-Shao Chen

The polylogarithm function is one of the constellation of important mathematical functions. It has a long history, and many connections to other special functions and series, and many applications, for instance in statistical physics.…

Numerical Analysis · Mathematics 2020-10-21 Matthew Roughan

This paper introduces a novel algorithm for cardinality, i.e., the number of nodes, estimation in large scale anonymous graphs using statistical inference methods. Applications of this work include estimating the number of sensor devices,…

Information Theory · Computer Science 2015-08-21 Ahmed Douik , Salah A. Aly , Tareq Y. Al-Naffouri , Mohamed-Slim Alouini

This paper considers the problem of cardinality estimation in data stream applications. We present a statistical analysis of probabilistic counting algorithms, focusing on two techniques that use pseudo-random variates to form…

Computation · Statistics 2012-11-20 Peter Clifford , Ioana A. Cosma

Cardinality estimation (CardEst) plays a significant role in generating high-quality query plans for a query optimizer in DBMS. In the last decade, an increasing number of advanced CardEst methods (especially ML-based) have been proposed…

In query optimisation accurate cardinality estimation is essential for finding optimal query plans. It is especially challenging for RDF due to the lack of explicit schema and the excessive occurrence of joins in RDF queries. Existing…

Databases · Computer Science 2018-01-22 Xin Wang , Eugene Siow , Aastha Madaan , Thanassis Tiropanis

We introduce kLog, a novel approach to statistical relational learning. Unlike standard approaches, kLog does not represent a probability distribution directly. It is rather a language to perform kernel-based learning on expressive logical…

Artificial Intelligence · Computer Science 2014-10-17 Paolo Frasconi , Fabrizio Costa , Luc De Raedt , Kurt De Grave

Log parsing, the process of converting raw log messages into structured formats, is an important initial step for automated analysis of logs of large-scale software systems. Traditional log parsers often rely on heuristics or handcrafted…

Software Engineering · Computer Science 2024-06-13 Yi Xiao , Van-Hoang Le , Hongyu Zhang

Cardinality estimation is a fundamental functionality in database systems. Most existing cardinality estimators focus on handling predicates over numeric or categorical data. They have largely omitted an important data type, set-valued…

Databases · Computer Science 2025-03-20 Yufan Sheng , Xin Cao , Kaiqi Zhao , Yixiang Fang , Jianzhong Qi , Wenjie Zhang , Christian S. Jensen

In various areas of applied numerics, the problem of calculating the logarithm of a matrix A emerges. Since series expansions of the logarithm usually do not converge well for matrices far away from the identity, the standard numerical…

Numerical Analysis · Computer Science 2007-07-19 Gernot Schaller

Super point is a special host in network which communicates with lots of other hosts in a certain time period. The number of hosts contacting with a super point is called as its cardinality. Cardinality estimating plays important roles in…

Networking and Internet Architecture · Computer Science 2018-07-05 Jie Xu , Wei Ding , Jian Gong , Xiaoyan Hu

In recent years, \emph{learned cardinality estimation} has emerged as an alternative to traditional query optimization methods: by training machine learning models over observed query performance, learned cardinality estimation techniques…

Databases · Computer Science 2023-12-05 Peizhi Wu , Ryan Marcus , Zachary G. Ives

Alignment techniques for LLMs rely on optimizing preference-based objectives -- where these preferences are typically elicited as ordinal, binary choices between responses. Recent work has focused on improving label quality or mitigating…

Artificial Intelligence · Computer Science 2025-08-13 Parker Whitfill , Stewy Slocum

Automated log analysis is crucial in modern software-intensive systems for facilitating program comprehension throughout software maintenance and engineering life cycles. Existing methods perform tasks such as log parsing and log anomaly…

Software Engineering · Computer Science 2024-01-29 Yilun Liu , Shimin Tao , Weibin Meng , Jingyu Wang , Wenbing Ma , Yanqing Zhao , Yuhang Chen , Hao Yang , Yanfei Jiang , Xun Chen

Log parsing serves as an essential prerequisite for various log analysis tasks. Recent advancements in this field have improved parsing accuracy by leveraging the semantics in logs through fine-tuning large language models (LLMs) or…

Software Engineering · Computer Science 2024-08-09 Junjie Huang , Zhihan Jiang , Zhuangbin Chen , Michael R. Lyu

We propose an ensemble algorithm, which provides a new approach for evaluating and summing up a set of function samples. The proposed algorithm is not a quantum algorithm, insofar it does not involve quantum entanglement. The query…

Quantum Physics · Physics 2009-11-07 C. D'Helon , V. Protopopescu