English
Related papers

Related papers: LogLog-Beta and More: A New Algorithm for Cardinal…

200 papers

In many classification problems it is desirable to output well-calibrated probabilities on the different classes. We propose a robust, non-parametric method of calibrating probabilities called SplineCalib that utilizes smoothing splines to…

Machine Learning · Statistics 2018-09-21 Brian Lucena

F.Giroire has recently proposed an algorithm which returns the approximate number of distincts elements in a large sequence of words, under strong constraints coming from the analysis of large data bases. His estimation is based on…

Statistics Theory · Mathematics 2011-04-25 Philippe Chassaing , Lucas Gerin

Retrieval-augmented generation (RAG) is a framework enabling large language models (LLMs) to enhance their accuracy and reduce hallucinations by integrating external knowledge bases. In this paper, we introduce a hybrid RAG system enhanced…

Computation and Language · Computer Science 2024-09-04 Ye Yuan , Chengwu Liu , Jingyang Yuan , Gongbo Sun , Siqi Li , Ming Zhang

We present some new density estimation algorithms obtained by bootstrap aggregation like Bagging. Our algorithms are analyzed and empirically compared to other methods found in the statistical literature, like stacking and boosting for…

Methodology · Statistics 2012-07-23 Mathias Bourel , Badih Ghattas

Recent studies highlight various machine learning (ML)-based techniques for code clone detection, which can be integrated into developer tools such as static code analysis. With the advancements brought by ML in code understanding, ML-based…

Software Engineering · Computer Science 2025-09-30 Teeradaj Racharak , Chaiyong Ragkhitwetsagul , Chayanee Junplong , Akara Supratak

This paper presents LogiCode, a novel framework that leverages Large Language Models (LLMs) for identifying logical anomalies in industrial settings, moving beyond traditional focus on structural inconsistencies. By harnessing LLMs for…

Machine Learning · Computer Science 2024-06-10 Yiheng Zhang , Yunkang Cao , Xiaohao Xu , Weiming Shen

Many classification applications require accurate probability estimates in addition to good class separation but often classifiers are designed focusing only on the latter. Calibration is the process of improving probability estimates by…

Machine Learning · Computer Science 2020-01-31 Tuomo Alasalmi , Jaakko Suutala , Heli Koskimäki , Juha Röning

Log parsing, which involves log template extraction from semi-structured logs to produce structured logs, is the first and the most critical step in automated log analysis. However, current log parsers suffer from limited effectiveness for…

Software Engineering · Computer Science 2024-03-01 Junjielong Xu , Ruichun Yang , Yintong Huo , Chengyu Zhang , Pinjia He

While logical reasoning evaluation of Large Language Models (LLMs) has attracted significant attention, existing benchmarks predominantly rely on multiple-choice formats that are vulnerable to random guessing, leading to overestimated…

Computation and Language · Computer Science 2025-02-25 Qin Zhu , Fei Huang , Runyu Peng , Keming Lu , Bowen Yu , Qinyuan Cheng , Xipeng Qiu , Xuanjing Huang , Junyang Lin

We consider to learn a causal ordering of variables in a linear non-Gaussian acyclic model called LiNGAM. Several existing methods have been shown to consistently estimate a causal ordering assuming that all the model assumptions are…

Machine Learning · Statistics 2012-04-10 Tatsuya Tashiro , Shohei Shimizu , Aapo Hyvarinen , Takashi Washio

Low-rank matrix approximations are often used to help scale standard machine learning algorithms to large-scale problems. Recently, matrix coherence has been used to characterize the ability to extract global information from a subset of…

Machine Learning · Statistics 2010-09-07 Mehryar Mohri , Ameet Talwalkar

Recent work has proposed stochastic Plackett-Luce (PL) ranking models as a robust choice for optimizing relevance and fairness metrics. Unlike their deterministic counterparts that require heuristic optimization algorithms, PL models are…

Information Retrieval · Computer Science 2021-07-08 Harrie Oosterhuis

Maximum Satisfiability (MaxSAT) is an optimization variant of the Boolean Satisfiability (SAT) problem. In general, MaxSAT algorithms perform a succession of SAT solver calls to reach an optimum solution making extensive use of cardinality…

Logic in Computer Science · Computer Science 2014-08-21 Ruben Martins , Saurabh Joshi , Vasco Manquinho , Ines Lynce

Model counting, or counting the satisfying assignments of a Boolean formula, is a fundamental problem with diverse applications. Given #P-hardness of the problem, developing algorithms for approximate counting is an important research area.…

Logic in Computer Science · Computer Science 2023-12-20 Kuldeep S. Meel , Supratik Chakraborty , S. Akshay

Online monitoring user cardinalities (or degrees) in graph streams is fundamental for many applications. For example in a bipartite graph representing user-website visiting activities, user cardinalities (the number of distinct visited…

Data Structures and Algorithms · Computer Science 2018-11-27 Pinghui Wang , Peng Jia , Xiangliang Zhang , Jing Tao , Xiaohong Guan , Don Towsley

A new parameterization and algorithm are proposed for seeking the primary relative maximum of the likelihood function in the three-parameter lognormal distribution. The parameterization yields the dimension reduction of the three-parameter…

Statistics Theory · Mathematics 2013-11-18 Yoshio Komori , Hideo Hirose

The majority of NLG evaluation relies on automatic metrics, such as BLEU . In this paper, we motivate the need for novel, system- and data-independent automatic evaluation methods: We investigate a wide range of metrics, including…

Computation and Language · Computer Science 2017-09-18 Jekaterina Novikova , Ondřej Dušek , Amanda Cercas Curry , Verena Rieser

We propose a totally corrective boosting algorithm with explicit cardinality regularization. The resulting combinatorial optimization problems are not known to be efficiently solvable with existing classical methods, but emerging quantum…

Machine Learning · Computer Science 2015-04-09 Vasil S. Denchev , Nan Ding , Shin Matsushima , S. V. N. Vishwanathan , Hartmut Neven

Machine-generated probability predictions are essential in modern classification tasks such as image classification. A model is well calibrated when its predicted probabilities correspond to observed event frequencies. Despite the need for…

Machine Learning · Statistics 2026-02-24 Amy Vennos , Xin Xing , Christopher T. Franck

We present a detailed study of top-$k$ classification, the task of predicting the $k$ most probable classes for an input, extending beyond single-class prediction. We demonstrate that several prevalent surrogate loss functions in…

Machine Learning · Computer Science 2024-03-29 Anqi Mao , Mehryar Mohri , Yutao Zhong