English
Related papers

Related papers: Performance Comparison of Function Evaluation Meth…

200 papers

At the heart of improving conversational AI is the open problem of how to evaluate conversations. Issues with automatic metrics are well known (Liu et al., 2016, arXiv:1603.08023), with human evaluations still considered the gold standard.…

Computation and Language · Computer Science 2022-01-14 Eric Michael Smith , Orion Hsu , Rebecca Qian , Stephen Roller , Y-Lan Boureau , Jason Weston

We explore the task of automatic assessment of argument quality. To that end, we actively collected 6.3k arguments, more than a factor of five compared to previously examined data. Each argument was explicitly and carefully annotated for…

Computation and Language · Computer Science 2019-09-04 Assaf Toledo , Shai Gretz , Edo Cohen-Karlik , Roni Friedman , Elad Venezian , Dan Lahav , Michal Jacovi , Ranit Aharonov , Noam Slonim

We compare the CPU effort and pricing biases of seven Fourier-based implementations. Our analyses show that truncation and discretization errors significantly increase as we move away from the Black-Scholes-Merton framework. We rank the…

Computational Finance · Quantitative Finance 2018-05-14 Ricardo Crisóstomo

Consider designing an effective crowdsourcing system for an $M$-ary classification task. Crowd workers complete simple binary microtasks whose results are aggregated to give the final result. We consider the novel scenario where workers…

Machine Learning · Computer Science 2016-12-14 Qunwei Li , Aditya Vempaty , Lav R. Varshney , Pramod K. Varshney

Collaborative work on shared documents was revolutionized by web services like Google Docs or Etherpad. Multiple users can work on the same document in a comfortable and distributed way. For the synchronization of the changes a replication…

Logic in Computer Science · Computer Science 2015-12-21 Tim Jungnickel , Tobias Herb

Context: Software performance is a critical non-functional requirement, appearing in many fields such as mission critical applications, financial, and real time systems. In this work we focused on early detection of performance bugs; our…

Software Engineering · Computer Science 2017-02-28 Sokratis Tsakiltsidis , Andriy Miranskyy , Elie Mazzawi

Numerous analysis methods for quantitative attack tree analysis have been proposed. These algorithms compute relevant security metrics, i.e. performance indicators that quantify how good the security of a system is, such as the most likely…

Cryptography and Security · Computer Science 2022-09-29 Carlos E. Budde , Mariëlle Stoelinga

With increasing interest in explaining machine learning (ML) models, the first part of this two-part study synthesizes recent research on methods for explaining global and local aspects of ML models. This study distinguishes explainability…

Machine Learning · Statistics 2022-11-17 Montgomery Flora , Corey Potvin , Amy McGovern , Shawn Handler

In data mining, when binary prediction rules are used to predict a binary outcome, many performance measures are used in a vast array of literature for the purposes of evaluation and comparison. Some examples include classification…

Machine Learning · Statistics 2025-07-08 Zheng Yuan , Wenxin Jiang

We propose a novel tree-based ensemble method, named XGBoostPP, to nonparametrically estimate the intensity of a point process as a function of covariates. It extends the use of gradient-boosted regression trees (Chen & Guestrin, 2016) to…

Methodology · Statistics 2024-02-01 C. Lu , Y. Guan , M. N. M. van Lieshout , G. Xu

Score-based explainable machine-learning techniques are often used to understand the logic behind black-box models. However, such explanation techniques are often computationally expensive, which limits their application in time-critical…

Machine Learning · Computer Science 2023-08-24 Amr Alkhatib , Henrik Boström , Sofiane Ennadir , Ulf Johansson

Algorithm evaluation and comparison are fundamental questions in machine learning and statistics -- how well does an algorithm perform at a given modeling task, and which algorithm performs best? Many methods have been developed to assess…

Statistics Theory · Mathematics 2025-11-25 Yuetian Luo , Rina Foygel Barber

This paper describes RESOLVE, a system that uses decision trees to learn how to classify coreferent phrases in the domain of business joint ventures. An experiment is presented in which the performance of RESOLVE is compared to the…

cmp-lg · Computer Science 2008-02-03 Joseph F. McCarthy , Wendy G. Lehnert

Nowadays new technologies, and especially artificial intelligence, are more and more established in our society. Big data analysis and machine learning, two sub-fields of artificial intelligence, are at the core of many recent breakthroughs…

Machine Learning · Statistics 2021-06-22 Antonio Sutera

In this paper, based on results of exact learning and test theory, we study arbitrary infinite binary information systems each of which consists of an infinite set of elements and an infinite set of two-valued functions (attributes) defined…

Computational Complexity · Computer Science 2022-01-13 Mikhail Moshkov

Predictions using a combination of decision trees are known to be effective in machine learning. Typical ideas for constructing a combination of decision trees for prediction are bagging and boosting. Bagging independently constructs…

Machine Learning · Computer Science 2024-02-12 Keito Tajima , Naoki Ichijo , Yuta Nakahara , Toshiyasu Matsushima

Inferring a decision maker's utility function typically involves an elicitation phase where the decision maker responds to a series of elicitation queries, followed by an estimation phase where the state-of-the-art is to either fit the…

Applications · Statistics 2018-07-31 Mengyang Gu , Debarun Bhattacharjya , Dharmashankar Subramanian

A key part of any dependent type-checker is the method for checking whether two types are equal. A common claim is that syntax-directed equality is more performant, although type-directed equality is more expressive. However, this claim is…

Programming Languages · Computer Science 2025-09-18 Chester J. F. Gould , William J. Bowman

Facial valence/arousal, expression and action unit are related tasks in facial affective analysis. However, the tasks only have limited performance in the wild due to the various collected conditions. The 4th competition on affective…

Computer Vision and Pattern Recognition · Computer Science 2022-07-21 Yanan Chang , Yi Wu , Xiangyu Miao , Jiahe Wang , Shangfei Wang

This paper explores the capabilities of current transformer-based language models for program evaluation of simple functional programming languages. We introduce a new program generation mechanism that allows control over syntactic sugar…

Computation and Language · Computer Science 2021-12-10 Torsten Scholak , Jonathan Pilault , Joey Velez-Ginorio