English
Related papers

Related papers: Approximation with Error Bounds in Spark

200 papers

The transition from human-centric to agent-centric software development practices is disrupting existing knowledge sharing environments for software developers. Traditional peer-to-peer repositories and developer communities for shared…

Artificial Intelligence · Computer Science 2025-11-12 Valentin Tablan , Scott Taylor , Gabriel Hurtado , Kristoffer Bernhem , Anders Uhrenholt , Gabriele Farei , Karo Moilanen

Error assessment for Approximate Query Processing (AQP) is a challenging problem. Bootstrap sampling can produce error assessment even when the population data distribution is unknown. However, bootstrap sampling needs to produce a large…

Quantum Physics · Physics 2025-08-26 Feng Yu , Raya Jahan

Data subsampling has become widely recognized as a tool to overcome computational and economic bottlenecks in analyzing massive datasets. We contribute to the development of adaptive design for estimation of finite population…

Methodology · Statistics 2024-07-08 Henrik Imberg , Xiaomi Yang , Carol Flannagan , Jonas Bärgman

We focus the use of \emph{row sampling} for approximating matrix algorithms. We give applications to matrix multipication; sparse matrix reconstruction; and, \math{\ell_2} regression. For a matrix \math{\matA\in\R^{m\times d}} which…

Data Structures and Algorithms · Computer Science 2010-08-04 Malik Magdon-Ismail

We present new algorithms and fast implementations to find efficient approximations for modelling stochastic processes. For many numerical computations it is essential to develop finite approximations for stochastic processes. While the…

Optimization and Control · Mathematics 2020-12-03 Kipngeno Benard Kirui , Georg Ch. Pflug , Alois Pichler

The sampling problem in training corpus is one of the major sources of errors in corpus-based applications. This paper proposes a corrective training algorithm to best-fit the run-time context domain in the application of bag generation. It…

cmp-lg · Computer Science 2008-02-03 Hsin-Hsi Chen , Yue-Shi Lee

Uncertainty sampling, a popular active learning algorithm, is used to reduce the amount of data required to learn a classifier, but it has been observed in practice to converge to different parameters depending on the initialization and…

Machine Learning · Computer Science 2018-12-06 Stephen Mussmann , Percy Liang

A plethora of problems in AI, engineering and the sciences are naturally formalized as inference in discrete probabilistic models. Exact inference is often prohibitively expensive, as it may require evaluating the (unnormalized) target…

Machine Learning · Computer Science 2019-10-16 Lars Buesing , Nicolas Heess , Theophane Weber

Assessing sampling uncertainty in extremum estimation can be challenging when the asymptotic variance is not analytically tractable. Bootstrap inference offers a feasible solution but can be computationally costly especially when the model…

Econometrics · Economics 2020-09-15 Jean-Jacques Forneron , Serena Ng

We revisit the sample average approximation (SAA) approach for non-convex stochastic programming. We show that applying the SAA approach to problems with expected value equality constraints does not necessarily result in asymptotic…

Optimization and Control · Mathematics 2024-07-16 Thomas Lew , Riccardo Bonalli , Marco Pavone

The distributed data analytic system -- Spark is a common choice for processing massive volumes of heterogeneous data, while it is challenging to tune its parameters to achieve high performance. Recent studies try to employ auto-tuning…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-09-06 Yang Li , Huaijun Jiang , Yu Shen , Yide Fang , Xiaofeng Yang , Danqing Huang , Xinyi Zhang , Wentao Zhang , Ce Zhang , Peng Chen , Bin Cui

Deploying neural networks on edge devices entails a careful balance between the energy required for inference and the accuracy of the resulting classification. One technique for navigating this tradeoff is approximate computing: the process…

Machine Learning · Computer Science 2025-09-18 Morteza Rezaalipour , Francesco Costa , Marco Biasion , Rodrigo Otoni , George A. Constantinides , Laura Pozzi

The problem of counting the number of models of a given Boolean formula has numerous applications, including computing the leakage of deterministic programs in Quantitative Information Flow. Model counting is a hard, #P-complete problem.…

Logic in Computer Science · Computer Science 2024-05-24 Michele Boreale , Daniele Gorla

Stochastic algorithms are efficient approaches to solving machine learning and optimization problems. In this paper, we propose a general framework called Splash for parallelizing stochastic algorithms on multi-node distributed systems.…

Machine Learning · Computer Science 2015-09-24 Yuchen Zhang , Michael I. Jordan

It is a long-standing objective to ease the computation burden incurred by the decision making process. Identification of this mechanism's sensitivity to simplification has tremendous ramifications. Yet, algorithms for decision making under…

Artificial Intelligence · Computer Science 2021-05-13 Andrey Zhitnikov , Vadim Indelman

We present a technique exploiting Datalog with aggregates to improve the performance of programs with arithmetic (in)equalities. Our approach employs a source-to-source program transformation which approximates the propagation technique…

Programming Languages · Computer Science 2011-12-19 Dario Campagna , Beata Sarna-Starosta , Tom Schrijvers

Motivated by the recent interest in approximate message passing (AMP) for matrix-valued linear observations with superposition of \emph{multiple statistically asymmetric signal sources}, we introduce a multi-source AMP framework in which…

Information Theory · Computer Science 2025-01-22 Burak Çakmak , Giuseppe Caire

In this paper, a sample-based procedure for obtaining simple and computable approximations of chance-constrained sets is proposed. The procedure allows to control the complexity of the approximating set, by defining families of…

Systems and Control · Electrical Eng. & Systems 2021-01-19 Martina Mammarella , Victor Mirasierra , Matthias Lorenzen , Teodoro Alamo , Fabrizio Dabbene

We present a novel statistical inference framework for convex empirical risk minimization, using approximate stochastic Newton steps. The proposed algorithm is based on the notion of finite differences and allows the approximation of a…

Machine Learning · Computer Science 2019-02-06 Tianyang Li , Anastasios Kyrillidis , Liu Liu , Constantine Caramanis

In this paper, we develop approximate dynamic programming methods for stochastic systems modeled as Markov Decision Processes, given both soft performance criteria and hard constraints in a class of probabilistic temporal logic called…

Optimization and Control · Mathematics 2018-10-08 Lening Li , Jie Fu