English
Related papers

Related papers: A Truncation Approach for Fast Computation of Dist…

200 papers

We propose a model for deterministic distributed function computation by a network of identical and anonymous nodes, with bounded computation and storage capabilities that do not scale with the network size. Our goal is to characterize the…

Distributed, Parallel, and Cluster Computing · Computer Science 2009-07-28 Julien M. Hendrickx , Alex Olshevsky , John N. Tsitsiklis

The parallelism of Transformer-based models comes at the cost of their input max-length. Some studies proposed methods to overcome this limitation, but none of them reported the effectiveness of summarization as an alternative. In this…

Computation and Language · Computer Science 2024-03-20 Mirza Alim Mutasodirin , Radityo Eko Prasojo

Probabilistic graphical models are a key tool in machine learning applications. Computing the partition function, i.e., normalizing constant, is a fundamental task of statistical inference but it is generally computationally intractable,…

Machine Learning · Statistics 2020-01-29 Sungsoo Ahn , Michael Chertkov , Adrian Weller , Jinwoo Shin

Developed so far, multi-document summarization has reached its bottleneck due to the lack of sufficient training data and diverse categories of documents. Text classification just makes up for these deficiencies. In this paper, we propose a…

Computation and Language · Computer Science 2016-11-29 Ziqiang Cao , Wenjie Li , Sujian Li , Furu Wei

The basic goal of quantization for probability distribution is to reduce the number of values, which is typically uncountable, describing a probability distribution to some finite set and thus approximation of a continuous probability…

Probability · Mathematics 2021-01-27 Mrinal Kanti Roychowdhury

We consider the problem of directly optimizing a non-linear function of an outcome, where this outcome itself is the sum of many small contributions. The non-linearity of the function means that the problem is not equivalent to the…

Machine Learning · Statistics 2025-09-04 Benjamin Heymann , Otmane Sakhi

Motivated by a wide variety of applications, this paper introduces a general class of networks of stochastic loss systems in which congestion renders lost revenue due to customers or jobs being permanently removed from the system. We seek…

Networking and Internet Architecture · Computer Science 2022-05-12 Brendan Patch , Mark S. Squillante , Peter M. Van de Ven

A distributed computing approach to solve the curse of dimensionality, caused by the complex quantum system modeling, is discussed. With the help of Cannon's algorithm, the distributed computing transformation of numerical method for…

Quantum Physics · Physics 2025-01-22 Hui-hui Miao , Yuri Igorevich Ozhigov

We study optimization algorithms for the finite sum problems frequently arising in machine learning applications. First, we propose novel variants of stochastic gradient descent with a variance reduction property that enables linear…

Machine Learning · Computer Science 2017-07-06 Jakub Konečný

We propose and analyze an algorithm to approximate distribution functions and densities of perpetuities. Our algorithm refines an earlier approach based on iterating discretized versions of the fixed point equation that defines the…

Probability · Mathematics 2007-11-08 Margarete Knape , Ralph Neininger

We propose an algorithm for reduction of the problem of maximization of fraction of two functionals to the equivalent procedure including maximization of difference between the functionals and the solution of an equation of scalar unknown.…

Numerical Analysis · Mathematics 2011-06-20 Ivan P Smirnov

Quantum computing is presently undergoing rapid development to achieve a significant speedup promised in certain applications. Nonetheless, scaling quantum computers remains a formidable engineering challenge, prompting exploration of…

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

Optimization and Control · Mathematics 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu

Slow running or straggler tasks can significantly reduce computation speed in distributed computation. Recently, coding-theory-inspired approaches have been applied to mitigate the effect of straggling, through embedding redundancy in…

Machine Learning · Statistics 2018-01-24 Can Karakus , Yifan Sun , Suhas Diggavi , Wotao Yin

A reaction-diffusion problem with a Caputo time derivative is considered. An integral discretization scheme on a graded mesh along with a decomposition of the exact solution is proposed. The truncation error estimate of the discretization…

Numerical Analysis · Mathematics 2018-10-19 Zhongdi Cen , Jian Huang , Anbo Le , Aimin Xu

The Fourier transform is approximated over a finite domain using a Riemann sum. This Riemann sum is then expressed in terms of the discrete Fourier transform, which allows the sum to be computed with a fast Fourier transform algorithm more…

Numerical Analysis · Mathematics 2015-08-07 Jeremy Axelrod

We propose a new framework for Hamiltonian Monte Carlo (HMC) on truncated probability distributions with smooth underlying density functions. Traditional HMC requires computing the gradient of potential function associated with the target…

Machine Learning · Statistics 2017-09-12 Kexin Yi , Finale Doshi-Velez

This paper proposes a new theory and methodology to tackle the problem of unifying distributed analyses and inferences on shared parameters from multiple sources, into a single coherent inference. This surprisingly challenging problem…

Methodology · Statistics 2019-07-22 Hongsheng Dai , Murray Pollock , Gareth Roberts

It is common practice to partition complex workflows into separate channels in order to speed up their completion times. When this is done within a distributed environment, unavoidable fluctuations make individual realizations depart from…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-07-03 Bernardo A. Huberman , Freddy C. Chua

Distributed quantum computation is often proposed to increase the scalability of quantum hardware, as it reduces cooperative noise and requisite connectivity by sharing quantum information between distant quantum devices. However, such…

Quantum Physics · Physics 2023-09-13 Abigail McClain Gomez , Taylor L. Patti , Anima Anandkumar , Susanne F. Yelin
‹ Prev 1 3 4 5 6 7 10 Next ›