English
Related papers

Related papers: Uniform generation of large traces

200 papers

We present randomized algorithms for estimating the trace and deter- minant of Hermitian positive semi-definite matrices. The algorithms are based on subspace iteration, and access the matrix only through matrix vector products. We analyse…

Numerical Analysis · Mathematics 2017-02-17 Arvind K. Saibaba , Alen Alexanderian , Ilse C. F. Ipsen

We show a new simple algorithm that checks whether a given higher-order grammar generates a nonempty language of trees. The algorithm amounts to a procedure that transforms a grammar of order n to a grammar of order n-1, preserving…

Formal Languages and Automata Theory · Computer Science 2020-09-18 Paweł Parys

Despite strong performance on a variety of tasks, neural sequence models trained with maximum likelihood have been shown to exhibit issues such as length bias and degenerate repetition. We study the related issue of receiving…

Machine Learning · Computer Science 2020-10-06 Sean Welleck , Ilia Kulikov , Jaedeok Kim , Richard Yuanzhe Pang , Kyunghyun Cho

Random features are a powerful technique for rewriting positive-definite kernels as linear products. They bring linear tools to bear in important nonlinear domains like KNNs and attention. Unfortunately, practical implementations require…

Machine Learning · Computer Science 2024-10-25 Luke Sernau , Silvano Bonacina , Rif A. Saurous

Contrary to several other families of lambda terms, no closed formula or generating function is known and none of the sophisticated techniques devised in analytic combinatorics can currently help with counting or generating the set of {\em…

Programming Languages · Computer Science 2016-08-16 Paul Tarau

Despite their growing capabilities, language models still frequently reproduce content from their training data, generate repetitive text, and favor common grammatical patterns and vocabulary. A possible cause is the decoding strategy: the…

Computation and Language · Computer Science 2026-01-15 Giorgio Franceschelli , Mirco Musolesi

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

Do word embeddings converge to learn similar things over different initializations? How repeatable are experiments with word embeddings? Are all word embedding techniques equally reliable? In this paper we propose evaluating methods for…

Computation and Language · Computer Science 2016-05-13 Yingtao Tian , Vivek Kulkarni , Bryan Perozzi , Steven Skiena

With the advances of deep learning techniques, text generation is attracting increasing interest in the artificial intelligence (AI) community, because of its wide applications and because it is an essential component of AI. Traditional…

Computation and Language · Computer Science 2023-09-19 Lili Mou

This paper performs the analysis necessary to bound the running time of known, efficient algorithms for generating all longest common subsequences. That is, we bound the running time as a function of input size for algorithms with time…

Discrete Mathematics · Computer Science 2007-05-23 Ronald I. Greenberg

An approximate textual retrieval algorithm for searching sources with high levels of defects is presented. It considers splitting the words in a query into two overlapping segments and subsequently building composite regular expressions…

Information Retrieval · Computer Science 2007-05-23 Pere Constans

In this paper, a fully compressed pattern matching problem is studied. The compression is represented by straight-line programs (SLPs), i.e. a context-free grammars generating exactly one string; the term fully means that both the pattern…

Data Structures and Algorithms · Computer Science 2013-06-26 Artur Jeż

Rejection sampling is a popular method used to generate numbers that follow some given distribution. We study the use of this method to generate random numbers in the unit interval from increasing probability density functions. We focus on…

Data Structures and Algorithms · Computer Science 2025-09-30 Louis-Roy Langevin , Alex Waese-Perlman

The present work analyzes the redundancy of sets of combinatorial objects produced by a weighted random generation algorithm proposed by Denise et al. This scheme associates weights to the terminals symbols of a weighted context-free…

Data Structures and Algorithms · Computer Science 2010-12-07 Danièle Gardy , Yann Ponty

Workload traces are essential to understand complex computer systems' behavior and manage processing and memory resources. Since real-world traces are hard to obtain, synthetic trace generation is a promising alternative. This paper…

Software Engineering · Computer Science 2025-09-23 Donghyun Kim , Sriram Ravula , Taemin Ha , Alexandros G. Dimakis , Daehyeok Kim , Aditya Akella

This paper presents InfiniteAudio, a simple yet effective strategy for generating infinite-length audio using diffusion-based text-to-audio methods. Current approaches face memory constraints because the output size increases with input…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-04 Chaeyoung Jung , Hojoon Ki , Ji-Hoon Kim , Junmo Kim , Joon Son Chung

A promising class of generative models maps points from a simple distribution to a complex distribution through an invertible neural network. Likelihood-based training of these models requires restricting their architectures to allow cheap…

Machine Learning · Computer Science 2018-10-23 Will Grathwohl , Ricky T. Q. Chen , Jesse Bettencourt , Ilya Sutskever , David Duvenaud

The method of random projections has become very popular for large-scale applications in statistical learning, information retrieval, bio-informatics and other applications. Using a well-designed coding scheme for the projected data, which…

Machine Learning · Computer Science 2013-08-12 Ping Li , Michael Mitzenmacher , Anshumali Shrivastava

We present a tendency of large language models (LLMs) to generate absurd patterns despite their clear inappropriateness in a simple task of identifying regularities in number series. Several approaches have been proposed to apply LLMs to…

Computation and Language · Computer Science 2025-10-14 Shin-nosuke Ishikawa , Masato Todo , Taiki Ogihara , Hirotsugu Ohba

We present a deep generative model for unsupervised text style transfer that unifies previously proposed non-generative techniques. Our probabilistic approach models non-parallel data from two domains as a partially observed parallel…

Computation and Language · Computer Science 2020-05-01 Junxian He , Xinyi Wang , Graham Neubig , Taylor Berg-Kirkpatrick