English
Related papers

Related papers: Communication Complexity of Permutation-Invariant …

200 papers

We consider a standard distributed optimisation setting where $N$ machines, each holding a $d$-dimensional function $f_i$, aim to jointly minimise the sum of the functions $\sum_{i = 1}^N f_i (x)$. This problem arises naturally in…

Machine Learning · Computer Science 2021-12-08 Dan Alistarh , Janne H. Korhonen

Given a real number beta>1, a permutation pi of length n is realized by the beta-shift if there is some x in [0,1] such that the relative order of the sequence x,f(x),...,f^{n-1}(x), where f(x) is the factional part of beta*x, is the same…

Combinatorics · Mathematics 2010-08-26 Sergi Elizalde

Simple function classes have emerged as toy problems to better understand in-context-learning in transformer-based architectures used for large language models. But previously proposed simple function classes like linear regression or…

Machine Learning · Computer Science 2024-07-30 Max Wilcoxson , Morten Svendgård , Ria Doshi , Dylan Davis , Reya Vir , Anant Sahai

Previous compact representations of permutations have focused on adding a small index on top of the plain data $<\pi(1), \pi(2),...\pi(n)>$, in order to efficiently support the application of the inverse or the iterated permutation. In this…

Data Structures and Algorithms · Computer Science 2011-08-23 Jérémy Barbay , Gonzalo Navarro

We construct an invariant of the bi-Lipschitz contact equivalence of continuous function germs definable in a polynomially bounded o-minimal structure, such as semialgebraic functions. For a germ $f,$ the invariant is given in terms of the…

Algebraic Geometry · Mathematics 2019-01-16 Tien-Son Pham , Nguyen Thao Nguyen Bui

We resolve the min-max complexity of distributed stochastic convex optimization (up to a log factor) in the intermittent communication setting, where $M$ machines work in parallel over the course of $R$ rounds of communication to optimize…

Machine Learning · Computer Science 2021-08-06 Blake Woodworth , Brian Bullins , Ohad Shamir , Nathan Srebro

In distributed systems, communication is a major concern due to issues such as its vulnerability or efficiency. In this paper, we are interested in estimating sparse inverse covariance matrices when samples are distributed into different…

Methodology · Statistics 2016-10-04 Jesús Arroyo , Elizabeth Hou

In this work we study oblivious complexity classes. These classes capture the power of interactive proofs where the prover(s) are only given the input size rather than the actual input. In particular, we study the connections between the…

Computational Complexity · Computer Science 2025-10-20 Karthik Gajulapalli , Zeyong Li , Ilya Volkovich

We introduce the notion of a weighted inversion statistic on the symmetric group, and examine its distribution on each conjugacy class. Our work generalizes the study of several common permutation statistics, including the number of…

Combinatorics · Mathematics 2023-05-18 Jesse Campion Loth , Michael Levet , Kevin Liu , Eric Nathan Stucky , Sheila Sundaram , Mei Yin

We show a partial Boolean function $f$ together with an input $x\in f^{-1}\left(*\right)$ such that both $C_{\bar{0}}\left(f,x\right)$ and $C_{\bar{1}}\left(f,x\right)$ are at least $C\left(f\right)^{2-o\left(1\right)}$. Due to recent…

Computational Complexity · Computer Science 2021-03-10 Kaspars Balodis

We study multivariate integration of functions that are invariant under permutations (of subsets) of their arguments. We find an upper bound for the $n$th minimal worst case error and show that under certain conditions, it can be bounded…

Numerical Analysis · Mathematics 2015-03-10 Dirk Nuyens , Gowri Suryanarayana , Markus Weimar

Functional principal components analysis is a popular tool for inference on functional data. Standard approaches rely on an eigendecomposition of a smoothed covariance surface in order to extract the orthonormal functions representing the…

Methodology · Statistics 2021-04-02 Tui H. Nolan , Jeff Goldsmith , David Ruppert

How hard is it to estimate a discrete-time signal $(x_{1}, ..., x_{n}) \in \mathbb{C}^n$ satisfying an unknown linear recurrence relation of order $s$ and observed in i.i.d. complex Gaussian noise? The class of all such signals is…

Statistics Theory · Mathematics 2025-01-13 Dmitrii M. Ostrovskii

Feature selection eliminates redundancy among features to improve downstream task performance while reducing computational overhead. Existing methods often struggle to capture intricate feature interactions and adapt across diverse…

Machine Learning · Computer Science 2026-03-02 Rui Liu , Tao Zhe , Yanjie Fu , Feng Xia , Ted Senator , Dongjie Wang

We prove the existence of (one-way) communication tasks with a subconstant versus superconstant asymptotic gap, which we call "doubly infinite," between their quantum information and communication complexities. We do so by studying the…

Quantum Physics · Physics 2016-05-09 Zi-Wen Liu , Christopher Perry , Yechao Zhu , Dax Enshan Koh , Scott Aaronson

The probabilistic satisfiability of a logical expression is a fundamental concept known as the partition function in statistical physics and field theory, an evaluation of a related graph's Tutte polynomial in mathematics, and the…

Discrete Mathematics · Computer Science 2022-06-09 Stephen Eubank , Madhurima Nath , Yihui Ren , Abhijin Adiga

An infinite permutation is a linear ordering of the set of non-negative integers. Generally, the properties of infinite permutations analogous to those of infinite words show some resemblances and some differences between permutations and…

Combinatorics · Mathematics 2009-11-09 S. V. Avgustinovich , A. E. Frid , T. Kamae , P. V. Salimov

This preliminary report addresses the expressive power of unit resolution regarding input data encoded with partial truth assignments of propositional variables. A characterization of the functions that are computable in this way, which we…

Artificial Intelligence · Computer Science 2011-06-20 Olivier Bailleux

Information theoretically secure multi-party computation (MPC) is a central primitive of modern cryptography. However, relatively little is known about the communication complexity of this primitive. In this work, we develop powerful…

Cryptography and Security · Computer Science 2014-04-15 Deepesh Data , Vinod M. Prabhakaran , Manoj M. Prabhakaran

An interactive function computation problem in a collocated network is studied in a distributed block source coding framework. With the goal of computing a desired function at the sink, the source nodes exchange messages through a sequence…

Information Theory · Computer Science 2016-11-17 Nan Ma , Prakash Ishwar