English
Related papers

Related papers: Counterexample to majority optimality in NICD with…

200 papers

In this paper we study non-interactive correlation distillation (NICD), a generalization of the study of noise sensitivity of boolean functions. We extend the model to NICD on trees. In this model there is a fixed undirected tree with…

Probability · Mathematics 2007-05-23 Elchanan Mossel , Ryan O'Donnell , Oded Regev , Jeffrey Steif , Benjamin Sudakov

We study two conjectures posed in the analysis of Boolean functions $f : \{-1, 1\}^n \to \{-1, 1\}$, in both of which, the Majority function plays a central role: the "Majority is Least Stable" (Benjamini et al., 1999) and the…

Computational Complexity · Computer Science 2026-04-09 Pritish Kamath , Ravi Kumar , Pasin Manurangsi

We investigate the performance of majority-logic decoding in both reversible and finite-time information erasure processes performed on macroscopic bits that contain $N$ microscopic binary units. While we show that for reversible erasure…

Statistical Mechanics · Physics 2019-03-19 Shiqi Sheng , Tim Herpich , Giovanni Diana , Massimiliano Esposito

We consider the problem of finding the $k^{th}$ highest element in a totally ordered set of $n$ elements (select), and partitioning a totally ordered set into the top $k$ and bottom $n-k$ elements (partition) using pairwise comparisons.…

Data Structures and Algorithms · Computer Science 2016-03-17 Mark Braverman , Jieming Mao , S. Matthew Weinberg

Noise Contrastive Estimation (NCE) has fueled major breakthroughs in representation learning and generative modeling. Yet a long-standing challenge remains: accurately estimating ratios between distributions that differ substantially, which…

Previous studies have typically assumed that large language models are unable to accurately perform arithmetic operations, particularly multiplication of >8 digits, and operations involving decimals and fractions, without the use of…

Machine Learning · Computer Science 2023-09-13 Zhen Yang , Ming Ding , Qingsong Lv , Zhihuan Jiang , Zehai He , Yuyi Guo , Jinfeng Bai , Jie Tang

In recent years, Large Language Models such as GPT-3 showed remarkable capabilities in performing NLP tasks in the zero and few shot settings. On the other hand, the experiments highlighted the difficulty of GPT-3 in carrying out tasks that…

Computation and Language · Computer Science 2023-04-24 Matteo Muffo , Aldo Cocco , Enrico Bertino

We study finite-time bit erasure in the context of majority-logic decoding. In particular, we calculate the minimum amount of work needed to erase a majority-logic bit when one has full control over the system dynamics. Although a single…

Statistical Mechanics · Physics 2021-04-01 Karel Proesmans , John Bechhoefer

It is widely known in the machine learning community that class noise can be (and often is) detrimental to inducing a model of the data. Many current approaches use a single, often biased, measurement to determine if an instance is noisy. A…

Machine Learning · Statistics 2014-03-11 Michael R. Smith , Tony Martinez

A quantum algorithm is exact if, on any input data, it outputs the correct answer with certainty (probability 1). A key question is: how big is the advantage of exact quantum algorithms over their classical counterparts: deterministic…

Quantum Physics · Physics 2014-07-11 Andris Ambainis

The (Non-Preemptive) Throughput Maximization problem is a natural and fundamental scheduling problem. We are given $n$ jobs, where each job $j$ is characterized by a processing time and a time window, contained in a global interval $[0,T)$,…

Data Structures and Algorithms · Computer Science 2026-04-01 Alexander Armbruster , Fabrizio Grandoni , Antoine Tinguely , Andreas Wiese

Suppose $Y^{n}$ is obtained by observing a uniform Bernoulli random vector $X^{n}$ through a binary symmetric channel. Courtade and Kumar asked how large the mutual information between $Y^{n}$ and a Boolean function $\mathsf{b}(X^{n})$…

Information Theory · Computer Science 2016-07-11 Nir Weinberger , Ofer Shayevitz

This letter presents an almost sure convergence of the zeroth-order mirror descent algorithm. The algorithm admits non-smooth convex functions and a biased oracle which only provides noisy function value at any desired point. We approximate…

Optimization and Control · Mathematics 2024-07-02 Anik Kumar Paul , Arun D Mahindrakar , Rachel K Kalaimani

Inexact computing aims to compute good solutions that require considerably less resource -- typically energy -- compared to computing exact solutions. While inexactness is motivated by concerns derived from technology scaling and Moore's…

Computational Complexity · Computer Science 2017-05-23 John Augustine , Krishna Palem , Parishkrati

Reversible logic represents the basis for many emerging technologies and has recently been intensively studied. However, most of the Boolean functions of practical interest are irreversible and must be embedded into a reversible function…

Emerging Technologies · Computer Science 2014-08-19 Mathias Soeken , Robert Wille , Oliver Keszocze , D. Michael Miller , Rolf Drechsler

The effectiveness of machine learning algorithms arises from being able to extract useful features from large amounts of data. As model and dataset sizes increase, dataset distillation methods that compress large datasets into significantly…

Machine Learning · Computer Science 2022-01-19 Timothy Nguyen , Roman Novak , Lechao Xiao , Jaehoon Lee

Knowledge Distillation (KD) is a common knowledge transfer algorithm used for model compression across a variety of deep learning based natural language processing (NLP) solutions. In its regular manifestations, KD requires access to the…

Computation and Language · Computer Science 2021-01-01 Ahmad Rashid , Vasileios Lioutas , Abbas Ghaddar , Mehdi Rezagholizadeh

We achieve essentially the largest possible separation between quantum and classical query complexities. We do so using a property-testing problem called Forrelation, where one needs to decide whether one Boolean function is highly…

Quantum Physics · Physics 2014-11-24 Scott Aaronson , Andris Ambainis

It has been proved that almost all $n$-bit Boolean functions have exact classical query complexity $n$. However, the situation seemed to be very different when we deal with exact quantum query complexity. In this paper, we prove that almost…

Computational Complexity · Computer Science 2014-09-30 Andris Ambainis , Jozef Gruska , Shenggen Zheng

Recent studies have demonstrated the great potential of Large Language Models (LLMs) serving as zero-shot relevance rankers. The typical approach involves making comparisons between pairs or lists of documents. Although effective, these…

Information Retrieval · Computer Science 2023-11-06 Weiwei Sun , Zheng Chen , Xinyu Ma , Lingyong Yan , Shuaiqiang Wang , Pengjie Ren , Zhumin Chen , Dawei Yin , Zhaochun Ren
‹ Prev 1 2 3 10 Next ›