English
Related papers

Related papers: Counting Coordination Categorially

200 papers

Author presents a study of certain category of the integrals, which might look quite difficult to compute, but in fact are easily computable, because they do not depend on the parameter in the integrand. As simple and elementary the…

Mathematical Physics · Physics 2012-10-16 Valery Fabrikant

The attention mechanism is a critical component of Large Language Models (LLMs) that allows tokens in a sequence to interact with each other, but is order-invariant. Incorporating position encoding (PE) makes it possible to address by…

Computation and Language · Computer Science 2024-05-31 Olga Golovneva , Tianlu Wang , Jason Weston , Sainbayar Sukhbaatar

Learning causal structure from observational data is a fundamental challenge in machine learning. However, the majority of commonly used differentiable causal discovery methods are non-identifiable, turning this problem into a continuous…

Machine Learning · Computer Science 2022-09-30 Yu Wang , An Zhang , Xiang Wang , Yancheng Yuan , Xiangnan He , Tat-Seng Chua

In this paper, we propose a novel strategy which is designed to enhance the accuracy of the parser by simplifying complex sentences before parsing. This approach involves the separate parsing of the constituent sub-sentences within a…

cmp-lg · Computer Science 2008-02-03 Peh Li Shiuan , Christopher Ting Hian Ann

The goal of this paper is to design a causal inference method accounting for complex interactions between causal factors. The proposed method relies on a category theoretical reformulation of the definitions of dependent variables,…

Statistics Theory · Mathematics 2020-06-16 Rémy Tuyéras

We use a probabilistic method to produce some combinatorial inequalities by considering pattern containment in permutations and words.

Combinatorics · Mathematics 2007-05-23 Alexander I. Burstein

We develop a categorical compositional distributional semantics for Lambek Calculus with a Relevant Modality, which has a limited version of the contraction and permutation rules. The categorical part of the semantics is a monoidal biclosed…

Logic in Computer Science · Computer Science 2021-01-27 Lachlan McPheat , Mehrnoosh Sadrzadeh , Hadi Wazni , Gijs Wijnholds

There have been several efforts to extend distributional semantics beyond individual words, to measure the similarity of word pairs, phrases, and sentences (briefly, tuples; ordered sets of words, contiguous or noncontiguous). One way to…

Machine Learning · Computer Science 2013-10-21 Peter D. Turney

In this paper, we further develop the coordination control framework for discrete-event systems with both complete and partial observation. A new weaker sufficient condition for the computation of the supremal conditionally controllable…

Optimization and Control · Mathematics 2014-03-20 Jan Komenda , Tomáš Masopust , Jan H. van Schuppen

We explore a basic noise-free signaling scenario where coordination and communication are naturally merged. A random signal X_1,...,X_n is processed to produce a control signal or action sequence A_1,...,A_n, which is observed and further…

Information Theory · Computer Science 2011-08-19 Paul Cuff , Lei Zhao

Temporal grounding is the task of locating a specific segment from an untrimmed video according to a query sentence. This task has achieved significant momentum in the computer vision community as it enables activity grounding beyond…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Juncheng Li , Siliang Tang , Linchao Zhu , Wenqiao Zhang , Yi Yang , Tat-Seng Chua , Fei Wu , Yueting Zhuang

Despite ample evidence that our concepts, our cognitive architecture, and mathematics itself are all deeply compositional, few models take advantage of this structure. We therefore propose a radically compositional approach to computational…

Neurons and Cognition · Quantitative Biology 2019-11-18 Toby B. St Clere Smithe

Invariant inference algorithms such as interpolation-based inference and IC3/PDR show that it is feasible, in practice, to find inductive invariants for many interesting systems, but non-trivial upper bounds on the computational complexity…

Programming Languages · Computer Science 2022-08-17 Yotam M. Y. Feldman , Sharon Shoham

Coordinate descent algorithms solve optimization problems by successively performing approximate minimization along coordinate directions or coordinate hyperplanes. They have been used in applications for many years, and their popularity…

Optimization and Control · Mathematics 2015-02-18 Stephen J. Wright

Circuits based on sum-product structure have become a ubiquitous representation to compactly encode knowledge, from Boolean functions to probability distributions. By imposing constraints on the structure of such circuits, certain inference…

Artificial Intelligence · Computer Science 2025-02-25 Benjie Wang , Denis Deratani Mauá , Guy Van den Broeck , YooJung Choi

We cardinally and ordinally rank distribution functions (CDFs). We present a new class of statistics, maximal adjusted quantiles, and show that a statistic is invariant with respect to cardinal shifts, preserves least upper bounds with…

Theoretical Economics · Economics 2023-05-11 Christopher P. Chambers , Alan D. Miller

We propose a novel speculative decoding method tailored for multi-sample reasoning scenarios, such as self-consistency and Best-of-N sampling. Our method exploits the intrinsic consensus of parallel generation paths to synthesize…

Computation and Language · Computer Science 2025-03-10 Yiwei Li , Jiayi Shi , Shaoxiong Feng , Peiwen Yuan , Xinglin Wang , Yueqi Zhang , Ji Zhang , Chuyi Tan , Boyuan Pan , Yao Hu , Kan Li

Imprecise probability is concerned with uncertainty about which probability distributions to use. It has applications in robust statistics and machine learning. We look at programming language models for imprecise probability. Our…

Programming Languages · Computer Science 2024-10-31 Jack Liell-Cock , Sam Staton

For music indexing robust to sound degradations and scalable for big music catalogs, this scientific report presents an approach based on audio descriptors relevant to the music content and invariant to sound transformations (noise…

Signal Processing · Electrical Eng. & Systems 2024-03-04 Rémi Mignot , Geoffroy Peeters

Recent works show that discourse analysis benefits from modeling intra- and inter-sentential levels separately, where proper representations for text units of different granularities are desired to capture both the meaning of text units and…

Computation and Language · Computer Science 2022-05-05 Yifei Zhou , Yansong Feng