Related papers: The Transpension Type: Technical Report
Modeling the parser state is key to good performance in transition-based parsing. Recurrent Neural Networks considerably improved the performance of transition-based systems by modelling the global state, e.g. stack-LSTM parsers, or local…
Sleep staging is essential for sleep assessment and plays a vital role as a health indicator. Many recent studies have devised various machine learning as well as deep learning architectures for sleep staging. However, two key challenges…
Transductive learning is a supervised machine learning task in which, unlike in traditional inductive learning, the unlabelled data that require labelling are a finite set and are available at training time. Similarly to inductive learning…
In this paper, we consider five possible extensions of the Pr\"ufer domain notion to the case of commutative rings with zero divisors. We investigate the transfer of these Pr\"ufer-like properties between a commutative ring and its subring…
The technique known as Grilliot's trick constitutes a template for explicitly defining the Turing jump functional $(\exists^2)$ in terms of a given effectively discontinuous type two functional. In this paper, we discuss the standard…
Transfer learning assumes classifiers of similar tasks share certain parameter structures. Unfortunately, modern classifiers uses sophisticated feature representations with huge parameter spaces which lead to costly transfer. Under the…
We generalise sheaf models of intuitionistic logic to univalent type theory over a small category with a Grothendieck topology. We use in a crucial way that we have constructive models of univalence, that can then be relativized to any…
We establish and advocate for a novel branch of category theory, centered around strong dinatural transformations (herein known as "paranatural transformations"). Paranatural transformations generalize natural transformations to…
Mechanistic interpretability (MI) is an emerging sub-field of interpretability that seeks to understand a neural network model by reverse-engineering its internal computations. Recently, MI has garnered significant attention for…
Although the Transformer translation model (Vaswani et al., 2017) has achieved state-of-the-art performance in a variety of translation tasks, how to use document-level context to deal with discourse phenomena problematic for Transformer…
A transfer is a group homomorphism from a finite group to an abelian quotient group of a subgroup of the group. In this paper, we explain some of the properties of transfers by using noncommutative determinants. These properties enable us…
Inference tasks such as answer sentence selection (AS2) or fact verification are typically solved by fine-tuning transformer-based models as individual sentence-pair classifiers. Recent studies show that these tasks benefit from modeling…
We define a relation that describes the ternary commutator for congruence modular varieties. Properties of this relation are used to investigate the theory of the higher commutator for congruence modular varieties.
Transformer architecture has widespread applications, particularly in Natural Language Processing and computer vision. Recently Transformers have been employed in various aspects of time-series analysis. This tutorial provides an overview…
In the last few years, Lopez-Permouth and several collaborators have introduced a new approach in the study of the classical projectivity, injectivity and flatness of modules. This way, they introduced subprojectivity domains of modules as…
The goal of this work is to study positivity of subvarieties with nef normal bundle in the sense of intersection theory. After Ottem's work on ample subschemes, we introduce the notion of a nef subscheme, which generalizes the notion of a…
Understanding the inner workings of machine learning models like Transformers is vital for their safe and ethical use. This paper provides a comprehensive analysis of a one-layer Transformer model trained to perform n-digit integer…
This thesis is an exposition of the author's contribution on effective descent morphisms in various categories of generalized categorical structures. It consists of: Chapter 1, where an elementary description of descent theory and the…
Can prelife proceed without cell division? A recently proposed mechanism suggests that transient compartmentalization could have preceded cell division in prebiotic scenarios. Here, we study transient compartmentalization dynamics in the…
We investigated the feasibility of predicting Medical Subject Headings (MeSH) Publication Types (PTs) from MEDLINE citation metadata using pre-trained Transformer-based models BERT and DistilBERT. This study addresses limitations in the…