English
Related papers

Related papers: Similarity encoding for learning with dirty catego…

200 papers

Examining the effect of different encoding techniques on entity and context embeddings, the goal of this work is to challenge commonly used Ordinal encoding for tabular learning. Applying different preprocessing methods and network…

Machine Learning · Computer Science 2024-03-29 Fredy Reusser

This paper deals with the problem of large-scale linear supervised learning in settings where a large number of continuous features are available. We propose to combine the well-known trick of one-hot encoding of continuous features with a…

Machine Learning · Statistics 2019-01-10 Mokhtar Z. Alaya , Simon Bussy , Stéphane Gaïffas , Agathe Guilloux

This work proposes and evaluates a novel approach to determine interesting categorical attributes for lists of entities. Once identified, such categories are of immense value to allow constraining (filtering) a current view of a user to…

Databases · Computer Science 2017-11-30 Koninika Pal , Sebastian Michel

Hierarchical categorical variables often exhibit many levels (high granularity) and many classes within each level (high dimensionality). This may cause overfitting and estimation issues when including such covariates in a predictive model.…

Methodology · Statistics 2024-08-20 Paul Wilsens , Katrien Antonio , Gerda Claeskens

Similarity query is the family of queries based on some similarity metrics. Unlike the traditional database queries which are mostly based on value equality, similarity queries aim to find targets "similar enough to" the given data objects,…

Databases · Computer Science 2022-04-19 Yifan Wang

Categorical data are present in key areas such as health or supply chain, and this data require specific treatment. In order to apply recent machine learning models on such data, encoding is needed. In order to build interpretable models,…

Machine Learning · Computer Science 2023-04-19 Paul Peseux , Maxime Berar , Thierry Paquet , Victor Nicollet

In this paper, we introduce the Vehicle Claims dataset, consisting of fraudulent insurance claims for automotive repairs. The data belongs to the more broad category of Auditing data, which includes also Journals and Network Intrusion data.…

Machine Learning · Computer Science 2022-10-27 Ajay Chawda , Stefanie Grimm , Marius Kloft

Curriculum learning can improve neural network training by guiding the optimization to desirable optima. We propose a novel curriculum learning approach for image classification that adapts the loss function by changing the label…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Urun Dogan , Aniket Anand Deshmukh , Marcin Machura , Christian Igel

We consider the problem of duplicate detection in noisy and incomplete data: given a large data set in which each record has multiple entries (attributes), detect which distinct records refer to the same real world entity. This task is…

Databases · Computer Science 2019-07-11 Yves van Gennip , Blake Hunter , Anna Ma , Daniel Moyer , Ryan de Vera , Andrea L. Bertozzi

Generative quantum machine learning models are trained to deduce the probability distribution underlying a given dataset, and to produce new, synthetic samples from it. The majority of such models proposed in the literature, like the…

Quantum Physics · Physics 2026-03-25 Michael Krebsbach , Florentin Reiter , Thomas Wellens , Hagen-Henrik Kowalski , Ali Abedi

Gathering training data is a key step of any supervised learning task, and it is both critical and expensive. Critical, because the quantity and quality of the training data has a high impact on the performance of the learned function.…

Data Structures and Algorithms · Computer Science 2021-10-28 Quentin Lutz , Élie de Panafieu , Alex Scott , Maya Stein

Categorical encoders transform categorical features into numerical representations that are indispensable for a wide range of machine learning models. Existing encoder benchmark studies lack generalizability because of their limited choice…

Machine Learning · Computer Science 2023-11-21 Federico Matteucci , Vadim Arzamasov , Klemens Boehm

Categorical data does not have an intrinsic definition of distance or order, and therefore, established visualization techniques for categorical data only allow for a set-based or frequency-based analysis, e.g., through Euler diagrams or…

Human-Computer Interaction · Computer Science 2025-01-15 Frederik L. Dennig , Lucas Joos , Patrick Paetzold , Daniela Blumberg , Oliver Deussen , Daniel A. Keim , Maximilian T. Fischer

Learning to hash is an efficient paradigm for exact and approximate nearest neighbor search from massive databases. Binary hash codes are typically extracted from an image by rounding output features from a CNN, which is trained on a…

Machine Learning · Computer Science 2020-05-12 Heikki Arponen , Tom E. Bishop

In this paper we consider the binary similarity problem that consists in determining if two binary functions are similar only considering their compiled form. This problem is know to be crucial in several application scenarios, such as…

Machine Learning · Computer Science 2018-11-14 Roberto Baldoni , Giuseppe Antonio Di Luna , Luca Massarelli , Fabio Petroni , Leonardo Querzoni

Encodings or the proof of their absence are the main way to compare process calculi. To analyse the quality of encodings and to rule out trivial or meaningless encodings, they are augmented with quality criteria. There exists a bunch of…

Logic in Computer Science · Computer Science 2015-08-28 Kirstin Peters , Rob van Glabbeek

Encoding a sequence of observations is an essential task with many applications. The encoding can become highly efficient when the observations are generated by a dynamical system. A dynamical system imposes regularities on the observations…

Machine Learning · Statistics 2018-05-29 Arash Mehrjou , Friedrich Solowjow , Sebastian Trimpe , Bernhard Schölkopf

We propose polar encoding, a representation of categorical and numerical $[0,1]$-valued attributes with missing values to be used in a classification context. We argue that this is a good baseline approach, because it can be used with any…

Machine Learning · Computer Science 2024-05-16 Oliver Urs Lenz , Daniel Peralta , Chris Cornelis

One-hot vectors, a common method for representing discrete/categorical data, in machine learning are widely used because of their simplicity and intuitiveness. However, one-hot vectors suffer from a linear increase in dimensionality, posing…

Machine Learning · Computer Science 2024-11-15 Masane Fuchi , Amar Zanashir , Hiroto Minami , Tomohiro Takagi

Binary code similarity detection is a core task in reverse engineering. It supports malware analysis and vulnerability discovery by identifying semantically similar code in different contexts. Modern methods have progressed from manually…

Artificial Intelligence · Computer Science 2025-09-30 Charles E. Gagnon , Steven H. H. Ding , Philippe Charland , Benjamin C. M. Fung