English
Related papers

Related papers: Application of Tabular Transformer Architectures f…

200 papers

Fingerprints are one of the most copious evidence in a crime scene and, for this reason, they are frequently used by law enforcement for identification of individuals. But fingerprints can be altered. "Altered fingerprints", refers to…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Oliver Giudice , Mattia Litrico , Sebastiano Battiato

This study investigates the application of Transfer Learning (TL) on Transformer architectures to enhance building energy consumption forecasting. Transformers are a relatively new deep learning architecture, which has served as the…

Machine Learning · Computer Science 2024-11-22 Robert Spencer , Surangika Ranathunga , Mikael Boulic , Andries van Heerden , Teo Susnjak

The success of neural networks such as convolutional neural networks (CNNs) has been largely attributed to their effective and widespread deployment on customised computing platforms, including field-programmable gate arrays (FPGAs) and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-11-12 Zhuoheng Ran , Chong Wu , Renjie Xu , Maolin Che , Hong Yan

Security concerns for IoT applications have been alarming because of their widespread use in different enterprise systems. The potential threats to these applications are constantly emerging and changing, and therefore, sophisticated and…

Cryptography and Security · Computer Science 2022-04-12 Sk. Tanzir Mehedi , Adnan Anwar , Ziaur Rahman , Kawsar Ahmed , Rafiqul Islam

Website fingerprinting enables an eavesdropper to determine which websites a user is visiting over an encrypted connection. State-of-the-art website fingerprinting (WF) attacks have demonstrated effectiveness even against Tor-protected…

Cryptography and Security · Computer Science 2025-01-23 Xinhao Deng , Xiyuan Zhao , Qilei Yin , Zhuotao Liu , Qi Li , Mingwei Xu , Ke Xu , Jianping Wu

Fingerprint recognition is one of most popular and accuracy Biometric technologies. Nowadays, it is used in many real applications. However, recognizing fingerprints in poor quality images is still a very complex problem. In recent years,…

Computer Vision and Pattern Recognition · Computer Science 2011-07-19 Le Hoang Thai , Ha Nhat Tam

Tabular data, owing to its ubiquitous presence in real-world domains, has garnered significant attention in machine learning research. While tree-based models have long dominated tabular machine learning tasks, the recently proposed deep…

Machine Learning · Computer Science 2025-05-23 Zi-Jian Cheng , Zi-Yi Jia , Zhi Zhou , Yu-Feng Li , Lan-Zhe Guo

Deep learning has raised hopes and expectations as a general solution for many applications; indeed it has proven effective, but it also showed a strong dependence on large quantities of data. Luckily, it has been shown that, even when data…

Computer Vision and Pattern Recognition · Computer Science 2019-02-14 Fabio Maria Carlucci

Deep learning (DL) techniques have been used to support several code-related tasks such as code summarization and bug-fixing. In particular, pre-trained transformer models are on the rise, also thanks to the excellent results they achieved…

This thesis examines self-attention training through the lens of Optimal Transport (OT) and develops an OT-based alternative for tabular classification. The study tracks intermediate projections of the self-attention layer during training…

Machine Learning · Statistics 2026-02-19 Alessandro Quadrio , Antonio Candelieri

Transformer-based architectures have shown remarkable performance in vision and language tasks but pose unique challenges for safety-critical applications. This paper presents a conceptual framework for integrating Transformers into…

Software Engineering · Computer Science 2026-01-28 Sven Kirchner , Nils Purschke , Chengdong Wu , Alois Knoll

Sequential tabular data is one of the most commonly used data types in real-world applications. Different from conventional tabular data, where rows in a table are independent, sequential tabular data contains rich contextual and sequential…

Altered fingerprint recognition (AFR) is challenging for biometric verification in applications such as border control, forensics, and fiscal admission. Adversaries can deliberately modify ridge patterns to evade detection, so robust…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Dana A Abdullah , Dana Rasul Hamad , Bishar Rasheed Ibrahim , Sirwan Abdulwahid Aula , Aso Khaleel Ameen , Sabat Salih Hamadamin

Foundation models are an emerging research direction in tabular deep learning. Notably, TabPFNv2 recently claimed superior performance over traditional GBDT-based methods on small-scale datasets using an in-context learning paradigm, which…

Machine Learning · Computer Science 2025-06-12 Ivan Rubachev , Akim Kotelnikov , Nikolay Kartashev , Artem Babenko

When the available data for a target domain is limited, transfer learning (TL) methods can be used to develop models on related data-rich domains, before deploying them on the target domain. However, these TL methods are typically designed…

Statistical Finance · Quantitative Finance 2025-08-06 Ricardo Ribeiro Pereira , Jacopo Bono , Hugo Ferreira , Pedro Ribeiro , Carlos Soares , Pedro Bizarro

Network traffic prediction is essential for automating modern network management. It is a difficult time series forecasting (TSF) problem that has been addressed by Deep Learning (DL) models due to their ability to capture complex patterns.…

Networking and Internet Architecture · Computer Science 2026-01-07 Eilaf MA Babai , Aalaa MA Babai , Koji Okamura

Data-driven machine learning approaches have recently been proposed to facilitate wireless network optimization by learning latent knowledge from historical optimization instances. However, existing methods do not well handle the topology…

Networking and Internet Architecture · Computer Science 2021-01-06 Shuai Zhang , Bo Yin , Yu Cheng

Learning to compute, the ability to model the functional behavior of a circuit graph, is a fundamental challenge for graph representation learning. Yet, the dominant paradigm is architecturally mismatched for this task. This flawed…

Artificial Intelligence · Computer Science 2026-02-10 Ziyang Zheng , Jiaying Zhu , Jingyi Zhou , Qiang Xu

This paper proposes DeepMarks, a novel end-to-end framework for systematic fingerprinting in the context of Deep Learning (DL). Remarkable progress has been made in the area of deep learning. Sharing the trained DL models has become a trend…

Cryptography and Security · Computer Science 2018-04-11 Huili Chen , Bita Darvish Rohani , Farinaz Koushanfar

The increasing use of the Internet of Things raises security concerns. To address this, device fingerprinting is often employed to authenticate devices, detect adversaries, and identify eavesdroppers in an environment. This requires the…

Cryptography and Security · Computer Science 2025-12-23 Justin Feng , Amirmohammad Haddad , Nader Sehatbakhsh