English
Related papers

Related papers: User-Based Sequential Modeling with Transformer En…

200 papers

An ever-growing number of vulnerabilities are reported every day. Yet these vulnerabilities are not all the same; Some are more targeted than others. Correctly estimating the likelihood of a vulnerability being exploited is a critical task…

Cryptography and Security · Computer Science 2023-04-21 Hadi Eskandari , Michael Bewong , Sabih ur Rehman

Machine-learning based intrusion detection classifiers are able to detect unknown attacks, but at the same time, they may be susceptible to evasion by obfuscation techniques. An adversary intruder which possesses a crucial knowledge about a…

Cryptography and Security · Computer Science 2019-04-16 Ivan Homoliak , Martin Teknos , Martín Ochoa , Dominik Breitenbacher , Saeid Hosseini , Petr Hanacek

Network intrusion detection, a well-explored cybersecurity field, has predominantly relied on supervised learning algorithms in the past two decades. However, their limitations in detecting only known anomalies prompt the exploration of…

Cryptography and Security · Computer Science 2025-10-06 Hamed Fard , Tobias Schalau , Gerhard Wunder

Intrusion Detection Systems are widely used to detect cyberattacks, especially on protocols vulnerable to hacking attacks such as SOME/IP. In this paper, we present a deep learning-based sequential model for offline intrusion detection on…

Cryptography and Security · Computer Science 2021-10-12 Natasha Alkhatib , Hadi Ghauch , Jean-Luc Danger

With the development of autonomous vehicle technology, the controller area network (CAN) bus has become the de facto standard for an in-vehicle communication system because of its simplicity and efficiency. However, without any encryption…

Cryptography and Security · Computer Science 2022-04-05 Thien-Nu Hoang , Daehee Kim

Insider threat detection is difficult because malicious behavior is rare, irregular, and buried in long periods of inactivity. In enterprise audit data, most windows contain little activity, while attacks appear intermittently and range…

Cryptography and Security · Computer Science 2026-05-01 Hayden Beadles , Jericho Cain

User embeddings play a crucial role in user engagement forecasting and personalized services. Recent advances in sequence modeling have sparked interest in learning user embeddings from behavioral data. Yet behavior-based user embedding…

Social and Information Networks · Computer Science 2024-03-21 Zhihan Zhou , Qixiang Fang , Leonardo Neves , Francesco Barbieri , Yozen Liu , Han Liu , Maarten W. Bos , Ron Dotsch

Adversarial robustness of deep models is pivotal in ensuring safe deployment in real world settings, but most modern defenses have narrow scope and expensive costs. In this paper, we propose a self-supervised method to detect adversarial…

Cryptography and Security · Computer Science 2021-09-01 Mazda Moayeri , Soheil Feizi

User-generated data is crucial to predictive modeling in many applications. With a web/mobile/wearable interface, a data owner can continuously record data generated by distributed users and build various predictive models from the data to…

Cryptography and Security · Computer Science 2019-05-02 Sagar Sharma , Keke Chen

Robustness of machine learning models is critical for security related applications, where real-world adversaries are uniquely focused on evading neural network based detectors. Prior work mainly focus on crafting adversarial examples (AEs)…

Machine Learning · Computer Science 2021-11-01 Ecenaz Erdemir , Jeffrey Bickford , Luca Melis , Sergul Aydore

In this paper, we assess the viability of transformer models in end-to-end InfoSec settings, in which no intermediate feature representations or processing steps occur outside the model. We implement transformer models for two distinct…

Machine Learning · Computer Science 2022-12-07 Ethan M. Rudd , Mohammad Saidur Rahman , Philip Tully

Multimodal contrastive learning uses various data modalities to create high-quality features, but its reliance on extensive data sources on the Internet makes it vulnerable to backdoor attacks. These attacks insert malicious behaviors…

Cryptography and Security · Computer Science 2024-10-01 Kuanrong Liu , Siyuan Liang , Jiawei Liang , Pengwen Dai , Xiaochun Cao

This paper proposes an algorithm based on a staged sliding window Transformer architecture to detect abnormal behaviors in the microstructure of the foreign exchange market, focusing on high-frequency EUR/USD trading data. The method…

Machine Learning · Computer Science 2025-04-02 Qiuliuyang Bao , Jiawei Wang , Hao Gong , Yiwei Zhang , Xiaojun Guo , Hanrui Feng

It is common practice to outsource the training of machine learning models to cloud providers. Clients who do so gain from the cloud's economies of scale, but implicitly assume trust: the server should not deviate from the client's training…

Cryptography and Security · Computer Science 2025-04-02 Hengrui Jia , Sierra Wyllie , Akram Bin Sediq , Ahmed Ibrahim , Nicolas Papernot

Anomaly-based Intrusion Detection Systems (IDSs) ensure protection against malicious attacks on networked systems. While deep learning-based IDSs achieve effective performance, their limited trustworthiness due to black-box architectures…

Cryptography and Security · Computer Science 2026-04-21 Francesco Vitale , Francesco Grimaldi , Massimiliano Rak , Nicola Mazzocca

To capture user preference, transformer models have been widely applied to model sequential user behavior data. The core of transformer architecture lies in the self-attention mechanism, which computes the pairwise attention scores in a…

Information Retrieval · Computer Science 2024-04-05 Zhen Tian , Wayne Xin Zhao , Changwang Zhang , Xin Zhao , Zhongrui Ma , Ji-Rong Wen

In this work, we investigate the time series representation learning problem using self-supervised techniques. Contrastive learning is well-known in this area as it is a powerful method for extracting information from the series and…

Machine Learning · Computer Science 2024-10-08 Duy A. Nguyen , Trang H. Tran , Huy Hieu Pham , Phi Le Nguyen , Lam M. Nguyen

Sequential user modeling, a critical task in personalized recommender systems, focuses on predicting the next item a user would prefer, requiring a deep understanding of user behavior sequences. Despite the remarkable success of…

Artificial Intelligence · Computer Science 2023-10-10 Hao Wang , Jianxun Lian , Mingqi Wu , Haoxuan Li , Jiajun Fan , Wanyue Xu , Chaozhuo Li , Xing Xie

Session-based recommendation is the task of predicting the next item a user will interact with, often without access to historical user data. In this work, we introduce Sequential Masked Modeling, a novel approach for encoder-only…

Information Retrieval · Computer Science 2024-10-16 Anis Redjdal , Luis Pinto , Michel Desmarais

We introduce an online outlier detection algorithm to detect outliers in a sequentially observed data stream. For this purpose, we use a two-stage filtering and hedging approach. In the first stage, we construct a multi-modal probability…

Machine Learning · Computer Science 2018-03-13 Mohammadreza Mohaghegh Neyshabouri , Suleyman Serdar Kozat