English
Related papers

Related papers: User-Based Sequential Modeling with Transformer En…

200 papers

Deep neural networks are vulnerable to adversarial examples, which dramatically alter model output using small input changes. We propose Neural Fingerprinting, a simple, yet effective method to detect adversarial examples by verifying…

Machine Learning · Computer Science 2019-06-18 Sumanth Dathathri , Stephan Zheng , Tianwei Yin , Richard M. Murray , Yisong Yue

We propose a Perceiver-based sequence classifier to detect abnormalities in speech reflective of several neurological disorders. We combine this classifier with a Universal Speech Model (USM) that is trained (unsupervised) on 12 million…

Audio and Speech Processing · Electrical Eng. & Systems 2023-10-23 Hagen Soltau , Izhak Shafran , Alex Ottenwess , Joseph R. JR Duffy , Rene L. Utianski , Leland R. Barnard , John L. Stricker , Daniela Wiepert , David T. Jones , Hugo Botha

The emergence of deep learning led to the broad usage of neural networks in the time series domain for various applications, including finance and medicine. While powerful, these models are prone to adversarial attacks: a benign targeted…

Machine Learning · Computer Science 2025-03-03 Petr Sokerin , Dmitry Anikin , Sofia Krehova , Alexey Zaytsev

In recent years, numerous Transformer-based models have been applied to long-term time-series forecasting (LTSF) tasks. However, recent studies with linear models have questioned their effectiveness, demonstrating that simple linear layers…

Machine Learning · Computer Science 2024-08-20 Jiaheng Yin , Zhengxin Shi , Jianshen Zhang , Xiaomin Lin , Yulin Huang , Yongzhi Qi , Wei Qi

Anomaly detection in multivariate time series is a central challenge in industrial monitoring, as failures frequently arise from complex temporal dynamics and cross-sensor interactions. While recent deep learning models, including graph…

Machine Learning · Computer Science 2026-04-21 Pooyan Khosravinia , João Gama , Bruno Veloso

Recent studies have proposed integrating Chain-of-Thought (CoT) reasoning to further enhance the reliability of Code Language Models (CLMs) in generating code, a step-by-step approach that breaks down complex programming tasks into…

Software Engineering · Computer Science 2025-03-11 Naizhu Jin , Zhong Li , Yinggang Guo , Chao Su , Tian Zhang , Qingkai Zeng

Insider Attack Detection in commercial networks is a critical problem that does not have any good solutions at this current time. The problem is challenging due to the lack of visibility into live networks and a lack of a standard feature…

Cryptography and Security · Computer Science 2020-10-30 Yash Samtani , Jesse Elwell

To improve the identification of potential anomaly patterns in complex user behavior, this paper proposes an anomaly detection method based on a deep mixture density network. The method constructs a Gaussian mixture model parameterized by a…

Machine Learning · Computer Science 2025-05-20 Lu Dai , Wenxuan Zhu , Xuehui Quan , Renzi Meng , Sheng Chai , Yichen Wang

We propose TabTransformer, a novel deep tabular data modeling architecture for supervised and semi-supervised learning. The TabTransformer is built upon self-attention based Transformers. The Transformer layers transform the embeddings of…

Machine Learning · Computer Science 2020-12-15 Xin Huang , Ashish Khetan , Milan Cvitkovic , Zohar Karnin

DDoS attacks have become a major threat to the security of IoT devices and can cause severe damage to the network infrastructure. IoT devices suffer from the inherent problem of resource constraints and are therefore susceptible to such…

Cryptography and Security · Computer Science 2025-08-15 Sandipan Dey , Payal Santosh Kate , Vatsala Upadhyay , Abhishek Vaish

The rapid expansion of varied network systems, including the Internet of Things (IoT) and Industrial Internet of Things (IIoT), has led to an increasing range of cyber threats. Ensuring robust protection against these threats necessitates…

Cryptography and Security · Computer Science 2024-03-19 Md. Ashraf Uddin , Sunil Aryal , Mohamed Reda Bouadjenek , Muna Al-Hawawreh , Md. Alamin Talukder

Insider threat is one of the most pressing threats in the field of information security as it leads to huge financial losses by the companies. Most of the proposed methods for detecting this threat require expensive and invasive equipment,…

Cryptography and Security · Computer Science 2020-05-07 Azamat Sultanov , Konstantin Kogos

Analyzing sequence data usually leads to the discovery of interesting patterns and then anomaly detection. In recent years, numerous frameworks and methods have been proposed to discover interesting patterns in sequence data as well as…

Databases · Computer Science 2021-12-01 Wensheng Gan , Lili Chen , Shicheng Wan , Jiahui Chen , Chien-Ming Chen

Insider threats pose a significant challenge to organizational security, often evading traditional rule-based detection systems due to their subtlety and contextual nature. This paper presents an AI-powered Insider Risk Management (IRM)…

Cryptography and Security · Computer Science 2025-05-08 Lokesh Koli , Shubham Kalra , Rohan Thakur , Anas Saifi , Karanpreet Singh

Malicious server (MS) attacks have enabled the scaling of data stealing in federated learning to large batch sizes and secure aggregation, settings previously considered private. However, many concerns regarding the client-side…

Cryptography and Security · Computer Science 2024-04-16 Kostadin Garov , Dimitar I. Dimitrov , Nikola Jovanović , Martin Vechev

With the broad application of deep neural networks (DNNs), backdoor attacks have gradually attracted attention. Backdoor attacks are insidious, and poisoned models perform well on benign samples and are only triggered when given specific…

Machine Learning · Computer Science 2022-07-12 Chang Yue , Peizhuo Lv , Ruigang Liang , Kai Chen

Time series forecasting task predicts future trends based on historical information. Transformer-based U-Net architectures, despite their success in medical image segmentation, have limitations in both expressiveness and computation…

Machine Learning · Computer Science 2024-09-10 Jiang You , Arben Cela , René Natowicz , Jacob Ouanounou , Patrick Siarry

Businesses are naturally interested in detecting anomalies in their internal processes, because these can be indicators for fraud and inefficiencies. Within the domain of business intelligence, classic anomaly detection is not very…

Artificial Intelligence · Computer Science 2018-05-01 Timo Nolle , Stefan Luettgen , Alexander Seeliger , Max Mühlhäuser

In recent years, Artificial Intelligence has become a powerful partner for complex tasks such as data analysis, prediction, and problem-solving, yet its lack of transparency raises concerns about its reliability. In sensitive domains such…

Machine Learning · Computer Science 2026-03-10 Jesús Sánchez Ochoa , Enrique Tomás Martínez Beltrán , Alberto Huertas Celdrán

Intrusion detection poses a significant challenge within expansive and persistently interconnected environments. As malicious code continues to advance and sophisticated attack methodologies proliferate, various advanced deep learning-based…

Cryptography and Security · Computer Science 2024-02-01 Thua Huynh Trong , Thanh Nguyen Hoang