English
Related papers

Related papers: TL-RL-FusionNet: An Adaptive and Efficient Reinfor…

200 papers

Industrial systems demand reliable predictive maintenance strategies to enhance operational efficiency and reduce downtime. This paper introduces an integrated framework that leverages the capabilities of the Transformer model-based neural…

Machine Learning · Computer Science 2024-08-06 Yang Zhao , Jiaxi Yang , Wenbo Wang , Helin Yang , Dusit Niyato

Insider threat detection aims to identify malicious user behavior by analyzing logs that record user interactions. Due to the lack of fine-grained behavior-level annotations, detecting specific behavior-level anomalies within user behavior…

Cryptography and Security · Computer Science 2025-08-18 Yang Wang , Yaxin Zhao , Xinyu Jiao , Sihan Xu , Xiangrui Cai , Ying Zhang , Xiaojie Yuan

In recent years, meta-reinforcement learning (meta-RL) algorithm has been proposed to improve sample efficiency in the field of decision-making and control, enabling agents to learn new knowledge from a small number of samples. However,…

Machine Learning · Computer Science 2025-01-14 Chenyang Qi , Huiping Li , Panfeng Huang

Malicious URLs remain a primary vector for phishing, malware, and cyberthreats. This study proposes a hybrid deep learning framework combining \texttt{HashingVectorizer} n-gram analysis, SMOTE balancing, Isolation Forest anomaly filtering,…

Cryptography and Security · Computer Science 2025-12-04 Berkani Khaled , Zeraoulia Rafik

Change Detection is a crucial but extremely challenging task of remote sensing image analysis, and much progress has been made with the rapid development of deep learning. However, most existing deep learning-based change detection methods…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Yuhang Gan , Wenjie Xuan , Hang Chen , Juhua Liu , Bo Du

Most reinforcement learning (RL) methods only focus on learning a single task from scratch and are not able to use prior knowledge to learn other tasks more effectively. Context-based meta RL techniques are recently proposed as a possible…

Machine Learning · Computer Science 2022-08-01 Xu Han , Feng Wu

This work addresses the problem of tracking maneuvering objects with complex motion patterns, a task in which conventional methods often struggle due to their reliance on predefined motion models. We integrate a data-driven liquid neural…

Signal Processing · Electrical Eng. & Systems 2025-10-30 Minti Liu , Qinghua Guo , Cao Zeng , Yanguang Yu , Jun Li , Ming Jin

Large-scale pre-trained Vision-Language Models (VLMs) have significantly advanced transfer learning across diverse tasks. However, adapting these models with limited few-shot data often leads to overfitting, undermining their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yuncheng Guo , Xiaodong Gu

Cyber-attacks are becoming increasingly sophisticated and frequent, highlighting the importance of network intrusion detection systems. This paper explores the potential and challenges of using deep reinforcement learning (DRL) in network…

Cryptography and Security · Computer Science 2026-03-03 Wanrong Yang , Alberto Acuto , Yihang Zhou , Dominik Wojtczak

Jamming attacks are proliferating and pose a significant threat to the security of 5G and beyond networks. These attacks target 5G radio frequency (RF) domain and can disrupt the communication in wireless networks. While conventional…

Networking and Internet Architecture · Computer Science 2026-05-05 Samhita Kuili , Mohammadreza Amini , Burak Kantarci

E-commerce platforms and payment solution providers face increasingly sophisticated fraud schemes, ranging from identity theft and account takeovers to complex money laundering operations that exploit the speed and anonymity of digital…

Artificial Intelligence · Computer Science 2026-01-12 Cooper Lin , Yanting Zhang , Maohao Ran , Wei Xue , Hongwei Fan , Yibo Xu , Zhenglin Wan , Sirui Han , Yike Guo , Jun Song

We investigate a Federated Reinforcement Learning with Environment Heterogeneity (FRL-EH) framework, where local environments exhibit statistical heterogeneity. Within this framework, agents collaboratively learn a global policy by…

Machine Learning · Computer Science 2025-07-22 Ukjo Hwang , Songnam Hong

Federated Reinforcement Learning (FRL) offers a promising solution to various practical challenges in resource allocation for vehicle-to-everything (V2X) networks. However, the data discrepancy among individual agents can significantly…

Signal Processing · Electrical Eng. & Systems 2024-05-06 Kaidi Xu , Shenglong Zhou , Geoffrey Ye Li

Model-Free Reinforcement Learning has achieved meaningful results in stable environments but, to this day, it remains problematic in regime changing environments like financial markets. In contrast, model-based RL is able to capture some…

Machine Learning · Computer Science 2021-04-23 Eric Benhamou , David Saltiel , Serge Tabachnik , Sui Kai Wong , François Chareyron

In the face of increasing cyber threats, particularly ransomware attacks, there is a pressing need for advanced detection and analysis systems that adapt to evolving malware behaviours. Throughout the literature, using machine learning (ML)…

Cryptography and Security · Computer Science 2025-01-03 Jamil Ispahany , MD Rafiqul Islam , M. Arif Khan , MD Zahidul Islam

In this paper, we present an adaptive framework designed for the continuous detection, identification and classification of emerging attacks in network traffic. The framework employs a transformer encoder architecture, which captures hidden…

Cryptography and Security · Computer Science 2024-11-12 Frederic Adjewa , Moez Esseghir , Leila Merghem-Boulahia

In modern biomedical and econometric studies, longitudinal processes are often characterized by complex time-varying associations and abrupt regime shifts that are shared across correlated outcomes. Standard functional data analysis (FDA)…

Methodology · Statistics 2026-01-28 Baolin Chen , Mengfei Ran

Object recognition is a key enabler across industry and defense. As technology changes, algorithms must keep pace with new requirements and data. New modalities and higher resolution sensors should allow for increased algorithm robustness.…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Samuel Rivera , Joel Klipfel , Deborah Weeks

Reinforcement learning (RL) has become a pivotal technology in the post-training phase of large language models (LLMs). Traditional task-colocated RL frameworks suffer from significant scalability bottlenecks, while task-separated RL…

Detecting anomalies in time series data is crucial for finance, healthcare, sensor networks, and industrial monitoring applications. However, time series anomaly detection often suffers from sparse labels, complex temporal patterns, and…

Machine Learning · Computer Science 2026-01-07 Bahareh Golchin , Banafsheh Rekabdar , Danielle Justo