English
Related papers

Related papers: Policy-Value Guided MDP-MCTS Framework for Cyber K…

200 papers

Standard chain-of-thought reasoning generates a solution in a single forward pass, committing irrevocably to each token and lacking a mechanism to recover from early errors. We introduce Inference-Time Rethinking, a generative framework…

Computation and Language · Computer Science 2026-02-09 Deqian Kong , Minglu Zhao , Aoyang Qin , Bo Pang , Chenxin Tao , David Hartmann , Edouardo Honig , Dehong Xu , Amit Kumar , Matt Sarte , Chuan Li , Jianwen Xie , Ying Nian Wu

This paper studies the performance and resilience of a cyber-physical control system (CPCS) with attack detection and reactive attack mitigation. It addresses the problem of deriving an optimal sequence of false data injection attacks that…

Cryptography and Security · Computer Science 2017-06-07 Subhash Lakshminarayana , Teo Zhan Teng , David K. Y. Yau , Rui Tan

To solve the problem of lateral and logitudinal joint decision-making of multi-vehicle cooperative driving for connected and automated vehicles (CAVs), this paper proposes a Monte Carlo tree search (MCTS) method with parallel update for…

Multiagent Systems · Computer Science 2025-08-07 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang , Xingyu Hu , Songyu Weng

Backdoor (trojan) attacks embed hidden, controllable behaviors into machine-learning models so that models behave normally on benign inputs but produce attacker-chosen outputs when a trigger is present. This survey reviews the rapidly…

Cryptography and Security · Computer Science 2025-09-10 Bilal Hussain Abbasi , Yanjun Zhang , Leo Zhang , Shang Gao

The techniques and tactics used by cyber adversaries are becoming more sophisticated, ironically, as defense getting stronger and the cost of a breach continuing to rise. Understanding the thought processes and behaviors of adversaries is…

Cryptography and Security · Computer Science 2020-02-24 Stephen Moskal , Shanchieh Jay Yang

Defending from cyberattacks requires practitioners to operate on high-level adversary behavior. Cyberthreat intelligence (CTI) reports on past cyberattack incidents describe the chain of malicious actions with respect to time. To avoid…

Cryptography and Security · Computer Science 2024-01-04 Md Rayhanur Rahman , Brandon Wroblewski , Quinn Matthews , Brantley Morgan , Tim Menzies , Laurie Williams

Understanding adversarial behavior in cybersecurity has traditionally relied on high-level intelligence reports and manual interpretation of attack chains. However, real-time defense requires the ability to infer attacker intent and…

Cryptography and Security · Computer Science 2025-10-27 Soham Hans , Stacy Marsella , Sophia Hirschmann , Nikolos Gurney

Monte-Carlo Tree Search (MCTS) is one of the most-widely used methods for planning, and has powered many recent advances in artificial intelligence. In MCTS, one typically performs computations (i.e., simulations) to collect statistics…

Artificial Intelligence · Computer Science 2020-11-20 Eren Sezener , Peter Dayan

Value iteration is a powerful yet inefficient algorithm for Markov decision processes (MDPs) because it puts the majority of its effort into backing up the entire state space, which turns out to be unnecessary in many cases. In order to…

Artificial Intelligence · Computer Science 2014-01-17 Peng Dai , Mausam , Daniel Sabby Weld , Judy Goldsmith

In this paper we consider the problem of how a reinforcement learning agent tasked with solving a set of related Markov decision processes can use knowledge acquired early in its lifetime to improve its ability to more rapidly solve novel,…

Artificial Intelligence · Computer Science 2019-02-26 Francisco M. Garcia , Bruno C. da Silva , Philip S. Thomas

Deep Reinforcement Learning have achieved significant success in automatically devising effective traffic signal control (TSC) policies. Neural policies, however, tend to be over-parameterized and non-transparent, hindering their…

Machine Learning · Computer Science 2025-11-11 Xiao-Cheng Liao , Yi Mei , Mengjie Zhang

A formal cyber reasoning framework for automating the threat hunting process is described. The new cyber reasoning methodology introduces an operational semantics that operates over three subspaces -- knowledge, hypothesis, and action -- to…

Cryptography and Security · Computer Science 2021-04-22 Frederico Araujo , Dhilung Kirat , Xiaokui Shu , Teryl Taylor , Jiyong Jang

Interpretability of AI models allows for user safety checks to build trust in such AIs. In particular, Decision Trees (DTs) provide a global look at the learned model and transparently reveal which features of the input are critical for…

Machine Learning · Computer Science 2024-01-23 Hector Kohler , Riad Akrour , Philippe Preux

LLM-powered systems require complex multi-step decision-making abilities to solve real-world tasks, yet current planning approaches face a trade-off between the high latency of inference-time search and the limited generalization of…

Artificial Intelligence · Computer Science 2026-04-17 Xin Xie , Dongyun Xue , Wuguannan Yao , Mingxiao Feng , Wengang Zhou , Xiang Qi , Houqiang Li , Peng Zhang

Due to the popularity of the Internet and smart mobile devices, more and more financial transactions and activities have been digitalized. Compared to traditional financial fraud detection strategies using credit-related features, customers…

Machine Learning · Computer Science 2018-08-17 Ruinan Zhang , Fanglan Zheng , Wei Min

Rapidly-changing cloud environments that consist of heavily interconnected components are difficult to secure. Existing solutions often try to correlate many weak indicators to identify and reconstruct multi-step cyber attacks. The lack of…

Cryptography and Security · Computer Science 2020-09-28 Mario Kahlhofer , Michael Hölzl , Andreas Berger

The increasing connectivity and intricate remote access environment have made traditional perimeter-based network defense vulnerable. Zero trust becomes a promising approach to provide defense policies based on agent-centric trust…

Artificial Intelligence · Computer Science 2023-03-07 Yunfei Ge , Tao Li , Quanyan Zhu

Alpha factor mining is pivotal in quantitative investment for identifying predictive signals from complex financial data. While traditional formulaic alpha mining relies on human expertise, contemporary automated methods, such as those…

Artificial Intelligence · Computer Science 2025-11-13 Yu Shi , Yitong Duan , Jian Li

Precise estimation of Crash Modification Factors (CMFs) is central to evaluating the effectiveness of various road safety treatments and prioritizing infrastructure investment accordingly. While customized study for each countermeasure…

Machine Learning · Computer Science 2023-11-16 Yanlin Qi , Jia Li , Michael Zhang

We address a fundamental challenge in cybersecurity operations of translating governance frameworks into actionable mitigation decisions under realistic resource constraints. Frameworks such as the NIST Cybersecurity Framework (CSF) provide…

Cryptography and Security · Computer Science 2026-05-12 Philip Huff , Dakota Dale , Harshith Guduru , Rohan Singh , Qinghua Li