English
Related papers

Related papers: SquirRL: Automating Attack Analysis on Blockchain …

200 papers

This paper studies a fundamental problem regarding the security of blockchain PoW consensus on how the existence of multiple misbehaving miners influences the profitability of selfish mining. Each selfish miner (or attacker interchangeably)…

Cryptography and Security · Computer Science 2023-04-04 Qianlan Bai , Yuedong Xu , Nianyi Liu , Xin Wang

We introduce Shielded RecRL, a reinforcement learning approach to generate personalized explanations for recommender systems without sacrificing the system's original ranking performance. Unlike prior RLHF-based recommender methods that…

Information Retrieval · Computer Science 2026-01-08 Ansh Tiwari , Ayush Chauhan

The core of a blockchain network is its consensus algorithm. Starting with the Proof-of-Work, there have been various versions of consensus algorithms, such as Proof-of-Stake (PoS), Proof-of-Authority (PoA), and Practical Byzantine Fault…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-12-10 Tariqul Islam , Faisal Haque Bappy , Tarannum Shaila Zaman , Md Sajidul Islam Sajid , Mir Mehedi Ahsan Pritom

Artificial intelligence (AI) has surpassed top human players in a variety of games. In imperfect information games, these achievements have primarily been driven by Counterfactual Regret Minimization (CFR) and its variants for computing…

Computer Science and Game Theory · Computer Science 2025-05-29 Qi Ju , Thomas Tellier , Meng Sun , Zhemei Fang , Yunfeng Luo

Bitcoin-NG is an extensible blockchain protocol based on the same trust model as Bitcoin. It divides each epoch into one Key-Block and multiple Micro-Blocks, effectively improving transaction processing capacity. Bitcoin-NG adopts a special…

Cryptography and Security · Computer Science 2023-06-07 Junjie Hu , Zhe Jiang , Chunxiang Xu

Reinforcement learning (RL) with tree search has demonstrated superior performance in traditional reasoning tasks. Compared to conventional independent chain sampling strategies with outcome supervision, tree search enables better…

Machine Learning · Computer Science 2025-06-16 Zhenyu Hou , Ziniu Hu , Yujiang Li , Rui Lu , Jie Tang , Yuxiao Dong

This paper considers the problem of designing optimal algorithms for reinforcement learning in two-player zero-sum games. We focus on self-play algorithms which learn the optimal policy by playing against itself without any direct…

Machine Learning · Computer Science 2020-07-15 Yu Bai , Chi Jin , Tiancheng Yu

We study an auction with $m$ identical items in a context where $n$ agents can arbitrarily commit to strategies. In general, such commitments non-trivially change the equilibria by inducing a metagame of choosing which strategies to commit…

Computer Science and Game Theory · Computer Science 2023-05-04 Daji Landis , Nikolaj I. Schwartzbach

Blockchain has recently been depicted as a secure protocol for information exchange in cyber-physical microgrids. However, it is still found vulnerable to consensus manipulation attacks. These stealth attacks are often difficult to detect…

Cryptography and Security · Computer Science 2023-03-09 Suman Rath , Lam Duc Nguyen , Subham Sahoo , Petar Popovski

Nowadays, federated recommendation technology is rapidly evolving to help multiple organisations share data and train models while meeting user privacy, data security and government regulatory requirements. However, federated recommendation…

Information Retrieval · Computer Science 2025-11-11 Jianhai Chen , Yanlin Wu , Dazhong Rong , Guoyao Yu , Lingqi Jiang , Zhenguang Liu , Peng Zhou , Rui Shen

Machine learning techniques are playing more and more important roles in finance market investment. However, finance quantitative modeling with conventional supervised learning approaches has a number of limitations. The development of deep…

Computational Finance · Quantitative Finance 2021-11-10 Zechu Li , Xiao-Yang Liu , Jiahao Zheng , Zhaoran Wang , Anwar Walid , Jian Guo

Given a dataset of expert demonstrations, inverse reinforcement learning (IRL) aims to recover a reward for which the expert is optimal. This work proposes a model-free algorithm to solve entropy-regularized IRL problem. In particular, we…

Machine Learning · Computer Science 2025-03-04 Titouan Renard , Andreas Schlaginhaufen , Tingting Ni , Maryam Kamgarpour

Preference-based Reinforcement Learning (PbRL) methods provide a solution to avoid reward engineering by learning reward models based on human preferences. However, poor feedback- and sample- efficiency still remain the problems that hinder…

Robotics · Computer Science 2026-05-22 Hexian Ni , Tao Lu , Haoyuan Hu , Yinghao Cai , Shuo Wang

Preference-based Reinforcement Learning (PbRL) replaces reward values in traditional reinforcement learning by preferences to better elicit human opinion on the target objective, especially when numerical reward values are hard to design or…

Machine Learning · Computer Science 2020-10-27 Yichong Xu , Ruosong Wang , Lin F. Yang , Aarti Singh , Artur Dubrawski

In recent years, phishing scams have become the crime type with the largest money involved on Ethereum, the second-largest blockchain platform. Meanwhile, graph neural network (GNN) has shown promising performance in various node…

Machine Learning · Computer Science 2021-06-21 Shucheng Li , Fengyuan Xu , Runchuan Wang , Sheng Zhong

Reinforcement learning (RL) algorithms aim to balance exploiting the current best strategy with exploring new options that could lead to higher rewards. Most common RL algorithms use undirected exploration, i.e., select random sequences of…

Machine Learning · Computer Science 2025-08-01 Bhavya Sukhija , Stelian Coros , Andreas Krause , Pieter Abbeel , Carmelo Sferrazza

Cooperation is fundamental for human prosperity. Blockchain, as a trust machine, is a cooperative institution in cyberspace that supports cooperation through distributed trust with consensus protocols. While studies in computer science…

General Economics · Economics 2023-01-23 Luyao Zhang , Xinyu Tian

We consider online no-regret learning in unknown games with bandit feedback, where each player can only observe its reward at each time -- determined by all players' current joint action -- rather than its gradient. We focus on the class of…

Machine Learning · Computer Science 2024-04-01 Wenjia Ba , Tianyi Lin , Jiawei Zhang , Zhengyuan Zhou

This paper considers a conjecture-based distributed learning approach that enables autonomous nodes to independently optimize their transmission probabilities in random access networks. We model the interaction among multiple…

Computer Science and Game Theory · Computer Science 2009-12-09 Yi Su , Mihaela van der Schaar

Smart contracts are stateful programs deployed on blockchains; they secure over a trillion dollars in transaction value per year. High-stakes smart contracts often rely on timely alerts about external events, but prior work has not analyzed…

Cryptography and Security · Computer Science 2026-04-14 Marwa Mouallem , Lorenz Breidenbach , Ittay Eyal , Ari Juels