English
Related papers

Related papers: Training Transformers for Information Security Tas…

200 papers

Machine Learning models have been shown to be vulnerable to adversarial examples, ie. the manipulation of data by a attacker to defeat a defender's classifier at test time. We present a novel probabilistic definition of adversarial examples…

Machine Learning · Statistics 2018-01-09 Martin Gubri

Cyber security can be enhanced through application of machine learning by recasting network attack data into an image format, then applying supervised computer vision and other machine learning techniques to detect malicious specimens.…

Machine Learning · Computer Science 2021-11-04 Erik Larsen , Korey MacVittie , John Lilly

Semi-supervised machine learning models learn from a (small) set of labeled training examples, and a (large) set of unlabeled training examples. State-of-the-art models can reach within a few percentage points of fully-supervised training,…

Machine Learning · Computer Science 2021-08-11 Nicholas Carlini

Browsers often include security features to detect phishing web pages. In the past, some browsers evaluated an unknown URL for inclusion in a list of known phishing pages. However, as the number of URLs and known phishing pages continued to…

Cryptography and Security · Computer Science 2021-08-30 Pranav Maneriker , Jack W. Stokes , Edir Garcia Lazo , Diana Carutasu , Farid Tajaddodianfar , Arun Gururajan

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

Machine learning (ML)-based network intrusion detection is susceptible to attacks that perturb malicious network flows to evade detection. Existing approaches to evaluating the robustness of these models rely on gradient-based optimization…

Cryptography and Security · Computer Science 2026-05-15 Kyle Domico , Jean-Charles Noirot Ferrand , Patrick McDaniel

Meta-learning is a branch of machine learning which aims to quickly adapt models, such as neural networks, to perform new tasks by learning an underlying structure across related tasks. In essence, models are being trained to learn new…

Machine learning (ML) models that learn and predict properties of computer programs are increasingly being adopted and deployed. These models have demonstrated success in applications such as auto-completing code, summarizing large…

Machine Learning · Computer Science 2021-03-23 Shashank Srikant , Sijia Liu , Tamara Mitrovska , Shiyu Chang , Quanfu Fan , Gaoyuan Zhang , Una-May O'Reilly

Incorporating metadata in Large Language Models (LLMs) pretraining has recently emerged as a promising approach to accelerate training. However prior work highlighted only one useful signal-URLs, leaving open the question of whether other…

Computation and Language · Computer Science 2026-04-21 Dongyang Fan , Diba Hashemi , Sai Praneeth Karimireddy , Martin Jaggi

Large transformer models pretrained on offline reinforcement learning datasets have demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they can make good decisions when prompted with interaction…

Machine Learning · Computer Science 2024-05-28 Licong Lin , Yu Bai , Song Mei

Malicious URLs provide adversarial opportunities across various industries, including transportation, healthcare, energy, and banking which could be detrimental to business operations. Consequently, the detection of these URLs is of crucial…

Cryptography and Security · Computer Science 2024-03-06 Ehsan Nowroozi , Nada Jadalla , Samaneh Ghelichkhani , Alireza Jolfaei

Large Language Models (LLMs) have greatly advanced Natural Language Processing (NLP), particularly through instruction tuning, which enables broad task generalization without additional fine-tuning. However, their reliance on large-scale…

Computation and Language · Computer Science 2026-04-21 San Kim , Gary Geunbae Lee

Large language models (LLMs) have significantly benefited from training on diverse, high-quality task-specific data, leading to impressive performance across a range of downstream applications. Current methods often rely on human-annotated…

Computation and Language · Computer Science 2024-10-23 Qintong Li , Jiahui Gao , Sheng Wang , Renjie Pi , Xueliang Zhao , Chuan Wu , Xin Jiang , Zhenguo Li , Lingpeng Kong

Pre-training large transformer models with in-domain data improves domain adaptation and helps gain performance on the domain-specific downstream tasks. However, sharing models pre-trained on potentially sensitive data is prone to…

Computation and Language · Computer Science 2025-08-14 Ying Yin , Ivan Habernal

The exponential increase in dependencies between the cyber and physical world leads to an enormous amount of data which must be efficiently processed and stored. Therefore, computing paradigms are evolving towards machine learning…

Machine Learning · Computer Science 2019-04-09 Faiq Khalid , Muhammad Abdullah Hanif , Semeen Rehman , Muhammad Shafique

A salient characteristic of pre-trained language models (PTLMs) is a remarkable improvement in their generalization capability and emergence of new capabilities with increasing model capacity and pre-training dataset size. Consequently, we…

Learning from demonstrations has made great progress over the past few years. However, it is generally data hungry and task specific. In other words, it requires a large amount of data to train a decent model on a particular task, and the…

Machine Learning · Computer Science 2021-03-29 Pin Wang , Hanhan Li , Ching-Yao Chan

Large Language Models (LLMs) can acquire unintended biases from seemingly benign training data even without explicit cues or malicious content. Existing methods struggle to detect such risks before fine-tuning, making post hoc evaluation…

Machine Learning · Computer Science 2026-02-05 Mengru Wang , Zhenqian Xu , Junfeng Fang , Yunzhi Yao , Shumin Deng , Huajun Chen , Ningyu Zhang

The use of supervised Machine Learning (ML) to enhance Intrusion Detection Systems has been the subject of significant research. Supervised ML is based upon learning by example, demanding significant volumes of representative instances for…

Cryptography and Security · Computer Science 2022-11-08 Hanan Hindy , Christos Tachtatzis , Robert Atkinson , David Brosset , Miroslav Bures , Ivan Andonovic , Craig Michie , Xavier Bellekens

Malicious URLs persistently threaten the cybersecurity ecosystem, by either deceiving users into divulging private data or distributing harmful payloads to infiltrate host systems. Gaining timely insights into the current state of this…

Cryptography and Security · Computer Science 2025-06-03 Ye Tian , Yanqiu Yu , Jianguo Sun , Yanbin Wang