English
Related papers

Related papers: Probe-Geometry Alignment: Erasing the Cross-Sequen…

200 papers

We study the ability of Transformer models to learn sequences generated by Permuted Congruential Generators (PCGs), a widely used family of pseudo-random number generators (PRNGs). PCGs introduce substantial additional difficulty over…

Machine Learning · Computer Science 2026-02-18 Tao Tao , Maissam Barkeshli

It is imperative to ensure the stability of every prediction made by a language model; that is, a language's prediction should remain consistent despite minor input variations, like word substitutions. In this paper, we investigate the…

Computation and Language · Computer Science 2024-06-06 Qian Lou , Xin Liang , Jiaqi Xue , Yancheng Zhang , Rui Xie , Mengxin Zheng

Feature Squeezing is a recently proposed defense method which reduces the search space available to an adversary by coalescing samples that correspond to many different feature vectors in the original space into a single sample. It has been…

Machine Learning · Statistics 2018-03-28 Yash Sharma , Pin-Yu Chen

We consider the problem of extracting a maximum-size reflected network in a linear program. This problem has been studied before and a state-of-the-art SGA heuristic with two variations have been proposed. In this paper we apply a new…

Data Structures and Algorithms · Computer Science 2010-03-30 G. Gutin , D. Karapetyan , I. Razgon

Standard unlearning evaluations measure behavioral suppression in full precision, immediately after training, despite every deployed language model being quantized first. Recent work has shown that 4-bit post-training quantization can…

Machine Learning · Computer Science 2026-05-15 Saisab Sadhu , Pratinav Seth , Vinay Kumar Sankarapu

Although promising, existing defenses against query-based attacks share a common limitation: they offer increased robustness against attacks at the price of a considerable accuracy drop on clean samples. In this work, we show how to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Pascal Zimmer , Sébastien Andreina , Giorgia Azzurra Marson , Ghassan Karame

Camouflaged object detection (COD) approaches heavily rely on pixel-level annotated datasets. Weakly-supervised COD (WSCOD) approaches use sparse annotations like scribbles or points to reduce annotation effort, but this can lead to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jian Hu , Jiayi Lin , Weitong Cai , Shaogang Gong

Image recovery from compressive measurements requires a signal prior for the images being reconstructed. Recent work has explored the use of deep generative models with low latent dimension as signal priors for such problems. However, their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Niklas Smedemark-Margulies , Jung Yeon Park , Max Daniels , Rose Yu , Jan-Willem van de Meent , Paul Hand

Advances in compressive sensing provided reconstruction algorithms of sparse signals from linear measurements with optimal sample complexity, but natural extensions of this methodology to nonlinear inverse problems have been met with…

Information Theory · Computer Science 2020-08-25 Paul Hand , Oscar Leong , Vladislav Voroninski

Background: Significance analysis plays a major role in identifying and ranking genes, transcription factor binding sites, DNA methylation regions, and other high-throughput features for association with disease. We propose a new approach,…

Methodology · Statistics 2017-01-10 Andrew E. Jaffe , John D. Storey , Hongkai Ji , Jeffrey T. Leek

Overparameterization in deep learning is powerful: Very large models fit the training data perfectly and yet often generalize well. This realization brought back the study of linear models for regression, including ordinary least squares…

Machine Learning · Statistics 2022-04-07 Ningyuan Huang , David W. Hogg , Soledad Villar

Prompt injection poses a critical threat to the safe deployment of large language models, yet existing detection approaches are typically evaluated under limited settings that do not reflect real-world operating constraints. In this work,…

Computation and Language · Computer Science 2026-05-27 Akindoyin Akinrele , Shreyank N Gowda

Anomaly detection is a fundamental yet challenging problem in machine learning due to the lack of label information. In this work, we propose a novel and powerful framework, dubbed as SLA$^2$P, for unsupervised anomaly detection. After…

Machine Learning · Computer Science 2021-11-29 Yizhou Wang , Can Qin , Rongzhe Wei , Yi Xu , Yue Bai , Yun Fu

Probe-level models have led to improved performance in microarray studies but the various sources of probe-level contamination are still poorly understood. Data-driven analysis of probe performance can be used to quantify the uncertainty in…

Computational Engineering, Finance, and Science · Computer Science 2013-04-09 Leo Lahti , Laura L. Elo , Tero Aittokallio , Samuel Kaski

Protein language models have excelled in a variety of tasks, ranging from structure prediction to protein engineering. However, proteins are highly diverse in functions and structures, and current state-of-the-art models including the…

Biomolecules · Quantitative Biology 2023-02-27 Chang Ma , Haiteng Zhao , Lin Zheng , Jiayi Xin , Qintong Li , Lijun Wu , Zhihong Deng , Yang Lu , Qi Liu , Lingpeng Kong

Segmentation of Prostate Cancer (PCa) tissues from Gleason graded histopathology images is vital for accurate diagnosis. Although deep learning (DL) based segmentation methods achieve state-of-the-art accuracy, they rely on large datasets…

Image and Video Processing · Electrical Eng. & Systems 2021-10-04 Dwarikanath Mahapatra

Prompt injection defenses are often framed as semantic understanding problems and delegated to increasingly large neural detectors. For the first screening layer, however, the requirements are different: the detector runs on every request…

Cryptography and Security · Computer Science 2026-04-16 J Alex Corll

Deep learning can help uncover patterns in resting-state functional Magnetic Resonance Imaging (rs-fMRI) associated with psychiatric disorders and personal traits. Yet the problem of interpreting deep learning findings is rarely more…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Camila González , Yanis Miraoui , Yiran Fan , Ehsan Adeli , Kilian M. Pohl

Power side-channel analysis (SCA) has been of immense interest to most embedded designers to evaluate the physical security of the system. This work presents profiling-based cross-device power SCA attacks using deep learning techniques on…

Signal Processing · Electrical Eng. & Systems 2019-07-08 Anupam Golder , Debayan Das , Josef Danial , Santosh Ghosh , Shreyas Sen , Arijit Raychowdhury

The Predictive Associative Memory (PAM) framework posits that useful relationships often connect items that co-occur in shared contexts rather than items that appear similar in embedding space. A contrastive MLP trained on co-occurrence…

Machine Learning · Computer Science 2026-03-24 Jason Dury