English
Related papers

Related papers: SpectralGuard: Detecting Memory Collapse Attacks i…

200 papers

State space models (SSMs) for language modelling promise an efficient and performant alternative to quadratic-attention Transformers, yet show variable performance on recalling basic information from the context. While performance on…

Computation and Language · Computer Science 2026-02-02 Aryaman Arora , Neil Rathi , Nikil Roashan Selvam , Róbert Csordás , Dan Jurafsky , Christopher Potts

State Space Models (SSMs)-most notably RNNs-have historically played a central role in sequential modeling. Although attention mechanisms such as Transformers have since dominated due to their ability to model global context, their…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Hyun-kyu Ko , Youbin Kim , Jihyeon Park , Dongheok Park , Gyeongjin Kang , Wonjun Cho , Hyung Yi , Eunbyung Park

State-Space Models (SSMs), and particularly Mamba, have recently emerged as a promising alternative to Transformers. Mamba introduces input selectivity to its SSM layer (S6) and incorporates convolution and gating into its block definition.…

Machine Learning · Computer Science 2025-06-16 Ningyuan Huang , Miguel Sarabia , Abhinav Moudgil , Pau Rodriguez , Luca Zappella , Federico Danieli

Visual language models (VLMs) have made significant progress in image captioning tasks, yet recent studies have found they are vulnerable to backdoor attacks. Attackers can inject undetectable perturbations into the data during inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Shuhan Xu , Siyuan Liang , Hongling Zheng , Aishan Liu , Xinbiao Wang , Yong Luo , Fu Lin , Leszek Rutkowski , Dacheng Tao

Efficiently modeling sequences with infinite context length has long been a challenging problem. Previous approaches have either suffered from quadratic computational complexity or limited extrapolation ability in length generalization. In…

Computation and Language · Computer Science 2025-03-03 Liliang Ren , Yang Liu , Yadong Lu , Yelong Shen , Chen Liang , Weizhu Chen

Audio super-resolution aims to enhance low-resolution signals by creating high-frequency content. In this work, we modify the architecture of AERO (a state-of-the-art system for this task) for music super-resolution. SPecifically, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-13 Wallace Abreu , Luiz Wagner Pereira Biscainho

Radiography imaging protocols target on specific anatomical regions, resulting in highly consistent images with recurrent structural patterns across patients. Recent advances in medical anomaly detection have demonstrated the effectiveness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-28 Rui Pan , Ruiying Lu

The primary tools used to monitor and defend object detectors under adversarial attack assume that when accuracy degrades, detection count drops in tandem. This coupling was assumed, not measured. We report a counterexample observed on a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Daye Kang , Hyeongboo Baek

Large Language Model (LLM) agents use memory to learn from past interactions, enabling autonomous planning and decision-making in complex environments. However, this reliance on memory introduces a critical security risk: an adversary can…

Cryptography and Security · Computer Science 2025-10-06 Qianshan Wei , Tengchao Yang , Yaochen Wang , Xinfeng Li , Lijun Li , Zhenfei Yin , Yi Zhan , Thorsten Holz , Zhiqiang Lin , XiaoFeng Wang

Loss explosions in training deep neural networks can nullify multi-million dollar training runs. Conventional monitoring metrics like weight and gradient norms are often lagging and ambiguous predictors, as their values vary dramatically…

Machine Learning · Computer Science 2025-10-07 Haiquan Qiu , You Wu , Yingjie Tan , Yaqing Wang , Quanming Yao

Vision Mambas (ViMs) achieve remarkable success with sub-quadratic complexity, but their efficiency remains constrained by quadratic token scaling with image resolution. While existing methods address token redundancy, they overlook ViMs'…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yan Wen , Peng Ye , Lin Zhang , Baopu Li , Jiakang Yuan , Yaoxin Yang , Tao Chen

Bidirectional Associative Memory (BAM) trained with Bidirectional Backpropagation (B-BP) often suffers from poor robustness and high sensitivity to noise and adversarial attacks. To address these issues, we propose a novel gradient-free…

Machine Learning · Computer Science 2025-11-18 Ci Lin , Tet Yeap , Iluju Kiringa , Biwei Zhang

Persistent external memory enables LLM agents to maintain context across sessions, yet its security properties remain formally uncharacterized. We formalize memory poisoning attacks on retrieval-augmented agents as a Stackelberg game with a…

Cryptography and Security · Computer Science 2026-05-08 Ishrith Gowda

State space models (SSMs) are a promising alternative to transformers for language modeling because they use fixed memory during inference. However, this fixed memory usage requires some information loss in the hidden state when processing…

Computation and Language · Computer Science 2025-12-18 Tamanna Hossain , Robert L. Logan , Ganesh Jagadeesan , Sameer Singh , Joel Tetreault , Alejandro Jaimes

Recently, recurrent models based on linear state space models (SSMs) have shown promising performance in language modeling (LM), competititve with transformers. However, there is little understanding of the in-principle abilities of such…

Computation and Language · Computer Science 2025-12-15 Yash Sarrof , Yana Veitsman , Michael Hahn

Linear State Space Models (SSMs) offer remarkable performance gains in efficient sequence modeling, with constant inference-time computation and memory complexity. Recent advances, such as Mamba, further enhance SSMs with input-dependent…

Machine Learning · Computer Science 2025-06-24 Zheng Zhan , Liliang Ren , Shuohang Wang , Liyuan Liu , Yang Liu , Yeyun Gong , Yanzhi Wang , Yelong Shen

Sequence modeling plays a vital role across various domains, with recurrent neural networks being historically the predominant method of performing these tasks. However, the emergence of transformers has altered this paradigm due to their…

The increasing sophistication of modern cyber threats, particularly file-less malware relying on living-off-the-land techniques, poses significant challenges to traditional detection mechanisms. Memory forensics has emerged as a crucial…

Cryptography and Security · Computer Science 2026-02-23 Arslan Tariq Syed , Mohamed Chahine Ghanem , Elhadj Benkhelifa , Fauzia Idrees Abro

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

Meta-learning facilitates few-shot hyperspectral target detection (HTD), but adapting deep backbones remains challenging. Full-parameter fine-tuning is inefficient and prone to overfitting, and existing methods largely ignore the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-08 Luqi Gong , Qixin Xie , Yue Chen , Ziqiang Chen , Fanda Fan , Shuai Zhao , Chao Li