English
Related papers

Related papers: OuroMamba: A Data-Free Quantization Framework for …

200 papers

Multimodal Sentiment Analysis (MSA) with missing modalities has attracted increasing attention recently. While current Transformer-based methods leverage dense text information to maintain model robustness, their quadratic complexity…

Multimedia · Computer Science 2026-01-12 Xiang Li , Xianfu Cheng , Dezhuang Miao , Xiaoming Zhang , Zhoujun Li

High-performance semantic segmentation has achieved significant progress in recent years, often driven by increasingly large backbones and higher computational budgets. While effective, such approaches introduce substantial computational…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Sheng-Wei Chan , Hsin-Jui Pan , Chun-Po Shen , Chia-Min Lin , Yung-Che Wang , Jen-Shiun Chiang

Audio super-resolution aims to enhance low-resolution signals by creating high-frequency content. In this work, we modify the architecture of AERO (a state-of-the-art system for this task) for music super-resolution. SPecifically, we…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-13 Wallace Abreu , Luiz Wagner Pereira Biscainho

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

Machine Learning · Computer Science 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun

Existing video camouflaged object detection (VCOD) methods primarily rely on spatial appearances for motion perception. However, the high foreground-background similarity in VCOD limits the discriminability of such features (e.g. color and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Xin Li , Keren Fu , Qijun Zhao

This paper introduces VMatcher, a hybrid Mamba-Transformer network for semi-dense feature matching between image pairs. Learning-based feature matching methods, whether detector-based or detector-free, achieve state-of-the-art performance…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Ali Youssef

Images corrupted by rain streaks often lose vital frequency information for perception, and image deraining aims to solve this issue which relies on global and local degradation modeling. Recent studies have witnessed the effectiveness and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Zou Zhen , Yu Hu , Zhao Feng

For large language models (LLMs), post-training quantization (PTQ) can significantly reduce memory footprint and computational overhead. Model quantization is rapidly evolving. Though many papers report breakthrough results, they are often…

Machine Learning · Computer Science 2026-01-30 Yutong Liu , Cairong Zhao , Guosheng Hu

Neural network quantization is an effective way to compress deep models and improve their execution latency and energy efficiency, so that they can be deployed on mobile or embedded devices. Existing quantization methods require original…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Shoukai Xu , Haokun Li , Bohan Zhuang , Jing Liu , Jiezhang Cao , Chuangrun Liang , Mingkui Tan

Mamba-based models have drawn much attention in offline RL. However, their selective mechanism often detrimental when key steps in RL sequences are omitted. To address these issues, we propose a simple yet effective structure, called…

Machine Learning · Computer Science 2026-02-27 Wall Kim , Chaeyoung Song , Hanul Kim

Recent 2D CNN-based domain adaptation approaches struggle with long-range dependencies due to limited receptive fields, making it difficult to adapt to target domains with significant spatial distribution changes. While transformer-based…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 A. Enes Doruk , Hasan F. Ates

Noise is an inevitable aspect of point cloud acquisition, necessitating filtering as a fundamental task within the realm of 3D vision. Existing learning-based filtering methods have shown promising capabilities on small-scale synthetic or…

Multimedia · Computer Science 2025-01-10 Qingyuan Zhou , Weidong Yang , Ben Fei , Jingyi Xu , Rui Zhang , Keyi Liu , Yeqi Luo , Ying He

Video matting is crucial for applications such as film production and virtual reality, yet deploying its computationally intensive models on resource-constrained devices presents challenges. Quantization is a key technique for model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Tianrui Zhu , Houyuan Chen , Ruihao Gong , Michele Magno , Haotong Qin , Kai Zhang

Quantization is an effective way to reduce the memory cost of large-scale model training. However, most existing methods adopt fixed-precision policies, which ignore the fact that optimizer-state distributions vary significantly across…

Machine Learning · Computer Science 2026-04-10 Minglu Liu , Cunchen Hu , Liangliang Xu , Fengming Tang , Ruijia Wang , Fu Yu

State Space Models (SSMs) with selective scan (Mamba) have been adapted into efficient vision models. Mamba, unlike Vision Transformers, achieves linear complexity for token interactions through a recurrent hidden state process. This…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Saarthak Kapse , Robin Betz , Srinivasan Sivanandan

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

Several post-training quantization methods have been applied to large language models (LLMs), and have been shown to perform well down to 8-bits. We find that these methods break down at lower bit precision, and investigate quantization…

Computation and Language · Computer Science 2023-05-30 Zechun Liu , Barlas Oguz , Changsheng Zhao , Ernie Chang , Pierre Stock , Yashar Mehdad , Yangyang Shi , Raghuraman Krishnamoorthi , Vikas Chandra

Video Language Models (VLMs) are crucial for generalizing across diverse tasks and using language cues to enhance learning. While transformer-based architectures have been the de facto in vision-language training, they face challenges like…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Zhikang Dong , Apoorva Beedu , Jason Sheinkopf , Irfan Essa

Deploying Vision-Language Models (VLMs) on edge devices is challenged by resource constraints and performance degradation under distribution shifts. While test-time adaptation (TTA) can counteract such shifts, existing methods are too…

Artificial Intelligence · Computer Science 2026-02-18 Xin Wang , Hong Jia , Hualin Zhou , Sheng Guang Wang , Yu Zhang , Ting Dang , Tao Gu

Diffusionmodels(DMs)havedemonstratedremarkableachievements in synthesizing images of high fidelity and diversity. However, the extensive computational requirements and slow generative speed of diffusion models have limited their widespread…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Jiaojiao Ye , Zhen Wang , Linnan Jiang