English
Related papers

Related papers: Can Quantized Audio Language Models Perform Zero-S…

200 papers

The rapid advancement of AI has enabled highly realistic speech synthesis and voice cloning, posing serious risks to voice authentication, smart assistants, and telecom security. While most prior work frames spoof detection as a binary…

Sound · Computer Science 2025-09-10 Bin Hu , Kunyang Huang , Daehan Kwak , Meng Xu , Kuan Huang

For consumer usage of locally deployed LLMs, the GGUF format and k\_quantization are invaluable tools for maintaining the performance of the original model while reducing it to sizes deployable with consumer-grade hardware. The number of…

Computation and Language · Computer Science 2026-01-23 Karl Audun Borgersen , Morten Goodwin

Advances in automatic speaker verification (ASV) promote research into the formulation of spoofing detection systems for real-world applications. The performance of ASV systems can be degraded severely by multiple types of spoofing attacks,…

Sound · Computer Science 2024-08-27 Zhenyu Wang , John H. L. Hansen

With the rapid growth in the use of fine-tuning for large language models (LLMs), optimizing fine-tuning while keeping inference efficient has become highly important. However, this is a challenging task as it requires improvements in all…

Computation and Language · Computer Science 2024-10-14 Changhun Lee , Jun-gyu Jin , Younghyun Cho , Eunhyeok Park

Voice anti-spoofing systems are crucial auxiliaries for automatic speaker verification (ASV) systems. A major challenge is caused by unseen attacks empowered by advanced speech synthesis technologies. Our previous research on one-class…

Audio and Speech Processing · Electrical Eng. & Systems 2022-11-08 Siwen Ding , You Zhang , Zhiyao Duan

Abuse of large language models reveals high risks as large language models are being deployed at an astonishing speed. It is important to protect the model weights to avoid malicious usage that violates licenses of open-source large…

Computation and Language · Computer Science 2023-10-18 Linyang Li , Botian Jiang , Pengyu Wang , Ke Ren , Hang Yan , Xipeng Qiu

We propose QeRL, a Quantization-enhanced Reinforcement Learning framework for large language models (LLMs). While RL is essential for LLMs' reasoning capabilities, it is resource-intensive, requiring substantial GPU memory and long rollout…

Machine Learning · Computer Science 2025-10-14 Wei Huang , Yi Ge , Shuai Yang , Yicheng Xiao , Huizi Mao , Yujun Lin , Hanrong Ye , Sifei Liu , Ka Chun Cheung , Hongxu Yin , Yao Lu , Xiaojuan Qi , Song Han , Yukang Chen

Rotations have become essential to state-of-the-art quantization pipelines for large language models (LLMs) by effectively smoothing outliers in weights and activations. However, further optimizing the rotation parameters offers only…

Machine Learning · Computer Science 2025-09-01 Liulu He , Shenli Zheng , Karwei Sun , Yijiang Liu , Yufei Zhao , Chongkang Tan , Huanrui Yang , Yuan Du , Li Du

Large Audio-Language Models (LALMs) have set new benchmarks in speech processing, yet their deployment is hindered by the memory footprint of the Key-Value (KV) cache during long-context inference. While general KV cache compression…

Sound · Computer Science 2026-04-09 Yuxuan Wang , Peize He , Xiyan Gui , Xiaoqian Liu , Junhao He , Xuyang Liu , Zichen Wen , Xuming Hu , Linfeng Zhang

Recently years have witnessed a rapid development of large language models (LLMs). Despite the strong ability in many language-understanding tasks, the heavy computational burden largely restricts the application of LLMs especially when one…

Machine Learning · Computer Science 2023-10-10 Yuhui Xu , Lingxi Xie , Xiaotao Gu , Xin Chen , Heng Chang , Hengheng Zhang , Zhengsu Chen , Xiaopeng Zhang , Qi Tian

Quantization is a powerful tool to improve large language model (LLM) inference efficiency by utilizing more energy-efficient low-precision datapaths and reducing memory footprint. However, accurately quantizing LLM weights and activations…

Hardware Architecture · Computer Science 2025-04-22 Coleman Hooper , Charbel Sakr , Ben Keller , Rangharajan Venkatesan , Kurt Keutzer , Sophia Shao , Brucek Khailany

Diffusion models have demonstrated remarkable capabilities in image synthesis and related generative tasks. Nevertheless, their practicality for real-world applications is constrained by substantial computational costs and latency issues.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Yefei He , Jing Liu , Weijia Wu , Hong Zhou , Bohan Zhuang

Modern large language models (LLMs) have established state-of-the-art performance through architectural improvements, but still require significant computational cost for inference. In an effort to reduce the inference cost, post-training…

Computation and Language · Computer Science 2024-05-24 Jaewoo Yang , Hayun Kim , Younghoon Kim

Quantum machine learning has emerged as a promising tool for pattern recognition, yet many audio-focused approaches still treat spectrograms as generic images and do not explicitly exploit their time-frequency structure. We propose Q-Patch,…

Sound · Computer Science 2026-05-08 Lisan Al Amin , Rakib Hossain , Mahbubul Islam , Faisal Quader , Thanh Thi Nguyen

The SAFE Challenge evaluates synthetic speech detection across three tasks: unmodified audio, processed audio with compression artifacts, and laundered audio designed to evade detection. We systematically explore self-supervised learning…

Audio and Speech Processing · Electrical Eng. & Systems 2025-10-08 Hashim Ali , Surya Subramani , Lekha Bollinani , Nithin Sai Adupa , Sali El-Loh , Hafiz Malik

Few-shot learning has emerged as a powerful paradigm for training models with limited labeled data, addressing challenges in scenarios where large-scale annotation is impractical. While extensive research has been conducted in the image…

How can we accurately quantize a pre-trained model without any data? Quantization algorithms are widely used for deploying neural networks on resource-constrained edge devices. Zero-shot Quantization (ZSQ) addresses the crucial and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Minjun Kim , Jongjin Kim , U Kang

Model quantization enables efficient deployment of deep neural networks on edge devices through low-bit parameter representation, yet raises critical challenges for implementing machine unlearning (MU) under data privacy regulations.…

Machine Learning · Computer Science 2025-03-19 Yujia Tong , Yuze Wang , Jingling Yuan , Chuang Hu

This paper presents our system for Task 3 of the CLEF 2025 CheckThat! Lab, which focuses on verifying numerical and temporal claims using retrieved evidence. We explore two complementary approaches: zero-shot prompting with…

Computation and Language · Computer Science 2025-09-16 Anirban Saha Anik , Md Fahimul Kabir Chowdhury , Andrew Wyckoff , Sagnik Ray Choudhury

Large Vision and Language Models have exhibited remarkable human-like intelligence in tasks such as natural language comprehension, problem-solving, logical reasoning, and knowledge retrieval. However, training and serving these models…

Machine Learning · Computer Science 2025-03-11 Feng Zhang , Yanbin Liu , Weihua Li , Jie Lv , Xiaodan Wang , Quan Bai
‹ Prev 1 8 9 10 Next ›