English
Related papers

Related papers: Inlier-Centric Post-Training Quantization for Obje…

200 papers

The great success that deep models have achieved in the past is mainly owed to large amounts of labeled training data. However, the acquisition of labeled data for new tasks aside from existing benchmarks is both challenging and costly.…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Clemens-Alexander Brust , Christoph Käding , Joachim Denzler

Denoising diffusion models have emerged as state-of-the-art in generative tasks across image, audio, and video domains, producing high-quality, diverse, and contextually relevant data. However, their broader adoption is limited by high…

Sound · Computer Science 2024-09-24 Jayneel Vora , Aditya Krishnan , Nader Bouacida , Prabhu RV Shankar , Prasant Mohapatra

We propose a novel unsupervised approach based on a two-stage object-centric adversarial framework that only needs object regions for detecting frame-level local anomalies in videos. The first stage consists in learning the correspondence…

Computer Vision and Pattern Recognition · Computer Science 2020-11-16 Pankaj Raj Roy , Guillaume-Alexandre Bilodeau , Lama Seoud

With the rapid advances in deep learning and smart manufacturing in Industry 4.0, there is an imperative for high-throughput, high-performance, and fully integrated visual inspection systems. Most anomaly detection approaches using defect…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Sushovan Jena , Arya Pulkit , Kajal Singh , Anoushka Banerjee , Sharad Joshi , Ananth Ganesh , Dinesh Singh , Arnav Bhavsar

An accurate and substantial dataset is essential for training a reliable and well-performing model. However, even manually annotated datasets contain label errors, not to mention automatically labeled ones. Previous methods for label…

Machine Learning · Computer Science 2024-01-05 Anastasiia Sedova , Lena Zellinger , Benjamin Roth

The aim of this work is to detect and automatically generate high-level explanations of anomalous events in video. Understanding the cause of an anomalous event is crucial as the required response is dependant on its nature and severity.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-13 Stanislaw Szymanowicz , James Charles , Roberto Cipolla

In this paper, we propose a noise-aware encoder-decoder framework to disentangle a clean saliency predictor from noisy training examples, where the noisy labels are generated by unsupervised handcrafted feature-based methods. The proposed…

Computer Vision and Pattern Recognition · Computer Science 2020-07-27 Jing Zhang , Jianwen Xie , Nick Barnes

QLoRA reduces the memory-cost of fine-tuning a large language model (LLM) with LoRA by quantizing the base LLM. However, quantization introduces quantization errors that negatively impact model performance after fine-tuning. In this paper…

Machine Learning · Computer Science 2024-10-22 Neal Lawton , Aishwarya Padmakumar , Judith Gaspers , Jack FitzGerald , Anoop Kumar , Greg Ver Steeg , Aram Galstyan

Understanding how Large Language Models (LLMs) process information from prompts remains a significant challenge. To shed light on this "black box," attention visualization techniques have been developed to capture neuron-level perceptions…

Large Vision Language Models (LVLMs) have achieved remarkable success in a range of downstream tasks that require multimodal interaction, but their capabilities come with substantial computational and memory overhead, which hinders…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ziwei Xiang , Fanhu Zeng , Hongjian Fang , Rui-Qi Wang , Renxing Chen , Yanan Zhu , Yi Chen , Peipei Yang , Xu-Yao Zhang

Conventional active learning algorithms assume a single labeler that produces noiseless label at a given, fixed cost, and aim to achieve the best generalization performance for given classifier under a budget constraint. However, in many…

Machine Learning · Computer Science 2021-05-25 Ruijiang Gao , Maytal Saar-tsechansky

Point cloud source data for surface reconstruction is usually contaminated with noise and outliers. To overcome this deficiency, a density-based point cloud denoising method is presented to remove outliers and noisy points. First,…

Computer Vision and Pattern Recognition · Computer Science 2016-02-18 Faisal Zaman , Ya Ping Wong , Boon Yian Ng

The significant resource requirements associated with Large-scale Language Models (LLMs) have generated considerable interest in the development of techniques aimed at compressing and accelerating neural networks. Among these techniques,…

Machine Learning · Computer Science 2024-03-20 Yuexiao Ma , Huixia Li , Xiawu Zheng , Feng Ling , Xuefeng Xiao , Rui Wang , Shilei Wen , Fei Chao , Rongrong Ji

Post-training quantization is a key technique for reducing the memory and inference latency of large language models by quantizing weights and activations without requiring retraining. However, existing methods either (1) fail to account…

Machine Learning · Computer Science 2025-09-23 Jinuk Kim , Marwa El Halabi , Wonpyo Park , Clemens JS Schaefer , Deokjae Lee , Yeonhong Park , Jae W. Lee , Hyun Oh Song

When transformer-based language models are deployed for text generation, most of the inference time is spent in the decoding stage, where output tokens are generated sequentially. Reducing the hardware cost of each decoding step is…

Machine Learning · Computer Science 2026-05-22 Sayed Mohammadreza Tayaranian Hosseini , Amir Ardakani , Warren J. Gross

While neural networks have advanced the frontiers in many applications, they often come at a high computational cost. Reducing the power and latency of neural network inference is key if we want to integrate modern networks into edge…

Machine Learning · Computer Science 2021-06-16 Markus Nagel , Marios Fournarakis , Rana Ali Amjad , Yelysei Bondarenko , Mart van Baalen , Tijmen Blankevoort

Deep convolutional models often produce inadequate predictions for inputs foreign to the training distribution. Consequently, the problem of detecting outlier images has recently been receiving a lot of attention. Unlike most previous work,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Petra Bevandić , Ivan Krešo , Marin Oršić , Siniša Šegvić

Semi-supervised learning aims to leverage a large amount of unlabeled data for performance boosting. Existing works primarily focus on image classification. In this paper, we delve into semi-supervised learning for object detection, where…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Zhenyu Wang , Yali Li , Ye Guo , Shengjin Wang

We introduce Delta-Aware Quantization (DAQ), a data-free post-training quantization framework that preserves the knowledge acquired during post-training. Standard quantization objectives minimize reconstruction error but are agnostic to the…

Machine Learning · Computer Science 2026-03-25 Xiaoming Yu , Shize Tang , Guanghua Yu , Linchuan Xie , Song Liu , Jianchen Zhu , Feng Li

At present, the quantification methods of neural network models are mainly divided into post-training quantization (PTQ) and quantization aware training (QAT). Post-training quantization only need a small part of the data to complete the…

Machine Learning · Computer Science 2022-07-08 Huabin Diao , Gongyan Li , Shaoyun Xu , Yuexing Hao