English
Related papers

Related papers: Accelerating Local AI on Consumer GPUs: A Hardware…

200 papers

In this study, we identify the inefficient attention phenomena in Large Vision-Language Models (LVLMs), notably within prominent models like LLaVA-1.5, QwenVL-Chat and Video-LLaVA. We find out that the attention computation over visual…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Liang Chen , Haozhe Zhao , Tianyu Liu , Shuai Bai , Junyang Lin , Chang Zhou , Baobao Chang

AMD Xilinx's new Versal Adaptive Compute Acceleration Platform (ACAP) is an FPGA architecture combining reconfigurable fabric with other on-chip hardened compute resources. AI engines are one of these and, by operating in a highly…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-01-31 Nick Brown

Visual Autoregressive (VAR) modeling inefficiently applies a fixed computational depth to each position when generating high-resolution images. While existing methods accelerate inference by pruning tokens using frequency maps, their binary…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Chunliang Li , Tianze Cao , Sanyuan Zhao

In this paper, we aim to design an efficient real-time object detector that exceeds the YOLO series and is easily extensible for many object recognition tasks such as instance segmentation and rotated object detection. To obtain a more…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Chengqi Lyu , Wenwei Zhang , Haian Huang , Yue Zhou , Yudong Wang , Yanyi Liu , Shilong Zhang , Kai Chen

For deployment, neural architecture search should be hardware-aware, in order to satisfy the device-specific constraints (e.g., memory usage, latency and energy consumption) and enhance the model efficiency. Existing methods on…

Machine Learning · Computer Science 2021-12-03 Hayeon Lee , Sewoong Lee , Song Chong , Sung Ju Hwang

Connected components and spanning forest are fundamental graph algorithms due to their use in many important applications, such as graph clustering and image segmentation. GPUs are an ideal platform for graph algorithms due to their high…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-08-28 Changwan Hong , Laxman Dhulipala , Julian Shun

Real-time object detection on Unmanned Aerial Vehicles (UAVs) is a challenging issue due to the limited computing resources of edge GPU devices as Internet of Things (IoT) nodes. To solve this problem, in this paper, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Wei Zhou , Xuanlin Min , Rui Hu , Yiwen Long , Huan Luo , JunYi

The Mixture of Experts (MoE) architecture has become a fundamental building block in state-of-the-art large language models (LLMs), improving domain-specific expertise in LLMs and scaling model capacity without proportionally increasing…

Machine Learning · Computer Science 2026-05-13 Ankit Jyothish , Ali Jannesari , Aishwarya Sarkar , Joseph Zuber

Accurate vehicle detection is a critical component of autonomous driving, traffic surveillance, and intelligent transportation systems. This paper presents an enhanced YOLOv8n-based model that integrates the Ghost Module, Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Syed Sajid Ullah , Muhammad Zunair Zamir , Ahsan Ishfaq , Salman Khan

The Interpretable Generalization (IG) mechanism recently published in IEEE Transactions on Information Forensics and Security delivers state-of-the-art, evidence-based intrusion detection by discovering coherent normal and attack patterns…

Cryptography and Security · Computer Science 2025-07-22 Shu-Ting Huang , Wen-Cheng Chung , Hao-Ting Pai

Unmanned aerial vehicles serve as primary sensing platforms for surveillance, traffic monitoring, and disaster response, making aerial object detection a central problem in applied computer vision. Current detectors struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Sohail Ali Farooqui , Zuhair Ahmed Khan Taha , Mohammed Mudassir Uddin , Shahnawaz Alam

The advent of edge devices dedicated to machine learning tasks enabled the execution of AI-based applications that efficiently process and classify the data acquired by the resource-constrained devices populating the Internet of Things. The…

Software Engineering · Computer Science 2023-09-04 Alessandro Tundo , Marco Mobilio , Shashikant Ilager , Ivona Brandić , Ezio Bartocci , Leonardo Mariani

Optimal designs minimize the number of experimental runs (samples) needed to accurately estimate model parameters, resulting in algorithms that, for instance, efficiently minimize parameter estimate variance. Governed by knowledge of past…

Methodology · Statistics 2023-02-03 Nicholas W. Barendregt , Emily G. Webb , Zachary P. Kilpatrick

Large language models (LLMs) are becoming increasingly capable at small parameter scales. At the same time, conventional cloud-centric deployment introduces challenges around data privacy, latency, and cost that are acute in operational…

Hardware Architecture · Computer Science 2026-04-29 Harri Renney , Fouad Trad , Michael Mattarock , Zena Wood

Image recognition tasks typically use deep learning and require enormous processing power, thus relying on hardware accelerators like GPUs and FPGAs for fast, timely processing. Failure in real-time image recognition tasks can occur due to…

Machine Learning · Computer Science 2023-02-22 Nikolaos Louloudakis , Perry Gibson , José Cano , Ajitha Rajan

With the widespread adoption of Mixture-of-Experts (MoE) models, there is a growing demand for efficient inference on memory-constrained devices. While offloading expert parameters to CPU memory and loading activated experts on demand has…

Machine Learning · Computer Science 2025-05-13 Yuxin Zhou , Zheng Li , Jun Zhang , Jue Wang , Yiping Wang , Zhongle Xie , Ke Chen , Lidan Shou

Memory bandwidth has become the real-time bottleneck of current deep learning accelerators (DLA), particularly for high definition (HD) object detection. Under resource constraints, this paper proposes a low memory traffic DLA chip with…

Hardware Architecture · Computer Science 2022-05-04 Kuo-Wei Chang , Hsu-Tung Shih , Tian-Sheuan Chang , Shang-Hong Tsai , Chih-Chyau Yang , Chien-Ming Wu , Chun-Ming Huang

Personalized recommendation is a ubiquitous application on the internet, with many industries and hyperscalers extensively leveraging Deep Learning Recommendation Models (DLRMs) for their personalization needs (like ad serving or movie…

Hardware Architecture · Computer Science 2024-10-30 Rishabh Jain , Vivek M. Bhasi , Adwait Jog , Anand Sivasubramaniam , Mahmut T. Kandemir , Chita R. Das

Object detection in civil engineering applications is constrained by limited annotated data in specialized domains. We introduce DINO-YOLO, a hybrid architecture combining YOLOv12 with DINOv3 self-supervised vision transformers for…

Computer Vision and Pattern Recognition · Computer Science 2025-11-03 Malaisree P , Youwai S , Kitkobsin T , Janrungautai S , Amorndechaphon D , Rojanavasu P

Adaptable models could greatly benefit robotic agents operating in the real world, allowing them to deal with novel and varying conditions. While approaches such as Bayesian inference are well-studied frameworks for adapting models to…

Machine Learning · Computer Science 2023-10-20 Orr Krupnik , Elisei Shafer , Tom Jurgenson , Aviv Tamar