English

A GPU-Accelerated RAG-Based Telegram Assistant for Supporting Parallel Processing Students

Computers and Society 2025-11-18 v2 Artificial Intelligence

Abstract

This project addresses a critical pedagogical need: offering students continuous, on-demand academic assistance beyond conventional reception hours. I present a domain-specific Retrieval-Augmented Generation (RAG) system powered by a quantized Mistral-7B Instruct model and deployed as a Telegram bot. The assistant enhances learning by delivering real-time, personalized responses aligned with the "Introduction to Parallel Processing" course materials. GPU acceleration significantly improves inference latency, enabling practical deployment on consumer hardware. This approach demonstrates how consumer GPUs can enable affordable, private, and effective AI tutoring for HPC education.

Keywords

Cite

@article{arxiv.2509.11947,
  title  = {A GPU-Accelerated RAG-Based Telegram Assistant for Supporting Parallel Processing Students},
  author = {Guy Tel-Zur},
  journal= {arXiv preprint arXiv:2509.11947},
  year   = {2025}
}

Comments

9 pages

R2 v1 2026-07-01T05:36:55.483Z