English

DESAMO: A Device for Elder-Friendly Smart Homes Powered by Embedded LLM with Audio Modality

Human-Computer Interaction 2025-08-27 v1 Sound Audio and Speech Processing

Abstract

We present DESAMO, an on-device smart home system for elder-friendly use powered by Audio LLM, that supports natural and private interactions. While conventional voice assistants rely on ASR-based pipelines or ASR-LLM cascades, often struggling with the unclear speech common among elderly users and unable to handle non-speech audio, DESAMO leverages an Audio LLM to process raw audio input directly, enabling a robust understanding of user intent and critical events, such as falls or calls for help.

Keywords

Cite

@article{arxiv.2508.18918,
  title  = {DESAMO: A Device for Elder-Friendly Smart Homes Powered by Embedded LLM with Audio Modality},
  author = {Youngwon Choi and Donghyuk Jung and Hwayeon Kim},
  journal= {arXiv preprint arXiv:2508.18918},
  year   = {2025}
}

Comments

2 pages, 2 figures. Accepted for presentation as a UIST 2025 Poster

R2 v1 2026-07-01T05:06:15.423Z