English

A real-time framework for visual feedback of articulatory data using statistical shape models

Human-Computer Interaction 2016-12-20 v1
Authors: Kristy James , Alexander Hewer , Ingmar Steiner , Stefanie Wuhrer
View on arXiv ↗ PDF ↗

Abstract

We present a novel open-source framework for visualizing electromagnetic articulography (EMA) data in real-time, with a modular framework and anatomically accurate tongue and palate models derived by multilinear subspace learning.

Cite

@article{arxiv.1612.06114,
  title  = {A real-time framework for visual feedback of articulatory data using statistical shape models},
  author = {Kristy James and Alexander Hewer and Ingmar Steiner and Stefanie Wuhrer},
  journal= {arXiv preprint arXiv:1612.06114},
  year   = {2016}
}

Comments

17th Annual Conference of the International Speech Communication Association (Interspeech), Oct 2016, San Francisco, United States

Related papers

View all related →
Human-Computer Interaction · Computer Science
Speech animation using electromagnetic articulography as motion capture data
Ingmar Steiner, Korin Richmond, Slim Ouni
2013-11-01
Computation and Language · Computer Science
Dynamical model parameters from ultrasound tongue kinematics
Sam Kirkham, Patrycja Strycharczuk
2025-11-05
Computer Vision and Pattern Recognition · Computer Science
EMMA: Extracting Multiple physical parameters from Multimodal Data
Farhat Shaikh, Ayan Banerjee, Sandeep Gupta
2026-05-26
Human-Computer Interaction · Computer Science
Toward a Unified Metadata Schema for Ecological Momentary Assessment with Voice-First Virtual Assistants
Chen Chen, Khalil Mrini, Kemeberly Charles, Ella T. Lifset +4
2024-07-09
Information Retrieval · Computer Science
EGRA:Toward Enhanced Behavior Graphs and Representation Alignment for Multimodal Recommendation
Xiaoxiong Zhang, Xin Zhou, Zhiwei Zeng, Yongjie Wang +2
2025-08-25
Human-Computer Interaction · Computer Science
Towards Visualization of Time-Series Ecological Momentary Assessment (EMA) Data on Standalone Voice-First Virtual Assistants
Yichen Han, Christopher Bo Han, Chen Chen, Peng Wei Lee +4
2022-08-02
Signal Processing · Electrical Eng. & Systems
WaveMind: Towards a Conversational EEG Foundation Model Aligned to Textual and Visual Modalities
Ziyi Zeng, Zhenyang Cai, Yixi Cai, Xidong Wang +7
2025-10-02
Applications · Statistics
Analyzing Ecological Momentary Assessment Data with State-Space Models: Considerations and Recommendations
Lindley R. Slipetz, Jeremy W. Eberle, Cheri A. Levinson, Ami Falk +2
2023-05-08
Audio and Speech Processing · Electrical Eng. & Systems
Deep Speech Synthesis from Articulatory Representations
Peter Wu, Shinji Watanabe, Louis Goldstein, Alan W Black +1
2022-09-15
Computer Vision and Pattern Recognition · Computer Science
Eye-gaze Guided Multi-modal Alignment for Medical Representation Learning
Chong Ma, Hanqi Jiang, Wenting Chen, Yiwei Li +9
2024-06-17
Information Retrieval · Computer Science
Structured Semantics from Unstructured Notes: Language Model Approaches to EHR-Based Decision Support
Wu Hao Ran, Xi Xi, Furong Li, Jingyi Lu +4
2025-06-10
Audio and Speech Processing · Electrical Eng. & Systems
Deep Speech Synthesis from MRI-Based Articulatory Representations
Peter Wu, Tingle Li, Yijing Lu, Yubin Zhang +5
2023-07-06
Artificial Intelligence · Computer Science
Progress in animation of an EMA-controlled tongue model for acoustic-visual speech synthesis
Ingmar Steiner, Slim Ouni
2012-01-20
Machine Learning · Computer Science
TAMER: A Test-Time Adaptive MoE-Driven Framework for EHR Representation Learning
Yinghao Zhu, Xiaochen Zheng, Ahmed Allam, Michael Krauthammer
2025-03-19
Signal Processing · Electrical Eng. & Systems
EEG-Language Pretraining for Highly Label-Efficient Clinical Phenotyping
Sam Gijsen, Kerstin Ritter
2025-08-12
Signal Processing · Electrical Eng. & Systems
A Survey of Spatio-Temporal EEG data Analysis: from Models to Applications
Pengfei Wang, Huanran Zheng, Silong Dai, Yiqiao Wang +3
2025-01-09
Audio and Speech Processing · Electrical Eng. & Systems
EMA2S: An End-to-End Multimodal Articulatory-to-Speech System
Yu-Wen Chen, Kuo-Hsuan Hung, Shang-Yi Chuang, Jonathan Sherman +3
2021-06-10
Computer Vision and Pattern Recognition · Computer Science
Contour-based 3d tongue motion visualization using ultrasound image sequences
Kele Xu, Yin Yang, Clémence Leboullenger, Pierre Roussel +1
2016-05-20
Sound · Computer Science
UTI-LLM: A Personalized Articulatory-Speech Therapy Assistance System Based on Multimodal Large Language Model
Yudong Yang, Xiaokang Liu, Shaofeng zhao, Rongfeng Su +2
2025-11-03
Computer Vision and Pattern Recognition · Computer Science
Everything Can Be Described in Words: A Simple Unified Multi-Modal Framework with Semantic and Temporal Alignment
Xiaowei Bi, Zheyuan Xu
2025-06-11
Audio and Speech Processing · Electrical Eng. & Systems
Reconstruction of the Complete Vocal Tract Contour Through Acoustic to Articulatory Inversion Using Real-Time MRI Data
Sofiane Azzouz, Pierre-André Vuissoz, Yves Laprie
2026-03-16
Machine Learning · Computer Science
Visualization of Machine Learning Models through Their Spatial and Temporal Listeners
Siyu Wu, Lei Shi, Lei Xia, Cenyang Wu +4
2026-03-31
Human-Computer Interaction · Computer Science
Exploring Large-Scale Language Models to Evaluate EEG-Based Multimodal Data for Mental Health
Yongquan Hu, Shuning Zhang, Ting Dang, Hong Jia +3
2024-08-15
Computer Vision and Pattern Recognition · Computer Science
Efficient Multi-Scale Attention Module with Cross-Spatial Learning
Daliang Ouyang, Su He, Guozhong Zhang, Mingzhu Luo +3
2023-06-07
Computer Vision and Pattern Recognition · Computer Science
EMMA: Efficient Visual Alignment in Multi-Modal LLMs
Sara Ghazanfari, Alexandre Araujo, Prashanth Krishnamurthy, Siddharth Garg +1
2025-06-12
R2 v1 2026-06-22T17:27:58.378Z