English
Related papers

Related papers: Raon-Speech Technical Report

200 papers

We present ESPnet-SpeechLM, an open toolkit designed to democratize the development of speech language models (SpeechLMs) and voice-driven agentic applications. The toolkit standardizes speech processing tasks by framing them as universal…

Large Audio-Language Models (LALMs) as judges have emerged as a prominent approach for evaluating speech generation quality, yet their ability to assess speaker consistency across multi-turn dialogues remains unexplored. We present…

Computation and Language · Computer Science 2026-04-21 Jonggeun Lee , Junseong Pyo , Gyuhyeon Seo , Yohan Jo

The development of Large Speech-Language Models (LSLMs) has been slowed by fragmented architectures and a lack of transparency, hindering the systematic comparison and reproducibility of research. Unlike in the vision-language domain, the…

Computation and Language · Computer Science 2025-08-22 Yirong Sun , Yizhong Geng , Peidong Wei , Yanjun Chen , Jinghan Yang , Rongfei Chen , Wei Zhang , Xiaoyu Shen

Large language models (LLMs) have gained considerable attention for Artificial Intelligence Generated Content (AIGC), particularly with the emergence of ChatGPT. However, the direct adaptation of continuous speech to LLMs that process…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-28 Haibin Wu , Kai-Wei Chang , Yuan-Kuei Wu , Hung-yi Lee

This study systematically evaluated the mathematical reasoning capabilities of Large Language Models (LLMs) using the 2026 Korean College Scholastic Ability Test (CSAT) Mathematics section, ensuring a completely contamination-free…

Computation and Language · Computer Science 2025-12-02 Goun Pyeon , Inbum Heo , Jeesu Jung , Taewook Hwang , Hyuk Namgoong , Hyein Seo , Yerim Han , Eunbin Kim , Hyeonseok Kang , Sangkeun Jung

We present a two-stage fine-tuning approach to make the large language model Qwen3 14B "think" natively in Korean. In the first stage, supervised fine-tuning (SFT) on a high-quality Korean reasoning dataset establishes a strong foundation…

Computation and Language · Computer Science 2025-08-15 Jungyup Lee , Jemin Kim , Sang Park , SeungJae Lee

In this paper, we propose a two-phase training approach where pre-trained large language models are continually pre-trained on parallel data and then supervised fine-tuned with a small amount of high-quality parallel data. To investigate…

Computation and Language · Computer Science 2024-07-04 Minato Kondo , Takehito Utsuro , Masaaki Nagata

Large Language Models (LLMs) demonstrate strong reasoning and self-correction abilities in high-resource languages like English, but their performance remains limited in low-resource languages such as Korean. In this study, we investigate…

Computation and Language · Computer Science 2026-01-12 Hongjin Kim , Jaewook Lee , Kiyoung Lee , Jong-hun Shin , Soojong Lim , Oh-Woog Kwon

Large language models (LLMs) demonstrate remarkable ability to comprehend, reason, and generate following nature language instructions. However, the development of LLMs has been primarily focused on high-resource languages, such as English,…

We consider the generative modeling of speech over multiple minutes, a requirement for long-form multimedia generation and audio-native voice assistants. However, textless spoken language models struggle to generate plausible speech past…

Computation and Language · Computer Science 2025-07-11 Se Jin Park , Julian Salazar , Aren Jansen , Keisuke Kinoshita , Yong Man Ro , RJ Skerry-Ryan

The recent advent of neural approaches for developing each dialog component in task-oriented dialog systems has remarkably improved, yet optimizing the overall system performance remains a challenge. Besides, previous research on modeling…

Computation and Language · Computer Science 2021-08-27 Hwaran Lee , Seokhwan Jo , HyungJun Kim , Sangkeun Jung , Tae-Yoon Kim

Large Language Models (LLMs) demonstrate strong conversational abilities. In this Working Paper, we study them in the context of debating in two ways: their ability to perform in a structured debate along with a dataset of arguments to use…

Information Retrieval · Computer Science 2025-07-15 Anthony Miyaguchi , Conor Johnston , Aaryan Potdar

Despite broad interest in modeling spoken dialogue agents, most approaches are inherently "half-duplex" -- restricted to turn-based interaction with responses requiring explicit prompting by the user or implicit tracking of interruption or…

Computation and Language · Computer Science 2024-09-25 Bandhav Veluri , Benjamin N Peloquin , Bokai Yu , Hongyu Gong , Shyamnath Gollakota

Large Audio-Language Models (LALMs), such as GPT-4o, have recently unlocked audio dialogue capabilities, enabling direct spoken exchanges with humans. The potential of LALMs broadens their applicability across a wide range of practical…

Artificial Intelligence · Computer Science 2025-07-29 Kuofeng Gao , Shu-Tao Xia , Ke Xu , Philip Torr , Jindong Gu

This paper presents a keystroke-based framework for detecting LLM-assisted cheating in Korean, addressing key gaps in prior research regarding language coverage, cognitive context, and the granularity of LLM involvement. Our proposed…

Machine Learning · Computer Science 2025-08-01 Dong Hyun Roh , Rajesh Kumar , An Ngo

Language agents powered by large language models (LLMs) face significant deployment challenges in resource-constrained environments, particularly for specialized domains and less-common languages. This paper presents Tox-chat, a Korean…

Computation and Language · Computer Science 2025-10-10 Hojun Cho , Donghu Kim , Soyoung Yang , Chan Lee , Hunjoo Lee , Jaegul Choo

Recent advances in speech large language models (speech LLMs) have enabled seamless spoken interactions, but these systems still struggle with complex reasoning tasks. Previously, chain-of-thought (CoT) prompting or fine-tuning has been to…

Computation and Language · Computer Science 2025-10-10 Yi-Jen Shih , Desh Raj , Chunyang Wu , Wei Zhou , SK Bong , Yashesh Gaur , Jay Mahadeokar , Ozlem Kalinli , Mike Seltzer

We introduce DeSTA2.5-Audio, a general-purpose Large Audio Language Model (LALM) designed for robust auditory perception and instruction-following. Recent LALMs augment Large Language Models (LLMs) with auditory capabilities by training on…

Large Language Models (LLMs) demonstrate superior performance in generative scenarios and have attracted widespread attention. Among them, stylized dialogue generation is essential in the context of LLMs for building intelligent and…

Computation and Language · Computer Science 2024-03-19 Jinpeng Li , Zekai Zhang , Quan Tu , Xin Cheng , Dongyan Zhao , Rui Yan

Large Language Models pre-trained with self-supervised learning have demonstrated impressive zero-shot generalization capabilities on a wide spectrum of tasks. In this work, we present WeLM: a well-read pre-trained language model for…

Computation and Language · Computer Science 2023-05-17 Hui Su , Xiao Zhou , Houjin Yu , Xiaoyu Shen , Yuwen Chen , Zilin Zhu , Yang Yu , Jie Zhou