English
Related papers

Related papers: Prompting Large Language Models with Audio for Gen…

200 papers

This paper describes the IUST NLP Lab submission to the Prompting Large Language Models as Explainable Metrics Shared Task at the Eval4NLP 2023 Workshop on Evaluation & Comparison of NLP Systems. We have proposed a zero-shot prompt-based…

Computation and Language · Computer Science 2023-11-21 Ghazaleh Mahmoudi

Large language models have proven themselves highly flexible, able to solve a wide range of generative tasks, such as abstractive summarization and open-ended question answering. In this paper we extend the capabilities of LLMs by directly…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-25 Yassir Fathullah , Chunyang Wu , Egor Lakomkin , Junteng Jia , Yuan Shangguan , Ke Li , Jinxi Guo , Wenhan Xiong , Jay Mahadeokar , Ozlem Kalinli , Christian Fuegen , Mike Seltzer

Large language models (LLMs) process and predict sequences containing text to answer questions, and address tasks including document summarization, providing recommendations, writing software and solving quantitative problems. We provide a…

Numerical Analysis · Mathematics 2026-02-02 Ricardo Baptista , Andrew Stuart , Son Tran

Given the great success of large language models (LLMs) across various tasks, in this paper, we introduce LLM-ST, a novel and effective speech translation model constructed upon a pre-trained LLM. By integrating the large language model…

Computation and Language · Computer Science 2023-12-22 Zhichao Huang , Rong Ye , Tom Ko , Qianqian Dong , Shanbo Cheng , Mingxuan Wang , Hang Li

We propose to utilize an instruction-tuned large language model (LLM) for guiding the text generation process in automatic speech recognition (ASR). Modern large language models (LLMs) are adept at performing various text generation tasks…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-08 Yosuke Higuchi , Tetsuji Ogawa , Tetsunori Kobayashi

Summarization is a core task in Natural Language Processing (NLP). Recent advances in Large Language Models (LLMs) and the introduction of large context windows reaching millions of tokens make it possible to process entire books in a…

Computation and Language · Computer Science 2026-03-12 Tairan Fu , Javier Conde , Pedro Reviriego , Javier Coronado-Blázquez , Nina Melero , Elena Merino-Gómez

Speech Large Language Models (Speech LLMs) have emerged as a crucial paradigm in recent years, extending the capabilities of traditional LLMs to speech tasks such as automatic speech recognition (ASR) and spoken dialogue modeling. However,…

Computation and Language · Computer Science 2025-07-08 Phurich Saengthong , Boonnithi Jiaramaneepinit , Sheng Li , Manabu Okumura , Takahiro Shinozaki

Audio-LLM introduces audio modality into a large language model (LLM) to enable a powerful LLM to recognize, understand, and generate audio. However, during speech recognition in noisy environments, we observed the presence of illusions and…

Sound · Computer Science 2024-08-20 Yangze Li , Xiong Wang , Songjun Cao , Yike Zhang , Long Ma , Lei Xie

Large Language Models (LLMs) continue to advance natural language processing with their ability to generate human-like text across a range of tasks. Despite the remarkable success of LLMs in Natural Language Processing (NLP), their…

Computation and Language · Computer Science 2025-07-08 Walid Mohamed Aly , Taysir Hassan A. Soliman , Amr Mohamed AbdelAziz

Conventional audio equalization is a static process that requires manual and cumbersome adjustments to adapt to changing listening contexts (e.g., mood, location, or social setting). In this paper, we introduce a Large Language Model…

Large language models (LLMs) have achieved impressive performance in text summarization, yet their performance often falls short when applied to specialized domains that differ from their original pre-training distribution. While…

Computation and Language · Computer Science 2025-10-10 Xue-Yong Fu , Elena Khasanova , Md Tahmid Rahman Laskar , Harsh Saini , Shashi Bhushan TN

Speech language models refer to language models with speech processing and understanding capabilities. One key desirable capability for speech language models is the ability to capture the intricate interdependency between content and…

Computation and Language · Computer Science 2025-08-11 Kaizhi Qian , Xulin Fan , Junrui Ni , Slava Shechtman , Mark Hasegawa-Johnson , Chuang Gan , Yang Zhang

Topic models are used to identify and group similar themes in a set of documents. Recent advancements in deep learning based neural topic models has received significant research interest. In this paper, an approach is proposed that further…

Computation and Language · Computer Science 2024-10-15 Trishia Khandelwal

We explore the ability of large language models (LLMs) to act as speech recognition post-processors that perform rescoring and error correction. Our first focus is on instruction prompting to let LLMs perform these task without fine-tuning,…

Computation and Language · Computer Science 2024-01-29 Chao-Han Huck Yang , Yile Gu , Yi-Chieh Liu , Shalini Ghosh , Ivan Bulyko , Andreas Stolcke

Large Language Models (LLM) are a new class of computation engines, "programmed" via prompt engineering. We are still learning how to best "program" these LLMs to help developers. We start with the intuition that developers tend to…

Software Engineering · Computer Science 2024-01-15 Toufique Ahmed , Kunal Suresh Pai , Premkumar Devanbu , Earl T. Barr

The rapid advancement of Large Language Models (LLMs) has inaugurated a transformative epoch in natural language processing, fostering unprecedented proficiency in text generation, comprehension, and contextual scrutiny. Nevertheless,…

Machine Learning · Computer Science 2024-04-22 Cangqing Wang , Yutian Yang , Ruisi Li , Dan Sun , Ruicong Cai , Yuzhu Zhang , Chengqian Fu , Lillian Floyd

Large language models (LLMs) have gained considerable attention for Artificial Intelligence Generated Content (AIGC), particularly with the emergence of ChatGPT. However, the direct adaptation of continuous speech to LLMs that process…

Audio and Speech Processing · Electrical Eng. & Systems 2023-08-28 Haibin Wu , Kai-Wei Chang , Yuan-Kuei Wu , Hung-yi Lee

This work focuses on the task of query-based meeting summarization in which the summary of a context (meeting transcript) is generated in response to a specific query. When using Large Language Models (LLMs) for this task, usually a new…

Computation and Language · Computer Science 2024-10-22 Md Tahmid Rahman Laskar , Elena Khasanova , Xue-Yong Fu , Cheng Chen , Shashi Bhushan TN

Large Language Models (LLMs) have recently garnered significant attention, primarily for their capabilities in text-based interactions. However, natural human interaction often relies on speech, necessitating a shift towards voice-based…

Computation and Language · Computer Science 2025-08-08 Wenqian Cui , Dianzhi Yu , Xiaoqi Jiao , Ziqiao Meng , Guangyan Zhang , Qichao Wang , Yiwen Guo , Irwin King

Text summarization helps readers capture salient information from documents, news, interviews, and meetings. However, most state-of-the-art pretrained language models (LM) are unable to efficiently process long text for many summarization…

Computation and Language · Computer Science 2022-04-15 Yusen Zhang , Ansong Ni , Ziming Mao , Chen Henry Wu , Chenguang Zhu , Budhaditya Deb , Ahmed H. Awadallah , Dragomir Radev , Rui Zhang