中文
相关论文

相关论文: Prompting Large Language Models for Zero-Shot Doma…

200 篇论文

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

计算与语言 · 计算机科学 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

End-to-end automatic speech recognition (E2E ASR) systems have significantly improved speech recognition through training on extensive datasets. Despite these advancements, they still struggle to accurately recognize domain specific words,…

计算与语言 · 计算机科学 2024-07-26 Jiwon Suh , Injae Na , Woohwan Jung

While large language models excel in a variety of natural language processing (NLP) tasks, to perform well on spoken language understanding (SLU) tasks, they must either rely on off-the-shelf automatic speech recognition (ASR) systems for…

计算与语言 · 计算机科学 2023-09-13 Pranay Dighe , Yi Su , Shangshang Zheng , Yunshu Liu , Vineet Garg , Xiaochuan Niu , Ahmed Tewfik

In this work, we introduce a framework for speech summarization that leverages the processing and reasoning capabilities of large language models (LLMs). We propose an end-to-end system that combines an instruction-tuned LLM with an audio…

音频与语音处理 · 电气工程与系统科学 2024-09-16 Wonjune Kang , Deb Roy

Dense retrieval (DR) converts queries and documents into dense embeddings and measures the similarity between queries and documents in vector space. One of the challenges in DR is the lack of domain-specific training data. While DR models…

信息检索 · 计算机科学 2024-06-18 Zhiyuan Peng , Xuyang Wu , Qifan Wang , Yi Fang

This paper proposes an automatic speech recognition (ASR) model for hate speech using large language models (LLMs). The proposed method integrates the encoder of the ASR model with the decoder of the LLMs, enabling simultaneous…

音频与语音处理 · 电气工程与系统科学 2026-01-09 Ryutaro Oshima , Yuya Hosoda , Youji Iiguni

In recent years, Large Language Models (LLMs) have emerged as a prominent area of interest across various research domains, including Process Mining (PM). Current applications in PM have predominantly centered on prompt engineering…

计算与语言 · 计算机科学 2025-09-04 Rafael Seidi Oyamada , Jari Peeperkorn , Jochen De Weerdt , Johannes De Smedt

Multi-speaker automatic speech recognition (MS-ASR) faces significant challenges in transcribing overlapped speech, a task critical for applications like meeting transcription and conversational analysis. While serialized output training…

音频与语音处理 · 电气工程与系统科学 2025-06-09 Yuke Lin , Ming Cheng , Ze Li , Beilong Tang , Ming Li

This paper describes the IUST NLP Lab submission to the Prompting Large Language Models as Explainable Metrics Shared Task at the Eval4NLP 2023 Workshop on Evaluation & Comparison of NLP Systems. We have proposed a zero-shot prompt-based…

计算与语言 · 计算机科学 2023-11-21 Ghazaleh Mahmoudi

The impressive capability and versatility of large language models (LLMs) have aroused increasing attention in automatic speech recognition (ASR), with several pioneering studies attempting to build integrated ASR models by connecting a…

音频与语音处理 · 电气工程与系统科学 2023-09-27 Wenyi Yu , Changli Tang , Guangzhi Sun , Xianzhao Chen , Tian Tan , Wei Li , Lu Lu , Zejun Ma , Chao Zhang

Metaphor is a pervasive feature of discourse and a powerful lens for examining cognition, emotion, and ideology. Large-scale analysis, however, has been constrained by the need for manual annotation due to the context-sensitive nature of…

计算与语言 · 计算机科学 2025-10-02 Matteo Fuoli , Weihang Huang , Jeannette Littlemore , Sarah Turner , Ellen Wilding

Large language models (LLMs) have achieved remarkable success in the field of natural language processing, enabling better human-computer interaction using natural language. However, the seamless integration of speech signals into LLMs has…

音频与语音处理 · 电气工程与系统科学 2023-10-03 Jian Wu , Yashesh Gaur , Zhuo Chen , Long Zhou , Yimeng Zhu , Tianrui Wang , Jinyu Li , Shujie Liu , Bo Ren , Linquan Liu , Yu Wu

Large Language Models (LLMs) can perform various natural language processing tasks with suitable instruction prompts. However, designing effective prompts manually is challenging and time-consuming. Existing methods for automatic prompt…

计算与语言 · 计算机科学 2024-04-04 Viet-Tung Do , Van-Khanh Hoang , Duy-Hung Nguyen , Shahab Sabahi , Jeff Yang , Hajime Hotta , Minh-Tien Nguyen , Hung Le

The efficacy of large language models (LLMs) is heavily dependent on the quality of the underlying data, particularly within specialized domains. A common challenge when fine-tuning LLMs for domain-specific applications is the potential…

计算与语言 · 计算机科学 2024-03-15 Jianwei Sun , Chaoyang Mei , Linlin Wei , Kaiyu Zheng , Na Liu , Ming Cui , Tianyi Li

Lexical Semantic Change Detection stands out as one of the few areas where Large Language Models (LLMs) have not been extensively involved. Traditional methods like PPMI, and SGNS remain prevalent in research, alongside newer BERT-based…

计算与语言 · 计算机科学 2023-12-12 Ruiyu Wang , Matthew Choi

Integrating audio encoders with LLMs through connectors has enabled these models to process and comprehend audio modalities, significantly enhancing speech-to-text tasks, including automatic speech recognition (ASR) and automatic speech…

音频与语音处理 · 电气工程与系统科学 2024-09-18 Hongfei Xue , Wei Ren , Xuelong Geng , Kun Wei , Longhao Li , Qijie Shao , Linju Yang , Kai Diao , Lei Xie

Large Language Model (LLM) alignment conventionally relies on supervised fine-tuning or reinforcement learning based alignment frameworks. These methods typically require labeled or preference datasets and involve updating model weights to…

计算与语言 · 计算机科学 2025-03-21 Reem I. Masoud , Martin Ferianc , Philip Treleaven , Miguel Rodrigues

Unsupervised domain adaptation leverages abundant labeled data from various source domains to generalize onto unlabeled target data. Prior research has primarily focused on learning domain-invariant features across the source and target…

计算与语言 · 计算机科学 2025-03-10 Jie He , Wendi Zhou , Xiang Lorraine Li , Jeff Z. Pan

Large language models (LLMs) demonstrate remarkable machine translation (MT) abilities via prompting, even though they were not explicitly trained for this task. However, even given the incredible quantities of data they are trained on,…

计算与语言 · 计算机科学 2023-02-16 Marjan Ghazvininejad , Hila Gonen , Luke Zettlemoyer

The use of Large Language Models (LLMs) for program code generation has gained substantial attention, but their biases and limitations with non-English prompts challenge global inclusivity. This paper investigates the complexities of…

计算与语言 · 计算机科学 2025-05-13 Mingda Li , Abhijit Mishra , Utkarsh Mujumdar