中文
相关论文

相关论文: Multimodal In-context Learning for ASR of Low-reso…

200 篇论文

In-context learning (ICL) allows a language model to improve its problem-solving capability when provided with suitable information in context. Since the choice of in-context information can be determined based on the problem itself,…

计算与语言 · 计算机科学 2025-09-12 Yinghui He , Abhishek Panigrahi , Yong Lin , Sanjeev Arora

Language Models (LLMs) have emerged as powerful reasoning engines for embodied control. In particular, In-Context Learning (ICL) enables off-the-shelf, text-only LLMs to predict robot actions without any task-specific training while…

Spoken dialog systems are slowly becoming and integral part of the human experience due to their various advantages over textual interfaces. Spoken language understanding (SLU) systems are fundamental building blocks of spoken dialog…

计算与语言 · 计算机科学 2022-05-26 Akshat Gupta

In-context learning, where pre-trained language models learn to perform tasks from task examples and instructions in their contexts, has attracted much attention in the NLP community. However, the ability of in-context learning is not fully…

计算与语言 · 计算机科学 2023-05-17 Yuxian Gu , Li Dong , Furu Wei , Minlie Huang

With the increasing capabilities of large language models (LLMs), in-context learning (ICL) has emerged as a new paradigm for natural language processing (NLP), where LLMs make predictions based on contexts augmented with a few examples. It…

计算与语言 · 计算机科学 2024-10-08 Qingxiu Dong , Lei Li , Damai Dai , Ce Zheng , Jingyuan Ma , Rui Li , Heming Xia , Jingjing Xu , Zhiyong Wu , Tianyu Liu , Baobao Chang , Xu Sun , Lei Li , Zhifang Sui

In Large Visual Language Models (LVLMs), the efficacy of In-Context Learning (ICL) remains limited by challenges in cross-modal interactions and representation disparities. To overcome these challenges, we introduce a novel Visual…

计算机视觉与模式识别 · 计算机科学 2024-02-20 Yucheng Zhou , Xiang Li , Qianning Wang , Jianbing Shen

In-context learning (ICL) improves language models' performance on a variety of NLP tasks by simply demonstrating a handful of examples at inference time. It is not well understood why ICL ability emerges, as the model has never been…

计算与语言 · 计算机科学 2023-06-28 Xiaochuang Han , Daniel Simig , Todor Mihaylov , Yulia Tsvetkov , Asli Celikyilmaz , Tianlu Wang

Large language models (LLMs) have demonstrated potential in handling spoken inputs for high-resource languages, reaching state-of-the-art performance in various tasks. However, their applicability is still less explored in low-resource…

音频与语音处理 · 电气工程与系统科学 2025-08-08 Seraphina Fong , Marco Matassoni , Alessio Brutti

Large language models (LLMs) have shown impressive capabilities across various tasks, but their performance on domain-specific tasks remains limited. While methods like retrieval augmented generation and fine-tuning can help to address…

计算与语言 · 计算机科学 2024-12-23 M. Mehdi Mojarradi , Lingyi Yang , Robert McCraith , Adam Mahdi

Large language models (LLMs) demonstrate an impressive ability to utilise information within the context of their input sequences to appropriately respond to data unseen by the LLM during its training procedure. This ability is known as…

神经与进化计算 · 计算机科学 2025-08-05 Thomas F Burns , Tomoki Fukai , Christopher J Earls

The INTERSPEECH 2025 Challenge on Multilingual Conversational Speech Language Models (MLC-SLM) promotes multilingual conversational ASR with large language models (LLMs). Our previous SHNU-mASR system adopted a competitive…

计算与语言 · 计算机科学 2026-02-03 Yuxiang Mei , Dongxing Xu , Jiaen Liang , Yanhua Long

In-context learning (ICL) has proven to be a significant capability with the advancement of Large Language models (LLMs). By instructing LLMs using few-shot demonstrative examples, ICL enables them to perform a wide range of tasks without…

计算与语言 · 计算机科学 2024-08-21 Quanyu Long , Jianda Chen , Wenya Wang , Sinno Jialin Pan

Multilingual automatic speech recognition (ASR) models have shown great promise in recent years because of the simplified model training and deployment process. Conventional methods either train a universal multilingual model without taking…

音频与语音处理 · 电气工程与系统科学 2021-07-14 Long Zhou , Jinyu Li , Eric Sun , Shujie Liu

Speech foundation models have recently demonstrated the ability to perform Speech In-Context Learning (SICL). Selecting effective in-context examples is crucial for SICL performance, yet selection methodologies remain underexplored. In this…

音频与语音处理 · 电气工程与系统科学 2025-09-18 Haolong Zheng , Yekaterina Yegorova , Mark Hasegawa-Johnson

Despite the rapid recent progress in creating accurate and compact in-context learners, most recent work focuses on in-context learning (ICL) for tasks in English. However, the ability to interact with users of languages outside English…

计算与语言 · 计算机科学 2023-04-05 Michal Štefánik , Marek Kadlčík , Piotr Gramacki , Petr Sojka

Multimodal in-context learning (ICL) is becoming a key capability that allows large vision-language models (LVLMs) to adapt to novel tasks without parameter updates, which expands their usefulness in many real-world applications. However,…

计算机视觉与模式识别 · 计算机科学 2025-12-11 Yanshu Li , Jianjiang Yang , Ziteng Yang , Bozheng Li , Ligong Han , Hongyang He , Zhengtao Yao , Yingjie Victor Chen , Songlin Fei , Dongfang Liu , Ruixiang Tang

In-context learning (ICL) unfolds as large language models become capable of inferring test labels conditioned on a few labeled samples without any gradient update. ICL-enabled large language models provide a promising step forward toward…

计算与语言 · 计算机科学 2023-06-27 Eshaan Tanwar , Subhabrata Dutta , Manish Borthakur , Tanmoy Chakraborty

In-Context Learning (ICL) enhances the performance of large language models (LLMs) with demonstrations. However, obtaining these demonstrations primarily relies on manual effort. In most real-world scenarios, users are often unwilling or…

计算与语言 · 计算机科学 2025-06-02 Jinglong Gao , Xiao Ding , Lingxiao Zou , Bing Qin , Ting Liu

Large Language Models (LLMs) excel at in-context learning (ICL), a supervised learning technique that relies on adding annotated examples to the model context. We investigate a contextual bandit version of in-context reinforcement learning…

计算与语言 · 计算机科学 2025-09-30 Giovanni Monea , Antoine Bosselut , Kianté Brantley , Yoav Artzi

Generating rational and generally accurate responses to tasks, often accompanied by example demonstrations, highlights Large Language Model's (LLM's) remarkable In-Context Learning (ICL) capabilities without requiring updates to the model's…

机器学习 · 计算机科学 2025-06-17 Debanjan Dutta , Faizanuddin Ansari , Swagatam Das