English
Related papers

Related papers: NIRANTAR: Continual Learning with New Languages an…

200 papers

Continual learning (CL) with long-tailed data distributions remains a critical challenge for real-world AI systems, where models must sequentially adapt to new classes while retaining knowledge of old ones, despite severe class imbalance.…

Machine Learning · Computer Science 2025-07-24 Hao Dai , Chong Tang , Jagmohan Chauhan

In-context learning (ICL) enables large language models (LLMs) to perform downstream tasks through advanced prompting and high-quality demonstrations. However, traditional ICL paradigms encounter significant limitations in complex reasoning…

Computation and Language · Computer Science 2025-06-03 Jinyang Wu , Mingkuan Feng , Shuai Zhang , Feihu Che , Zengqi Wen , Chonghua Liao , Jianhua Tao

We present a CLSRIL-23, a self supervised learning based audio pre-trained model which learns cross lingual speech representations from raw audio across 23 Indic languages. It is built on top of wav2vec 2.0 which is solved by training a…

Computation and Language · Computer Science 2022-01-14 Anirudh Gupta , Harveen Singh Chadha , Priyanshi Shah , Neeraj Chhimwal , Ankur Dhuriya , Rishabh Gaur , Vivek Raghavan

Language agents have shown some ability to interact with an external environment, e.g., a virtual world such as ScienceWorld, to perform complex tasks, e.g., growing a plant, without the startup costs of reinforcement learning. However,…

Despite being one of the most widely spoken languages globally, Bangla remains a low-resource language in the field of Natural Language Processing (NLP). Mainstream Automatic Speech Recognition (ASR) and Speaker Diarization systems for…

Sound · Computer Science 2026-02-27 Zarif Ishmam , Zarif Mahir , Shafnan Wasif , Md. Ishtiak Moin

Automatic Speech Recognition (ASR) traditionally assumes known domains, but adding data from a new domain raises concerns about computational inefficiencies linked to retraining models on both existing and new domains. Fine-tuning solely on…

Computation and Language · Computer Science 2024-09-25 Devang Kulshreshtha , Saket Dingliwal , Brady Houston , Nikolaos Pappas , Srikanth Ronanki

Speech LLM-based ASR often struggles with named entities and long-tail words due to strong internal language-model priors. Retrieval-augmented biasing can help, but its effectiveness depends on accurate hotword localization in…

Sound · Computer Science 2026-03-27 Shangkun Huang , Huan Shen , Wei Zou , Yunzhang Chen

Current Multilingual ASR models only support a fraction of the world's languages. Continual Learning (CL) aims to tackle this problem by adding new languages to pre-trained models while avoiding the loss of performance on existing…

Computation and Language · Computer Science 2025-01-15 Chin Yuen Kwok , Jia Qi Yip , Eng Siong Chng

Continual Learning (CL) in Automatic Speech Recognition (ASR) suffers from catastrophic forgetting when adapting to new tasks, domains, or speakers. A common strategy to mitigate this is to store a subset of past data in memory for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-06 Steven Vander Eeckt , Hugo Van hamme

We present Samanantar, the largest publicly available parallel corpora collection for Indic languages. The collection contains a total of 49.7 million sentence pairs between English and 11 Indic languages (from two language families).…

Class-incremental with repetition (CIR), where previously trained classes repeatedly introduced in future tasks, is a more realistic scenario than the traditional class incremental setup, which assumes that each task contains unseen…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Taeheon Kim , San Kim , Minhyuk Seo , Dongjae Jeon , Wonje Jeung , Jonghyun Choi

Real-world data streams naturally include the repetition of previous concepts. From a Continual Learning (CL) perspective, repetition is a property of the environment and, unlike replay, cannot be controlled by the agent. Nowadays, the…

This paper introduces an interactive continual learning paradigm where AI models dynamically learn new skills from real-time human feedback while retaining prior knowledge. This paradigm distinctively addresses two major limitations of…

Machine Learning · Computer Science 2025-05-16 Yutao Yang , Jie Zhou , Junsong Li , Qianjun Pan , Bihao Zhan , Qin Chen , Xipeng Qiu , Liang He

Automatic speech recognition research focuses on training and evaluating on static datasets. Yet, as speech models are increasingly deployed on personal devices, such models encounter user-specific distributional shifts. To simulate this…

Audio and Speech Processing · Electrical Eng. & Systems 2023-05-26 Anuj Diwan , Ching-Feng Yeh , Wei-Ning Hsu , Paden Tomasello , Eunsol Choi , David Harwath , Abdelrahman Mohamed

This paper studies the challenging continual learning (CL) setting of Class Incremental Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or classes. At any time, a single model is built that can be…

Machine Learning · Computer Science 2023-06-23 Gyuhak Kim , Changnan Xiao , Tatsuya Konishi , Bing Liu

Although Automatic Speech Recognition (ASR) in Bengali has seen significant progress, processing long-duration audio and performing robust speaker diarization remain critical research gaps. To address the severe scarcity of joint ASR and…

Sound · Computer Science 2026-02-27 Sanjid Hasan , Risalat Labib , A H M Fuad , Bayazid Hasan

Continual learning (CL) has emerged as a pivotal paradigm to enable large language models (LLMs) to dynamically adapt to evolving knowledge and sequential tasks while mitigating catastrophic forgetting-a critical limitation of the static…

Computation and Language · Computer Science 2026-03-16 Hongyang Chen , Zhongwu Sun , Hongfei Ye , Kunchi Li , Xuemin Lin

Incremental learning is one paradigm to enable model building and updating at scale with streaming data. For end-to-end automatic speech recognition (ASR) tasks, the absence of human annotated labels along with the need for privacy…

The longstanding goal of multi-lingual learning has been to develop a universal cross-lingual model that can withstand the changes in multi-lingual data distributions. There has been a large amount of work to adapt such multi-lingual models…

Computation and Language · Computer Science 2024-01-01 Meryem M'hamdi , Xiang Ren , Jonathan May

During the last few years, continual learning (CL) strategies for image classification and segmentation have been widely investigated designing innovative solutions to tackle catastrophic forgetting, like knowledge distillation and…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Elena Camuffo , Simone Milani