Computation and Language · Computer Science
IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages
Mohammed Safi Ur Rahman Khan, Priyam Mehta, Ananth Sankar, Umashankar Kumaravelan +8
2024-12-02
Computation and Language · Computer Science
IndicBART: A Pre-trained Model for Indic Natural Language Generation
Raj Dabre, Himani Shrotriya, Anoop Kunchukuttan, Ratish Puduppully +2
2022-10-28
Computation and Language · Computer Science
IndicNLG Benchmark: Multilingual Datasets for Diverse NLG Tasks in Indic Languages
Aman Kumar, Himani Shrotriya, Prachi Sahu, Raj Dabre +5
2022-10-28
Computation and Language · Computer Science
AI4Bharat-IndicNLP Corpus: Monolingual Corpora and Word Embeddings for Indic Languages
Anoop Kunchukuttan, Divyanshu Kakwani, Satish Golla, Gokul N. C. +3
2020-05-04
Computation and Language · Computer Science
Building pre-train LLM Dataset for the INDIC Languages: a case study on Hindi
Shantipriya Parida, Shakshi Panwar, Kusum Lata, Sanskruti Mishra +1
2024-07-16
Computation and Language · Computer Science
CodemixedNLP: An Extensible and Open NLP Toolkit for Code-Mixing
Sai Muralidhar Jayanthi, Kavya Nerella, Khyathi Raghavi Chandu, Alan W Black
2021-06-14
Computation and Language · Computer Science
Trankit: A Light-Weight Transformer-based Toolkit for Multilingual Natural Language Processing
Minh Van Nguyen, Viet Dac Lai, Amir Pouran Ben Veyseh, Thien Huu Nguyen
2021-10-18
Computation and Language · Computer Science
HPLT 3.0: Very Large-Scale Multilingual Resources for LLMs and MT. Mono- and Bi-lingual Data, Multilingual Evaluation, and Pre-Trained Models
Stephan Oepen, Nikolay Arefev, Mikko Aulamo, Marta Bañón +28
2026-04-21
Computation and Language · Computer Science
EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing
Chengyu Wang, Minghui Qiu, Chen Shi, Taolin Zhang +6
2023-03-14
Computation and Language · Computer Science
mahaNLP: A Marathi Natural Language Processing Library
Vidula Magdum, Omkar Dhekane, Sharayu Hiwarkhedkar, Saloni Mittal +1
2023-11-07
Computation and Language · Computer Science
Improving Multilingual Instruction Finetuning via Linguistically Natural and Diverse Datasets
Sathish Reddy Indurthi, Wenxuan Zhou, Shamil Chollampatt, Ravi Agrawal +3
2024-07-03
Computation and Language · Computer Science
ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings
Shibo Hao, Tianyang Liu, Zhen Wang, Zhiting Hu
2024-01-17
Computation and Language · Computer Science
Improving Multilingual Neural Machine Translation System for Indic Languages
Sudhansu Bala Das, Atharv Biradar, Tapas Kumar Mishra, Bidyut Kumar Patra
2024-03-18
Computation and Language · Computer Science
IndicGenBench: A Multilingual Benchmark to Evaluate Generation Capabilities of LLMs on Indic Languages
Harman Singh, Nitish Gupta, Shikhar Bharadwaj, Dinesh Tewari +1
2024-08-09
Computation and Language · Computer Science
OpenICL: An Open-Source Framework for In-context Learning
Zhenyu Wu, YaoXiang Wang, Jiacheng Ye, Jiangtao Feng +3
2023-03-07
Computation and Language · Computer Science
Indic-TunedLens: Interpreting Multilingual Models in Indian Languages
Mihir Panchal, Deeksha Varshney, Mamta, Asif Ekbal
2026-02-19
Computation and Language · Computer Science
Navigating Text-to-Image Generative Bias across Indic Languages
Surbhi Mittal, Arnav Sudan, Mayank Vatsa, Richa Singh +2
2024-08-02