中文
相关论文

相关论文: Mukhyansh: A Headline Generation Dataset for Indic…

200 篇论文

This work presents BanglaNLG, a comprehensive benchmark for evaluating natural language generation (NLG) models in Bangla, a widely spoken yet low-resource language. We aggregate six challenging conditional text generation tasks under the…

计算与语言 · 计算机科学 2023-02-14 Abhik Bhattacharjee , Tahmid Hasan , Wasi Uddin Ahmad , Rifat Shahriyar

With the rise of online abuse, the NLP community has begun investigating the use of neural architectures to generate counterspeech that can "counter" the vicious tone of such abusive speech and dilute/ameliorate their rippling effect over…

计算与语言 · 计算机科学 2024-02-13 Mithun Das , Saurabh Kumar Pandey , Shivansh Sethi , Punyajoy Saha , Animesh Mukherjee

Number-focused headline generation is a summarization task requiring both high textual quality and precise numerical accuracy, which poses a unique challenge for Large Language Models (LLMs). Existing studies in the literature focus only on…

计算与语言 · 计算机科学 2025-02-06 Zhen Qian , Xiuzhen Zhang , Xiaofei Xu , Feng Xia

We present sentence aligned parallel corpora across 10 Indian Languages - Hindi, Telugu, Tamil, Malayalam, Gujarati, Urdu, Bengali, Oriya, Marathi, Punjabi, and English - many of which are categorized as low resource. The corpora are…

计算与语言 · 计算机科学 2020-07-16 Shashank Siripragada , Jerin Philip , Vinay P. Namboodiri , C V Jawahar

India's linguistic landscape is one of the most diverse in the world, comprising over 120 major languages and approximately 1,600 additional languages, with 22 officially recognized as scheduled languages in the Indian Constitution. Despite…

This paper presents the challenges in creating and managing large parallel corpora of 12 major Indian languages (which is soon to be extended to 23 languages) as part of a major consortium project funded by the Department of Information…

计算与语言 · 计算机科学 2021-12-06 Ritesh Kumar , Shiv Bhusan Kaushik , Pinkey Nainwani , Girish Nath Jha

Evaluating Large Language Models (LLMs) in low-resource and linguistically diverse languages remains a significant challenge in NLP, particularly for languages using non-Latin scripts like those spoken in India. Existing benchmarks…

计算与语言 · 计算机科学 2025-02-05 Sshubam Verma , Mohammed Safi Ur Rahman Khan , Vishwajeet Kumar , Rudra Murthy , Jaydeep Sen

Automatic text summarization, particularly headline generation, remains a critical yet underexplored area for Bengali religious news. Existing approaches to headline generation typically rely solely on the article content, overlooking…

计算与语言 · 计算机科学 2025-01-03 Md Osama , Ashim Dey , Kawsar Ahmed , Muhammad Ashad Kabir

Lexicon or dictionary generation across domains has the potential for societal impact, as it can potentially enhance information accessibility for a diverse user base while preserving language identity. Prior work in the field primarily…

计算与语言 · 计算机科学 2025-06-03 Ayush Maheshwari , Atul Kumar Singh , Karthika NJ , Krishnakant Bhatt , Preethi Jyothi , Ganesh Ramakrishnan

India is a multilingual society with 1369 rationalized languages and dialects being spoken across the country (INDIA, 2011). Of these, the 22 scheduled languages have a staggering total of 1.17 billion speakers and 121 languages have more…

Multimodal research has predominantly focused on single-image reasoning, with limited exploration of multi-image scenarios. Recent models have sought to enhance multi-image understanding through large-scale pretraining on interleaved…

Automatic question generation (QG) is a challenging problem in natural language understanding. QG systems are typically built assuming access to a large number of training instances where each instance is a question and its corresponding…

计算与语言 · 计算机科学 2019-06-07 Vishwajeet Kumar , Nitish Joshi , Arijit Mukherjee , Ganesh Ramakrishnan , Preethi Jyothi

In this paper, we introduce Neural Information Retrieval resources for 11 widely spoken Indian Languages (Assamese, Bengali, Gujarati, Hindi, Kannada, Malayalam, Marathi, Oriya, Punjabi, Tamil, and Telugu) from two major Indian language…

信息检索 · 计算机科学 2023-12-18 Saiful Haq , Ashutosh Sharma , Pushpak Bhattacharyya

Language models based on the Transformer architecture have achieved state-of-the-art performance on a wide range of NLP tasks such as text classification, question-answering, and token classification. However, this performance is usually…

计算与语言 · 计算机科学 2020-11-05 Kushal Jain , Adwait Deshpande , Kumar Shridhar , Felix Laumann , Ayushman Dash

Automatic summarization of legal case judgments is a practically important problem that has attracted substantial research efforts in many countries. In the context of the Indian judiciary, there is an additional complexity -- Indian legal…

计算与语言 · 计算机科学 2023-10-31 Debtanu Datta , Shubham Soni , Rajdeep Mukherjee , Saptarshi Ghosh

We present the IndicNLP corpus, a large-scale, general-domain corpus containing 2.7 billion words for 10 Indian languages from two language families. We share pre-trained word embeddings trained on these corpora. We create news article…

Millions of news articles published online daily can overwhelm readers. Headlines and entity (topic) tags are essential for guiding readers to decide if the content is worth their time. While headline generation has been extensively…

计算与语言 · 计算机科学 2024-06-10 Faisal Tareque Shohan , Mir Tafseer Nayeem , Samsul Islam , Abu Ubaida Akash , Shafiq Joty

We explore the impact of leveraging the relatedness of languages that belong to the same family in NLP models using multilingual fine-tuning. We hypothesize and validate that multilingual fine-tuning of pre-trained language models can yield…

Large language models (LLMs) are increasingly deployed in multilingual applications but often generate plausible yet incorrect or misleading outputs, known as hallucinations. While hallucination detection has been studied extensively in…

计算与语言 · 计算机科学 2025-12-02 Hrishikesh Terdalkar , Kirtan Bhojani , Aryan Dongare , Omm Aditya Behera

In this work, we introduce L3Cube-IndicNews, a multilingual text classification corpus aimed at curating a high-quality dataset for Indian regional languages, with a specific focus on news headlines and articles. We have centered our work…

计算与语言 · 计算机科学 2024-04-30 Aishwarya Mirashi , Srushti Sonavane , Purva Lingayat , Tejas Padhiyar , Raviraj Joshi