English
Related papers

Related papers: Amharic LLaMA and LLaVA: Multimodal LLMs for Low R…

200 papers

Vision-language models (VLMs) have recently shown promise in general-purpose reasoning tasks, yet their applicability to domain-specific scientific workflows remains largely unexplored. In this work, we evaluated a series of open-weight and…

Instrumentation and Methods for Astrophysics · Physics 2026-02-10 S. Riggi

The recent surge in open-source Multimodal Large Language Models (MLLM) frameworks, such as LLaVA, provides a convenient kickoff for artificial intelligence developers and researchers. However, most of the MLLM frameworks take vision as the…

We train a suite of multimodal foundation models (MMFM) using the popular LLaVA framework with the recently released Gemma family of large language models (LLMs). Of particular interest is the 2B parameter Gemma model, which provides…

Computation and Language · Computer Science 2024-06-12 Musashi Hinck , Matthew L. Olson , David Cobbley , Shao-Yen Tseng , Vasudev Lal

Large Multimodal Models (LMMs) are typically trained on vast corpora of image-text data but are often limited in linguistic coverage, leading to biased and unfair outputs across languages. While prior work has explored multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-07-11 Ananya Raval , Aravind Narayanan , Vahid Reza Khazaie , Shaina Raza

S\'ami, an indigenous language group comprising multiple languages, faces digital marginalization due to the limited availability of data and sophisticated language models designed for its linguistic intricacies. This work focuses on…

Computation and Language · Computer Science 2024-05-10 Ronny Paul , Himanshu Buckchash , Shantipriya Parida , Dilip K. Prasad

We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets…

Large Language Models (LLMs) demonstrate remarkable translation capabilities in high-resource language tasks, yet their performance in low-resource languages is hindered by insufficient multilingual data during pre-training. To address…

Computation and Language · Computer Science 2024-10-15 Yinquan Lu , Wenhao Zhu , Lei Li , Yu Qiao , Fei Yuan

While Large Language Models (LLMs) have shown remarkable capabilities in natural language understanding and generation, their performance often lags in lower-resource, non-English languages due to biases in the training data. In this work,…

Computation and Language · Computer Science 2024-12-11 Matthieu Meeus , Anthony Rathé , François Remy , Pieter Delobelle , Jens-Joris Decorte , Thomas Demeester

Current Multimodal Large Language Models exhibit very strong performance for several demanding tasks. While commercial MLLMs deliver acceptable performance in low-resource languages, comparable results remain unattained within the open…

Computation and Language · Computer Science 2026-03-05 Lukas Arana , Julen Etxaniz , Ander Salaberria , Gorka Azkune

The advent of Large Language Models (LLMs) has significantly advanced the field of automated code generation. LLMs rely on large and diverse datasets to learn syntax, semantics, and usage patterns of programming languages. For low-resource…

Software Engineering · Computer Science 2025-02-03 Alessandro Giagnorio , Alberto Martin-Lopez , Gabriele Bavota

Recently, various studies have leveraged Large Language Models (LLMs) to help decision-making and planning in environments, and try to align the LLMs' knowledge with the world conditions. Nonetheless, the capacity of LLMs to continuously…

Machine Learning · Computer Science 2023-10-16 Yicheng Feng , Yuxuan Wang , Jiazheng Liu , Sipeng Zheng , Zongqing Lu

Large language models (LLMs) have shown continuously improving multilingual capabilities, and even small-scale open-source models have demonstrated rapid performance enhancement. In this paper, we systematically explore the abilities of…

Computation and Language · Computer Science 2025-02-25 Menglong Cui , Pengzhi Gao , Wei Liu , Jian Luan , Bin Wang

As an Indo-Aryan language with limited available data, Chakma remains largely underrepresented in language models. In this work, we introduce a novel corpus of contextually coherent Bangla-transliterated Chakma, curated from Chakma…

Computation and Language · Computer Science 2025-11-27 Adity Khisa , Nusrat Jahan Lia , Tasnim Mahfuz Nafis , Zarif Masud , Tanzir Pial , Shebuti Rayana , Ahmedul Kabir

"Bigger the better" has been the predominant trend in recent Large Language Models (LLMs) development. However, LLMs do not suit well for scenarios that require on-device processing, energy efficiency, low memory footprint, and response…

Computation and Language · Computer Science 2024-02-27 Omkar Thawakar , Ashmal Vayani , Salman Khan , Hisham Cholakal , Rao M. Anwer , Michael Felsberg , Tim Baldwin , Eric P. Xing , Fahad Shahbaz Khan

Large Language Models represent state-of-the-art linguistic models designed to equip computers with the ability to comprehend natural language. With its exceptional capacity to capture complex contextual relationships, the LLaMA (Large…

Computation and Language · Computer Science 2023-12-18 Pierpaolo Basile , Elio Musacchio , Marco Polignano , Lucia Siciliani , Giuseppe Fiameni , Giovanni Semeraro

Large Language Models (LLMs) have gained considerable notoriety in the field of natural language to SQL tasks (NL2SQL). In this study, we show how task decomposition can greatly benefit LLMs in database understanding and query generation in…

Computation and Language · Computer Science 2024-01-09 José Manuel Domínguez , Benjamín Errázuriz , Patricio Daher

The rapid progress of large language models (LLMs) raises concerns about cultural bias, fairness, and performance in diverse languages and underrepresented regions. Addressing these gaps requires large-scale resources grounded in…

Computation and Language · Computer Science 2026-04-08 Firoj Alam , Md Arid Hasan , Sahinur Rahman Laskar , Mucahid Kutlu , Kareem Darwish , Shammur Absar Chowdhury

We investigate the effectiveness of large language models (LLMs) for text diacritization in two typologically distinct languages: Arabic and Yoruba. To enable a rigorous evaluation, we introduce a novel multilingual dataset MultiDiac, with…

Computation and Language · Computer Science 2026-03-18 Hawau Olamide Toyin , Samar Mohamed Magdy , Hanan Aldarmaki

Large Language Models (LLMs) are the engines driving today's AI agents. The better these models understand human languages, the more natural and user-friendly the interaction with AI becomes, from everyday devices like computers and…

Computation and Language · Computer Science 2025-11-24 Mohamed Mahdi

How to efficiently transform large language models (LLMs) into instruction followers is recently a popular research direction, while training LLM for multi-modal reasoning remains less explored. Although the recent LLaMA-Adapter…

Computer Vision and Pattern Recognition · Computer Science 2023-05-01 Peng Gao , Jiaming Han , Renrui Zhang , Ziyi Lin , Shijie Geng , Aojun Zhou , Wei Zhang , Pan Lu , Conghui He , Xiangyu Yue , Hongsheng Li , Yu Qiao