English
Related papers

Related papers: Teaching LLMs to Speak Spectroscopy

200 papers

We explore the feasibility of large language models (LLMs) in detecting subtle expressions of micro-behaviors in team conversations using transcripts collected during simulated space missions. Specifically, we examine zero-shot…

Computation and Language · Computer Science 2025-07-01 Ankush Raut , Projna Paromita , Sydney Begerowski , Suzanne Bell , Theodora Chaspari

Recently, decoder-only pre-trained large language models (LLMs), with several tens of billion parameters, have significantly impacted a wide range of natural language processing (NLP) tasks. While encoder-only or encoder-decoder pre-trained…

Computation and Language · Computer Science 2024-03-11 Aru Maekawa , Tsutomu Hirao , Hidetaka Kamigaito , Manabu Okumura

General-purpose large language models (LLMs), despite their broad capabilities, often struggle with specialized domain knowledge. This gap hinders their deployment as reliable research agents in demanding fields such as astronomy. Building…

Instrumentation and Methods for Astrophysics · Physics 2026-02-23 Tijmen de Haan , Yuan-Sen Ting , Tirthankar Ghosal , Tuan Dung Nguyen , Alberto Accomazzi , Emily Herron , Vanessa Lama , Rui Pan , Azton Wells , Nesar Ramachandra

Writing radiology reports from medical images requires a high level of domain expertise. It is time-consuming even for trained radiologists and can be error-prone for inexperienced radiologists. It would be appealing to automate this task…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yuzhe Lu , Sungmin Hong , Yash Shah , Panpan Xu

A prior-informed large language model (LLM) driven multi-task learning framework is proposed for the unified description of multiple nuclear observables. By fine-tuning the pre-trained DeepSeek-R1-1.5B model with Low-Rank Adaptation (LoRA),…

Nuclear Theory · Physics 2026-05-29 S. J. Guo , S. Y. Wang , E. H. Wang , Z. M. Niu , Y. M. Ding

Large Language Models have shown remarkable capabilities in the NLP domain. Their effectiveness can mainly be attributed to their ability to adapt to an array of downstream tasks. However, generally, full fine-tuning is a computationally…

Computation and Language · Computer Science 2025-06-10 Harsh Bihany , Shubham Patel , Ashutosh Modi

This paper presents a novel approach to fine-tuning the Qwen2-1.5B model for Arabic language processing using Quantized Low-Rank Adaptation (QLoRA) on a system with only 4GB VRAM. We detail the process of adapting this large language model…

Computation and Language · Computer Science 2024-12-24 Prakash Aryan

Although Large Language Models (LLMs) have shown promise for human-like conversations, they are primarily pre-trained on text data. Incorporating audio or video improves performance, but collecting large-scale multimodal data and…

Running Large Language Models (LLMs) on edge devices is constrained by high compute and memory demands posing a barrier for real-time applications in sectors like healthcare, education, and embedded systems. Current solutions such as…

Fine-tuning large language models (LLMs) aims to adapt pre-trained models to specific tasks using relatively small and domain-specific datasets. Among Parameter-Efficient Fine-Tuning (PEFT) methods, Low-Rank Adaptation (LoRA) stands out by…

Computation and Language · Computer Science 2026-04-16 Yarui Cao , Kai Liu

Large language models (LLMs) are computationally intensive. The computation workload and the memory footprint grow quadratically with the dimension (layer width). Most of LLMs' parameters come from the linear layers of the transformer…

Machine Learning · Computer Science 2024-02-22 Xiao-Yang Liu , Jie Zhang , Guoxuan Wang , Weiqing Tong , Anwar Walid

We present LLaMA-Adapter, a lightweight adaption method to efficiently fine-tune LLaMA into an instruction-following model. Using 52K self-instruct demonstrations, LLaMA-Adapter only introduces 1.2M learnable parameters upon the frozen…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Renrui Zhang , Jiaming Han , Chris Liu , Peng Gao , Aojun Zhou , Xiangfei Hu , Shilin Yan , Pan Lu , Hongsheng Li , Yu Qiao

Training large language models (LLMs) for pretraining or adapting to new tasks and domains has become increasingly critical as their applications expand. However, as the model and the data sizes grow, the training process presents…

Machine Learning · Computer Science 2024-12-17 Amrutha Varshini Ramesh , Vignesh Ganapathiraman , Issam H. Laradji , Mark Schmidt

Large language models (LLMs) demonstrate extraordinary abilities in a wide range of natural language processing (NLP) tasks. In this paper, we show that, beyond text understanding capability, LLMs are capable of processing text layouts that…

Computation and Language · Computer Science 2024-08-29 Weiming Li , Manni Duan , Dong An , Yan Shao

Large language models (LLMs) are increasingly used across research and industry applications, yet their inference efficiency remains a significant challenge. As the computational power of modern GPU architectures continuously improves,…

Despite the efficacy of network sparsity in alleviating the deployment strain of Large Language Models (LLMs), it endures significant performance degradation. Applying Low-Rank Adaptation (LoRA) to fine-tune the sparse LLMs offers an…

Machine Learning · Computer Science 2025-02-21 Weizhong Huang , Yuxin Zhang , Xiawu Zheng , Yang Liu , Jing Lin , Yiwu Yao , Rongrong Ji

Text generation with Large Language Models (LLMs) is known to be memory bound due to the combination of their auto-regressive nature, huge parameter counts, and limited memory bandwidths, often resulting in low token rates. Speculative…

Machine Learning · Computer Science 2024-05-15 Raghavv Goel , Mukul Gagrani , Wonseok Jeon , Junyoung Park , Mingu Lee , Christopher Lott

Multilingual Large Language Models (LLMs) often provide suboptimal performance on low-resource languages like Urdu. This paper introduces UrduLLaMA 1.0, a model derived from the open-source Llama-3.1-8B-Instruct architecture and continually…

Computation and Language · Computer Science 2025-02-25 Layba Fiaz , Munief Hassan Tahir , Sana Shams , Sarmad Hussain

Large language models (LLMs) have advanced the state of the art in natural language processing. However, their predominant design for English or a limited set of languages creates a substantial gap in their effectiveness for low-resource…

Computation and Language · Computer Science 2024-04-04 Peiqin Lin , Shaoxiong Ji , Jörg Tiedemann , André F. T. Martins , Hinrich Schütze

We propose a neural language modeling system based on low-rank adaptation (LoRA) for speech recognition output rescoring. Although pretrained language models (LMs) like BERT have shown superior performance in second-pass rescoring, the high…