English
Related papers

Related papers: L3iTC at the FinLLM Challenge Task: Quantization f…

200 papers

This study explores the innovative use of Large Language Models (LLMs) as analytical tools for interpreting complex financial regulations. The primary objective is to design effective prompts that guide LLMs in distilling verbose and…

Risk Management · Quantitative Finance 2024-07-11 Zhiyu Cao , Zachary Feinstein

Memory-efficient finetuning of large language models (LLMs) has recently attracted huge attention with the increasing size of LLMs, primarily due to the constraints posed by GPU memory limitations and the effectiveness of these methods…

Machine Learning · Computer Science 2024-06-24 Baohao Liao , Christian Herold , Shahram Khadivi , Christof Monz

The application of large language models (LLMs) to healthcare information extraction has emerged as a promising approach. This study evaluates the classification performance of five open-source LLMs: GEMMA-3-27B-IT, LLAMA3-70B, LLAMA4-109B,…

Computation and Language · Computer Science 2025-05-09 Yuting Guo , Abeed Sarker

Large language models (LLMs) deliver impressive results for a variety of tasks, but state-of-the-art systems require fast GPUs with large amounts of memory. To reduce both the memory and latency of these systems, practitioners quantize…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Gautom Das , Vincent La , Ethan Lau , Abhinav Shrivastava , Matthew Gwilliam

The most recent large language models(LLMs) such as ChatGPT and GPT-4 have shown exceptional capabilities of generalist models, achieving state-of-the-art performance on a wide range of NLP tasks with little or no adaptation. How effective…

Computation and Language · Computer Science 2023-10-12 Xianzhi Li , Samuel Chan , Xiaodan Zhu , Yulong Pei , Zhiqiang Ma , Xiaomo Liu , Sameena Shah

We introduce a method that dramatically reduces fine-tuning VRAM requirements and rectifies quantization errors in quantized Large Language Models. First, we develop an extremely memory-efficient fine-tuning (EMEF) method for quantized…

Computation and Language · Computer Science 2023-06-16 Yuji Chai , John Gkountouras , Glenn G. Ko , David Brooks , Gu-Yeon Wei

Misogyny and sexism are growing problems in social media. Advances have been made in online sexism detection but the systems are often uninterpretable. SemEval-2023 Task 10 on Explainable Detection of Online Sexism aims at increasing…

Computation and Language · Computer Science 2023-06-09 Konstantin Chernyshev , Ekaterina Garanina , Duygu Bayram , Qiankun Zheng , Lukas Edman

We present FinMMR, a novel bilingual multimodal benchmark tailored to evaluate the reasoning capabilities of multimodal large language models (MLLMs) in financial numerical reasoning tasks. Compared to existing benchmarks, our work…

Low-rank approximation techniques have become the de facto standard for fine-tuning Large Language Models (LLMs) due to their reduced computational and memory requirements. This paper investigates the effectiveness of these methods in…

Machine Learning · Computer Science 2024-05-30 Saswat Das , Marco Romanelli , Cuong Tran , Zarreen Reza , Bhavya Kailkhura , Ferdinando Fioretto

Benefiting from the revolutionary advances in large language models (LLMs) and foundational vision models, large vision-language models (LVLMs) have also made significant progress. However, current benchmarks focus on tasks that evaluating…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Jiacheng Ruan , Yebin Yang , Zehao Lin , Yuchen Feng , Feiyu Xiong , Zeyun Tang , Zhiyu Li

Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks. However, their proficiency and reliability in the specialized domain of financial data analysis, particularly focusing on data-driven…

Computation and Language · Computer Science 2024-06-17 Shu Liu , Shangqing Zhao , Chenghao Jia , Xinlin Zhuang , Zhaoguang Long , Jie Zhou , Aimin Zhou , Man Lan , Qingquan Wu , Chong Yang

Summarizing software artifacts is an important task that has been thoroughly researched. For evaluating software summarization approaches, human judgment is still the most trusted evaluation. However, it is time-consuming and fatiguing for…

Software Engineering · Computer Science 2024-09-04 Abhishek Kumar , Sonia Haiduc , Partha Pratim Das , Partha Pratim Chakrabarti

Large language models (LLMs) are increasingly being applied to financial analysis, reporting, investment decision support, risk management, compliance, and professional training. However, robust evaluation of their domain competence in…

Qualitative analysis of textual contents unpacks rich and valuable information by assigning labels to the data. However, this process is often labor-intensive, particularly when working with large datasets. While recent AI-based tools…

Computation and Language · Computer Science 2023-04-24 Ziang Xiao , Xingdi Yuan , Q. Vera Liao , Rania Abdelghani , Pierre-Yves Oudeyer

As Large Language Model (LLM) capabilities advance, the demand for high-quality annotation of exponentially increasing text corpora has outpaced human capacity, leading to the widespread adoption of LLMs in automatic evaluation and…

Computation and Language · Computer Science 2026-04-02 Jiayu Wang , Junyoung Lee

Large Vision Language Models (LVLMs) have achieved remarkable success in a range of downstream tasks that require multimodal interaction, but their capabilities come with substantial computational and memory overhead, which hinders…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Ziwei Xiang , Fanhu Zeng , Hongjian Fang , Rui-Qi Wang , Renxing Chen , Yanan Zhu , Yi Chen , Peipei Yang , Xu-Yao Zhang

Fine-tuning of Large Language Models (LLMs) for downstream tasks, performed on domain-specific data has shown significant promise. However, commercial use of such LLMs is limited by the high computational cost required for their deployment…

Computation and Language · Computer Science 2025-03-06 Boris Nazarov , Darya Frolova , Yackov Lubarsky , Alexei Gaissinski , Pavel Kisilev

This paper describes the participation of QUST_NLP in the SemEval-2025 Task 7. We propose a three-stage retrieval framework specifically designed for fact-checked claim retrieval. Initially, we evaluate the performance of several retrieval…

Information Retrieval · Computer Science 2025-06-24 Youzheng Liu , Jiyan Liu , Xiaoman Xu , Taihang Wang , Yimin Wang , Ye Jiang

Despite the effectiveness of data selection for large language models (LLMs) during pretraining and instruction fine-tuning phases, improving data efficiency in supervised fine-tuning (SFT) for specialized domains poses significant…

Computation and Language · Computer Science 2024-12-06 Yu Yang , Siddhartha Mishra , Jeffrey N Chiang , Baharan Mirzasoleiman

Text-to-SQL, the task of translating natural language questions into SQL queries, is part of various business processes. Its automation, which is an emerging challenge, will empower software practitioners to seamlessly interact with…

Software Engineering · Computer Science 2024-01-10 Yewei Song , Saad Ezzini , Xunzhu Tang , Cedric Lothritz , Jacques Klein , Tegawendé Bissyandé , Andrey Boytsov , Ulrick Ble , Anne Goujon