中文
相关论文

相关论文: FinGPT: Instruction Tuning Benchmark for Open-Sour…

200 篇论文

Fine-tuning large language models is a popular choice among users trying to adapt them for specific applications. However, fine-tuning these models is a demanding task because the user has to examine several factors, such as resource…

机器学习 · 计算机科学 2024-06-07 Arjun Singh , Nikhil Pandey , Anup Shirgaonkar , Pavan Manoj , Vijay Aski

The potential of large language models (LLMs) to simultaneously perform a wide range of natural language processing (NLP) tasks has been the subject of extensive research. Although instruction tuning has proven to be a data-efficient method…

计算与语言 · 计算机科学 2023-10-25 Chufan Shi , Yixuan Su , Cheng Yang , Yujiu Yang , Deng Cai

Federated Learning (FL) enables training models across decentralized data silos while preserving client data privacy. Recent research has explored efficient methods for post-training large language models (LLMs) within FL to address…

机器学习 · 计算机科学 2025-08-25 Tao Guo , Junxiao Wang , Fushuo Huo , Laizhong Cui , Song Guo , Jie Gui , Dacheng Tao

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

计算与语言 · 计算机科学 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

As educational systems evolve, ensuring that assessment items remain aligned with content standards is essential for maintaining fairness and instructional relevance. Traditional human alignment reviews are accurate but slow and…

人工智能 · 计算机科学 2025-11-26 Farzan Karimi-Malekabadi , Pooya Razavi , Sonya Powers

The advancement of Large Language Models (LLMs) for domain applications in fields such as materials science and engineering depends on the development of fine-tuning strategies that adapt models for specialized, technical capabilities. In…

计算与语言 · 计算机科学 2024-09-06 Wei Lu , Rachel K. Luu , Markus J. Buehler

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

人工智能 · 计算机科学 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Generative large language models (LLMs) are a promising alternative to pre-trained language models for entity matching due to their high zero-shot performance and ability to generalize to unseen entities. Existing research on using LLMs for…

计算与语言 · 计算机科学 2025-05-22 Aaron Steiner , Ralph Peeters , Christian Bizer

Financial sentiment analysis is critical for valuation and investment decision-making. Traditional NLP models, however, are limited by their parameter size and the scope of their training datasets, which hampers their generalization…

计算与语言 · 计算机科学 2023-11-07 Boyu Zhang , Hongyang Yang , Tianyu Zhou , Ali Babar , Xiao-Yang Liu

The era of large language models (LLM) raises questions not only about how to train models, but also about how to evaluate them. Despite numerous existing benchmarks, insufficient attention is often given to creating assessments that test…

Large Language Models (LLMs) have demonstrated impressive success across various tasks. Integrating LLMs with Federated Learning (FL), a paradigm known as FedLLM, offers a promising avenue for collaborative model adaptation while preserving…

机器学习 · 计算机科学 2026-02-25 Yebo Wu , Chunlin Tian , Jingguang Li , He Sun , Kahou Tam , Zhanting Zhou , Haicheng Liao , Jing Xiong , Zhijiang Guo , Li Li , Chengzhong Xu

Instruction fine-tuning is crucial for today's large language models (LLMs) to learn to follow instructions and align with human preferences. Conventionally, supervised data, including the instruction and the correct response, is required…

计算与语言 · 计算机科学 2024-09-04 Juncheng Xie , Shensian Syu , Hung-yi Lee

Prompts for pre-trained language models (PLMs) have shown remarkable performance by bridging the gap between pre-training tasks and various downstream tasks. Among these methods, prompt tuning, which freezes PLMs and only tunes soft…

计算与语言 · 计算机科学 2022-03-15 Yuxian Gu , Xu Han , Zhiyuan Liu , Minlie Huang

Large Language Models (LLMs) generate responses to questions; however, their effectiveness is often hindered by sub-optimal quality of answers and occasional failures to provide accurate responses to questions. To address these challenges,…

计算与语言 · 计算机科学 2024-02-06 Liang Zhang , Katherine Jijo , Spurthi Setty , Eden Chung , Fatima Javid , Natan Vidra , Tommy Clifford

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

计算与语言 · 计算机科学 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer

Inspired by the recent advancements of Large Language Models (LLMs) in NLP tasks, there's growing interest in applying LLMs to graph-related tasks. This study delves into the capabilities of instruction-following LLMs for engaging with…

计算与语言 · 计算机科学 2024-08-13 Kerui Zhu , Bo-Wei Huang , Bowen Jin , Yizhu Jiao , Ming Zhong , Kevin Chang , Shou-De Lin , Jiawei Han

In recent years, large language models (LLMs) have significantly advanced the field of natural language processing (NLP). By fine-tuning LLMs with data from specific scenarios, these foundation models can better adapt to various downstream…

计算与语言 · 计算机科学 2024-11-05 Jiaqi Wu , Simin Chen , Yuzhe Yang , Yijiang Li , Shiyue Hou , Rui Jing , Zehua Wang , Wei Chen , Zijian Tian

Current large language models (LLMs) have proven useful for analyzing financial data, but most existing models, such as BloombergGPT and FinGPT, lack customization for specific user needs. In this paper, we address this gap by developing…

计算工程、金融与科学 · 计算机科学 2024-10-22 Felix Tian , Ajay Byadgi , Daniel Kim , Daochen Zha , Matt White , Kairong Xiao , Xiao-Yang Liu Yanglet

Trained on massive publicly available data, large language models (LLMs) have demonstrated tremendous success across various fields. While more data contributes to better performance, a disconcerting reality is that high-quality public data…

机器学习 · 计算机科学 2024-02-13 Rui Ye , Wenhao Wang , Jingyi Chai , Dihan Li , Zexi Li , Yinda Xu , Yaxin Du , Yanfeng Wang , Siheng Chen

Large language models (LLMs) have emerged as powerful tools in natural language processing (NLP), showing a promising future of artificial generated intelligence (AGI). Despite their notable performance in the general domain, LLMs have…

计算与语言 · 计算机科学 2025-01-23 Jingyuan Chen , Tao Wu , Wei Ji , Fei Wu