中文
相关论文

相关论文: Fine-Tuning Small Language Models for Domain-Speci…

200 篇论文

Recent advances in language models opened new opportunities to address complex schema matching tasks. Schema matching approaches have been proposed that demonstrate the usefulness of language models, but they have also uncovered important…

数据库 · 计算机科学 2025-06-18 Yurong Liu , Eduardo Pena , Aecio Santos , Eden Wu , Juliana Freire

As modern networks grow in scale and complexity, manual configuration becomes increasingly inefficient and prone to human error. While intent-driven self-configuration using large language models has shown significant promise, such models…

网络与互联网体系结构 · 计算机科学 2025-12-03 Oscar G. Lira , Oscar M. Caicedo , Nelson L. S. Da Fonseca

The landscape for building conversational interfaces (chatbots) has witnessed a paradigm shift with recent developments in generative Artificial Intelligence (AI) based Large Language Models (LLMs), such as ChatGPT by OpenAI (GPT3.5 and…

人机交互 · 计算机科学 2024-07-23 Sumit Soman , Ranjani H G

Large Language Models (LLMs) exploit fine-tuning as a technique to adapt to diverse goals, thanks to task-specific training data. Task specificity should go hand in hand with domain orientation, that is, the specialization of an LLM to…

计算与语言 · 计算机科学 2023-09-20 Teodoro Baldazzi , Luigi Bellomarini , Stefano Ceri , Andrea Colombo , Andrea Gentili , Emanuel Sallinger

Recent advances in large language models (LLMs) provide robots with contextual reasoning abilities to comprehend human instructions. Yet, current LLM-enabled robots typically depend on cloud-based models or high-performance computing…

机器人学 · 计算机科学 2026-04-15 Wenhao Wang , Yanyan Li , Long Jiao , Jiawei Yuan

Mobile Large Language Models (LLMs) are revolutionizing diverse fields such as healthcare, finance, and education with their ability to perform advanced natural language processing tasks on-the-go. However, the deployment of these models in…

密码学与安全 · 计算机科学 2025-09-03 Honghui Xu , Kaiyang Li , Wei Chen , Danyang Zheng , Zhiyuan Li , Zhipeng Cai

Large Language Models (LLMs) have emerged as a significant advancement in the field of Natural Language Processing (NLP), demonstrating remarkable capabilities in language generation and other language-centric tasks. Despite their…

计算与语言 · 计算机科学 2024-02-27 Tasnim Ahmed , Nicola Piovesan , Antonio De Domenico , Salimur Choudhury

Small language models (SLMs) have become increasingly prominent in the deployment on edge devices due to their high efficiency and low computational cost. While researchers continue to advance the capabilities of SLMs through innovative…

密码学与安全 · 计算机科学 2025-05-27 Sibo Yi , Tianshuo Cong , Xinlei He , Qi Li , Jiaxing Song

While most deployed speech recognition systems today still run on servers, we are in the midst of a transition towards deployments on edge devices. This leap to the edge is powered by the progression from traditional speech recognition…

计算与语言 · 计算机科学 2020-02-10 Yuan Shangguan , Jian Li , Qiao Liang , Raziel Alvarez , Ian McGraw

Large Language Models(LLMs)have become effective tools for natural language processing and have been used in many different fields. This essay offers a succinct summary of various LLM subcategories. The survey emphasizes recent developments…

计算与语言 · 计算机科学 2023-07-21 Saurabh Pahune , Manoj Chandrasekharan

Language models (LMs) have demonstrated remarkable capabilities in NLP, yet adapting them efficiently and robustly to specific tasks remains challenging. As their scale and complexity grow, fine-tuning LMs on labelled data often…

计算与语言 · 计算机科学 2025-06-27 Zhengyan Shi

The limited reasoning capabilities of small language models (SLMs) cast doubt on their suitability for tasks demanding deep, multi-step logical deduction. This paper introduces a framework called Small Reasons, Large Hints (SMART), which…

计算与语言 · 计算机科学 2025-06-03 Yujin Kim , Euiin Yi , Minu Kim , Se-Young Yun , Taehyeon Kim

Deploying Large Language Models (LLMs) on edge or mobile devices offers significant benefits, such as enhanced data privacy and real-time processing capabilities. However, it also faces critical challenges due to the substantial memory…

机器学习 · 计算机科学 2024-05-07 Yu Mao , Weilan Wang , Hongchao Du , Nan Guan , Chun Jason Xue

The use of generative AI-based coding assistants like ChatGPT and Github Copilot is a reality in contemporary software development. Many of these tools are provided as remote APIs. Using third-party APIs raises data privacy and security…

软件工程 · 计算机科学 2025-01-20 Negar Alizadeh , Boris Belchev , Nishant Saurabh , Patricia Kelbert , Fernando Castor

The burgeoning field of Large Language Models (LLMs), exemplified by sophisticated models like OpenAI's ChatGPT, represents a significant advancement in artificial intelligence. These models, however, bring forth substantial challenges in…

Large language models (LLMs) hold promise for transforming healthcare, from streamlining administrative and clinical workflows to enriching patient engagement and advancing clinical decision-making. However, their successful integration…

计算机与社会 · 计算机科学 2025-04-04 Mohammed Al-Garadi , Tushar Mungle , Abdulaziz Ahmed , Abeed Sarker , Zhuqi Miao , Michael E. Matheny

Small language models (SLMs; 1-12B params, sometimes up to 20B) are sufficient and often superior for agentic workloads where the objective is schema- and API-constrained accuracy rather than open-ended generation. We synthesize recent…

人工智能 · 计算机科学 2025-10-07 Raghav Sharma , Manan Mehta

Instruction tuning is a pivotal technique for aligning large language models (LLMs) with human intentions, safety constraints, and domain-specific requirements. This survey provides a comprehensive overview of the full pipeline,…

计算与语言 · 计算机科学 2025-11-20 Xudong Han , Junjie Yang , Tianyang Wang , Ziqian Bi , Xinyuan Song , Junfeng Hao , Junhao Song

Large Language Models (LLM) and foundation models are popular as they offer new opportunities for individuals and businesses to improve natural language processing, interact with data, and retrieve information faster. However, training or…

机器学习 · 计算机科学 2024-05-03 Herbert Woisetschläger , Alexander Isenko , Shiqiang Wang , Ruben Mayer , Hans-Arno Jacobsen

Efficient adaption of large language models (LLMs) on edge devices is essential for applications requiring continuous and privacy-preserving adaptation and inference. However, existing tuning techniques fall short because of the high…