中文
相关论文

相关论文: Small Models, Big Tasks: An Exploratory Empirical …

200 篇论文

Natural language processing (NLP) is a key technology to extract important patient information from clinical narratives to support healthcare applications. The rapid development of large language models (LLMs) has revolutionized many NLP…

计算与语言 · 计算机科学 2025-09-08 Cheng Peng , Xinyu Dong , Mengxian Lyu , Daniel Paredes , Yaoyun Zhang , Yonghui Wu

The interest in developing small language models (SLM) for on-device deployment is fast growing. However, the existing SLM design hardly considers the device hardware characteristics. Instead, this work presents a simple yet effective…

计算与语言 · 计算机科学 2024-11-11 Rongjie Yi , Xiang Li , Weikai Xie , Zhenyan Lu , Chenghua Wang , Ao Zhou , Shangguang Wang , Xiwen Zhang , Mengwei Xu

Large Language Models (LLMs), with their remarkable ability to tackle challenging and unseen reasoning problems, hold immense potential for tabular learning, that is vital for many real-world applications. In this paper, we propose a novel…

机器学习 · 计算机科学 2024-05-07 Sungwon Han , Jinsung Yoon , Sercan O Arik , Tomas Pfister

As organizations scale adoption of generative AI, model cost optimization and operational efficiency have emerged as critical factors determining sustainability and accessibility. While Large Language Models (LLMs) demonstrate impressive…

人工智能 · 计算机科学 2026-03-11 Polaris Jhandi , Owais Kazi , Shreyas Subramanian , Neel Sendas

Large language models (LLMs) have the potential to enhance K-12 STEM education by improving both teaching and learning processes. While previous studies have shown promising results, there is still a lack of comprehensive understanding…

计算与语言 · 计算机科学 2024-10-16 Eason Chen , Danyang Wang , Luyi Xu , Chen Cao , Xiao Fang , Jionghao Lin

Large language models (LLMs) are increasingly used to extract structured information from free-text clinical records, but prior work often focuses on single tasks, limited models, and English-language reports. We evaluated 15 open-weight…

Many recent studies have shown the ability of large language models (LLMs) to achieve state-of-the-art performance on many NLP tasks, such as question answering, text summarization, coding, and translation. In some cases, the results…

Large Language Models (LLMs) have demonstrated promise in medical knowledge assessments, yet their practical utility in real-world clinical decision-making remains underexplored. In this study, we evaluated the performance of three…

计算与语言 · 计算机科学 2025-12-30 Mengdi Chai , Ali R. Zomorrodi

A number of tasks have been proposed recently to facilitate easy access to charts such as chart QA and summarization. The dominant paradigm to solve these tasks has been to fine-tune a pretrained model on the task data. However, this…

计算与语言 · 计算机科学 2023-12-19 Xuan Long Do , Mohammad Hassanpour , Ahmed Masry , Parsa Kavehzadeh , Enamul Hoque , Shafiq Joty

Large language models (LLMs) can be used as accessible and intelligent chatbots by constructing natural language queries and directly inputting the prompt into the large language model. However, different prompt' constructions often lead to…

计算与语言 · 计算机科学 2023-12-14 Jinta Weng , Jiarui Zhang , Yue Hu , Daidong Fa , Xiaofeng Xuand , Heyan Huang

Research to improve Automated Short Answer Grading has recently focused on Large Language Models (LLMs) with prompt engineering and no- or few-shot prompting to achieve best results. This is in contrast to the fine-tuning approach, which…

机器学习 · 计算机科学 2025-08-07 Joel Walsh , Siddarth Mamidanna , Benjamin Nye , Mark Core , Daniel Auerbach

Slot filling is a crucial subtask in spoken language understanding (SLU), traditionally implemented as a cascade of speech recognition followed by one or more natural language understanding (NLU) components. The recent advent of…

计算与语言 · 计算机科学 2025-10-20 Kadri Hacioglu , Manjunath K E , Andreas Stolcke

Small language models (SLMs; 1-12B params, sometimes up to 20B) are sufficient and often superior for agentic workloads where the objective is schema- and API-constrained accuracy rather than open-ended generation. We synthesize recent…

人工智能 · 计算机科学 2025-10-07 Raghav Sharma , Manan Mehta

Large Language Models are expressive tools that enable complex tasks of text understanding within Computational Social Science. Their versatility, while beneficial, poses a barrier for establishing standardized best practices within the…

计算机与社会 · 计算机科学 2024-08-05 Anders Giovanni Møller , Luca Maria Aiello

Software documentation is essential for program comprehension, developer onboarding, code review, and long-term maintenance. Yet producing quality documentation manually is time-consuming and frequently yields incomplete or inconsistent…

软件工程 · 计算机科学 2026-04-20 Afia Farjana , Zaiyu Cheng , Antonio Mastropaolo

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

软件工程 · 计算机科学 2026-04-07 Rabia Iftikhar , Andreas Rausch

Multilingual Large Language Models (LLMs) have recently shown great capabilities in a wide range of tasks, exhibiting state-of-the-art performance through zero-shot or few-shot prompting methods. While there have been extensive studies on…

计算与语言 · 计算机科学 2023-10-24 Ruochen Zhang , Samuel Cahyawijaya , Jan Christian Blaise Cruz , Genta Indra Winata , Alham Fikri Aji

Large language models (LLMs) excel in text generation; however, these creative elements require heavy computation and are accompanied by a steep cost. Especially for targeted applications such as sales and marketing outreach, these costs…

计算与语言 · 计算机科学 2025-08-22 Ishaan Bhola , Mukunda NS , Sravanth Kurmala , Harsh Nandwani , Arihant Jain

Large language models (LLMs) can capture rich representations of concepts that are useful for real-world tasks. However, language alone is limited. While existing LLMs excel at text-based inferences, health applications require that models…

Instruction-tuned Language Models ILMs have become essential components of modern AI systems, demonstrating exceptional versatility across a wide range of natural language and reasoning tasks. Among their most impactful applications is code…