中文
相关论文

相关论文: Skill Weaving: Efficient LLM Improvement via Modul…

200 篇论文

Large Language Models (LLMs) have demonstrated remarkable success in various tasks such as natural language understanding, text summarization, and machine translation. However, their general-purpose nature often limits their effectiveness…

计算与语言 · 计算机科学 2025-09-03 Zirui Song , Bin Yan , Yuhan Liu , Miao Fang , Mingzhe Li , Rui Yan , Xiuying Chen

This paper introduces a multifaceted methodology for fine-tuning and evaluating large language models (LLMs) for specialized monetization tasks. The goal is to balance general language proficiency with domain-specific skills. The…

计算与语言 · 计算机科学 2023-10-10 Zheng Zhang , Chen Zheng , Da Tang , Ke Sun , Yukun Ma , Yingtong Bu , Xun Zhou , Liang Zhao

Large Language Models (LLMs) have shown impressive versatility as general purpose models. However, their broad applicability comes at a high-cost computational overhead, particularly in auto-regressive decoding where each step requires a…

计算与语言 · 计算机科学 2025-08-04 Itay Nakash , Nitay Calderon , Eyal Ben David , Elad Hoffer , Roi Reichart

In this work, we develop a specialized dataset aimed at enhancing the evaluation and fine-tuning of large language models (LLMs) specifically for wireless communication applications. The dataset includes a diverse set of multi-hop…

机器学习 · 计算机科学 2025-01-17 Yushen Lin , Ruichen Zhang , Wenqi Huang , Kaidi Wang , Zhiguo Ding , Daniel K. C. So , Dusit Niyato

Large language model (LLM) agent systems are increasingly expected to improve after deployment, but existing work often decouples two adaptation targets: skill evolution and multi-agent system (MAS) restructuring. This separation can create…

多智能体系统 · 计算机科学 2026-05-19 Shuai Pan , Yixiang Liu , Jiaye Gao , Te Gao , Weiwen Liu , Jianghao Lin , Zhihui Fu , Jun Wang , Weinan Zhang , Yong Yu

Agent skills provide a lightweight way to adapt LLM agents to specialized domains by storing reusable procedural knowledge in structured files. However, whether downloaded from third parties or self-generated, these skills are often…

人工智能 · 计算机科学 2026-05-28 Hanyu Wang , Yifan Lan , Bochuan Cao , Lu Lin , Jinghui Chen

Large language models (LLMs) have shown great potential in domain-specific machine translation (MT). However, one major issue is that LLMs pre-trained on general domain corpus might not generalize well to specific domains due to the lack of…

计算与语言 · 计算机科学 2024-12-18 Jiawei Zheng , Hanghai Hong , Feiyan Liu , Xiaoli Wang , Jingsong Su , Yonggui Liang , Shikai Wu

Clinical text improvement is vital for healthcare efficiency but remains difficult due to limited high-quality data and the complex constraints of medical documentation. While Large Language Models (LLMs) show promise, current approaches…

计算与语言 · 计算机科学 2026-02-03 Ziyan Xiao , Yinghao Zhu , Liang Peng , Lequan Yu

Large language model (LLM) agents often struggle in long-context interactions. As the agent accumulates more interaction history, context management approaches such as sliding window and prompt compression may omit earlier structured…

计算与语言 · 计算机科学 2026-04-28 Yating Wu , Yuhao Zhang , Sayan Ghosh , Sourya Basu , Anoop Deoras , Jun Huan , Gaurav Gupta

How can we teach large multimodal models (LMMs) new skills without erasing prior abilities? We study sequential fine-tuning on five target skills while monitoring general ability on eight held-out benchmarks across three model families.…

人工智能 · 计算机科学 2026-04-22 Zhen Zhu , Yiming Gong , Yao Xiao , Yaoyao Liu , Derek Hoiem

Recent development in Large Language Models (LLMs) and Multi-modal Large Language Models (MLLMs) have leverage Attention-based Transformer architectures and achieved superior performance and generalization capabilities. They have since…

Large language models (LLMs) are increasingly used as semantic encoders and decoders in semantic communication. However, current LLM based systems mostly remain monolithic: a single prompted model, or a tightly coupled transmitter/receiver…

系统与控制 · 电气工程与系统科学 2026-05-05 Jingwen Fu , Ming Xiao , Mikael Skoglund

Large Vision-Language Models (LVLMs) have demonstrated remarkable performance across a wide range of multimodal tasks. However, fine-tuning these models for domain-specific applications remains a computationally intensive challenge. This…

计算机视觉与模式识别 · 计算机科学 2024-12-16 Chee Ng , Yuen Fung

Ensembling large language models (LLMs) can effectively combine diverse strengths of different models, offering a promising approach to enhance performance across various tasks. However, existing methods typically rely on fixed weighting…

机器学习 · 计算机科学 2025-06-03 Yuqian Fu , Yuanheng Zhu , Jiajun Chai , Guojun Yin , Wei Lin , Qichao Zhang , Dongbin Zhao

Large language model (LLM) agents such as OpenClaw rely on reusable skills to perform complex tasks, yet these skills remain largely static after deployment. As a result, similar workflows, tool usage patterns, and failure modes are…

人工智能 · 计算机科学 2026-04-10 Ziyu Ma , Shidong Yang , Yuxiang Ji , Xucong Wang , Yong Wang , Yiming Hu , Tongwen Huang , Xiangxiang Chu

Large Language Models (LLMs) are known for their expensive and time-consuming training. Thus, oftentimes, LLMs are fine-tuned to address a specific task, given the pretrained weights of a pre-trained LLM considered a foundation model. In…

计算与语言 · 计算机科学 2025-12-05 Eshed Gal , Moshe Eliasof , Javier Turek , Uri Ascher , Eran Treister , Eldad Haber

Large language models (LLMs) are at the forefront of transforming numerous domains globally. However, their inclusivity and effectiveness remain limited for non-Latin scripts and low-resource languages. This paper tackles the imperative…

计算与语言 · 计算机科学 2025-01-08 Somnath Kumar , Vaibhav Balloli , Mercy Ranjit , Kabir Ahuja , Tanuja Ganu , Sunayana Sitaram , Kalika Bali , Akshay Nambi

Machine learning models and libraries can train datasets of different sizes and perform prediction and classification operations, but machine learning models and libraries cause slow and long training times on large datasets. This article…

机器学习 · 计算机科学 2025-09-17 Halil Hüseyin Çalışkan , Talha Koruk

Training video-language models is often prohibitively expensive due to the high cost of processing long frame sequences and the limited availability of annotated long videos. We present VideoWeave, a simple yet effective approach to improve…

计算机视觉与模式识别 · 计算机科学 2026-01-13 Zane Durante , Silky Singh , Arpandeep Khatua , Shobhit Agarwal , Reuben Tan , Yong Jae Lee , Jianfeng Gao , Ehsan Adeli , Li Fei-Fei

Equipping large language models with explicit skills has emerged as a promising paradigm for enabling autonomous agents to solve complex tasks. Agent skills can be inherently divided into general skills for broad cognitive transfer and…

计算与语言 · 计算机科学 2026-05-28 Jiapeng Zhu , Jianxiang Yu , Yibo Zhao , Chengcheng Han , Qi Gu , Xunliang Cai , Xiang Li , Weining Qian