中文
相关论文

相关论文: On-device System of Compositional Multi-tasking in…

200 篇论文

Large language models (LLMs) are a promising avenue for machine translation (MT). However, current LLM-based MT systems are brittle: their effectiveness highly depends on the choice of few-shot examples and they often require extra…

The advent of large language models (LLMs) revolutionized natural language processing applications, and running LLMs on edge devices has become increasingly attractive for reasons including reduced latency, data localization, and…

计算与语言 · 计算机科学 2024-09-17 Jiajun Xu , Zhiyuan Li , Wei Chen , Qun Wang , Xin Gao , Qi Cai , Ziyuan Ling

The pretrain+fine-tune paradigm is foundational for deploying large language models (LLMs) across various downstream applications. Within this framework, Low-Rank Adaptation (LoRA) stands out for its parameter-efficient fine-tuning (PEFT),…

计算与语言 · 计算机科学 2024-10-10 Jingwei Xu , Junyu Lai , Yunpeng Huang

Large Multimodal Models (LMMs) have shown significant progress in various complex vision tasks with the solid linguistic and reasoning capacity inherited from large language models (LMMs). Low-rank adaptation (LoRA) offers a promising…

计算机视觉与模式识别 · 计算机科学 2025-04-04 Liang Mi , Weijun Wang , Wenming Tu , Qingfeng He , Rui Kong , Xinyu Fang , Yazhu Dong , Yikang Zhang , Yunchun Li , Meng Li , Haipeng Dai , Guihai Chen , Yunxin Liu

Recently, Large Language Models (LLMs) have achieved amazing zero-shot learning performance over a variety of Natural Language Processing (NLP) tasks, especially for text generative tasks. Yet, the large size of LLMs often leads to the high…

计算与语言 · 计算机科学 2023-09-21 Yukang Xie , Chengyu Wang , Junbing Yan , Jiyong Zhou , Feiqi Deng , Jun Huang

Parameter-Efficient Fine-Tuning (PEFT) is essential for adapting Large Language Models (LLMs). In practice, LLMs are often required to handle a diverse set of tasks from multiple domains, a scenario naturally addressed by multi-task…

计算与语言 · 计算机科学 2025-08-08 Jinda Liu , Bo Cheng , Yi Chang , Yuan Wu

The advance of Artificial Intelligence (AI) is continuously reshaping the future 6G wireless communications. Particularly, the development of Large Language Models (LLMs) offers a promising approach to effectively improve the performance…

信息论 · 计算机科学 2025-03-10 Tianyue Zheng , Linglong Dai

Large language models (LLMs) have demonstrated strong performance in sentence-level machine translation, but scaling to document-level translation remains challenging, particularly in modeling long-range dependencies and discourse phenomena…

计算与语言 · 计算机科学 2025-08-29 Miguel Moura Ramos , Patrick Fernandes , Sweta Agrawal , André F. T. Martins

This paper addresses the limited transfer and adaptation capabilities of large language models in low-resource language scenarios. It proposes a unified framework that combines a knowledge transfer module with parameter-efficient…

计算与语言 · 计算机科学 2025-07-03 Shuangquan Lyu , Yingnan Deng , Guiran Liu , Zhen Qi , Ruotong Wang

Large Language Models (LLMs) have shown high capabilities in several software development-related tasks such as program repair, documentation, code refactoring, debugging, and testing. However, training these models requires massive amount…

软件工程 · 计算机科学 2025-06-10 Meghdad Dehghan , Jie JW Wu , Fatemeh H. Fard , Ali Ouni

Large language models (LLMs) are very performant connectionist systems, but do they exhibit more compositionality? More importantly, is that part of why they perform so well? We present empirical analyses across four LLM families (12…

计算与语言 · 计算机科学 2025-05-21 Ruchira Dhar , Anders Søgaard

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

信息检索 · 计算机科学 2025-05-16 Alejo Lopez-Avila , Jinhua Du

Fine-tuning large language models (LLMs) with low-rank adaptations (LoRAs) has become common practice, often yielding numerous copies of the same LLM differing only in their LoRA updates. This paradigm presents challenges for systems that…

分布式、并行与集群计算 · 计算机科学 2025-06-02 Rickard Brüel-Gabrielsson , Jiacheng Zhu , Onkar Bhardwaj , Leshem Choshen , Kristjan Greenewald , Mikhail Yurochkin , Justin Solomon

Large language models (LLMs) continue to struggle with low-resource languages, primarily due to limited training data, translation noise, and unstable cross-lingual alignment. To address these challenges, we propose LiRA (Linguistic Robust…

计算与语言 · 计算机科学 2026-05-19 Haolin Li , Haipeng Zhang , Mang Li , Yaohua Wang , Lijie Wen , Yu Zhang , Biqing Huang

Large Language Models (LLMs) have demonstrated exceptional abilities across a broad range of language-related tasks, including generating solutions to complex reasoning problems. An effective technique to enhance LLM performance is…

计算与语言 · 计算机科学 2024-12-25 Shuzhang Cai , Twumasi Mensah-Boateng , Xander Kuksov , Jing Yuan , Shaojie Tang

Large Language Models (LLMs) have demonstrated remarkable language understanding and generation capabilities. However, training, deploying, and accessing these models pose notable challenges, including resource-intensive demands, extended…

计算与语言 · 计算机科学 2024-01-31 Souvika Sarkar , Mohammad Fakhruddin Babar , Monowar Hasan , Shubhra Kanti Karmaker

Recent advancements in large language models (LLMs) have significantly propelled the development of large multi-modal models (LMMs), highlighting the potential for general and intelligent assistants. However, most LMMs model visual and…

计算与语言 · 计算机科学 2025-03-20 Rui Yang , Lin Song , Yicheng Xiao , Runhui Huang , Yixiao Ge , Ying Shan , Hengshuang Zhao

Finetuned LLMs often exhibit poor uncertainty quantification, manifesting as overconfidence, poor calibration, and unreliable prediction results on test data or out-of-distribution samples. One approach commonly used in vision for…

机器学习 · 计算机科学 2023-10-06 Xi Wang , Laurence Aitchison , Maja Rudolph

This paper explores the rapid development of a telephone call summarization system utilizing large language models (LLMs). Our approach involves initial experiments with prompting existing LLMs to generate summaries of telephone…

计算与语言 · 计算机科学 2024-10-25 David Thulke , Yingbo Gao , Rricha Jalota , Christian Dugast , Hermann Ney

Large Language Models (LLMs) have exhibited significant potential in performing diverse tasks, including the ability to call functions or use external tools to enhance their performance. While current research on function calling by LLMs…

计算与语言 · 计算机科学 2025-03-04 Mingyang Chen , Haoze Sun , Tianpeng Li , Fan Yang , Hao Liang , Keer Lu , Bin Cui , Wentao Zhang , Zenan Zhou , Weipeng Chen