English
Related papers

Related papers: Never Start from Scratch: Expediting On-Device LLM…

200 papers

Large Language Models (LLMs) excel at a wide range of tasks, but adapting them to new data, particularly for personalized applications, poses significant challenges due to resource and computational constraints. Existing methods either rely…

Computation and Language · Computer Science 2025-01-08 Yoel Zeldes , Amir Zait , Ilia Labzovsky , Danny Karmon , Efrat Farkash

Entity resolution, the task of identifying and merging records that refer to the same real-world entity, is crucial in sectors like e-commerce, healthcare, and law enforcement. Large Language Models (LLMs) introduce an innovative approach…

Computation and Language · Computer Science 2024-09-13 Huahang Li , Longyu Feng , Shuangyin Li , Fei Hao , Chen Jason Zhang , Yuanfeng Song

Aligning Large Language Models (LLMs) with general human preferences has been proved crucial in improving the interaction quality between LLMs and human. However, human values are inherently diverse among different individuals, making it…

Computation and Language · Computer Science 2024-12-31 Jianfei Zhang , Jun Bai , Bei Li , Yanmeng Wang , Rumei Li , Chenghua Lin , Wenge Rong

In autonomous exploration tasks, robots are required to explore and map unknown environments while efficiently planning in dynamic and uncertain conditions. Given the significant variability of environments, human operators often have…

Robotics · Computer Science 2025-03-11 Shuhao Liao , Xuxin Lv , Yuhong Cao , Jeric Lew , Wenjun Wu , Guillaume Sartoretti

This research investigates the application of Large Language Models (LLMs) to augment conversational agents in process mining, aiming to tackle its inherent complexity and diverse skill requirements. While LLM advancements present novel…

Artificial Intelligence · Computer Science 2023-07-20 Urszula Jessen , Michal Sroka , Dirk Fahland

With the rapid development of large language models (LLMs), which possess powerful natural language processing and generation capabilities, LLMs are poised to provide more natural and personalized user experiences. Their deployment on…

Artificial Intelligence · Computer Science 2026-03-03 Lianjun Liu , Hongli An , Pengxuan Chen , Longxiang Ye

This paper delves into the pressing need in Parameter-Efficient Fine-Tuning (PEFT) for Large Language Models (LLMs). While LLMs possess remarkable capabilities, their extensive parameter requirements and associated computational demands…

Computation and Language · Computer Science 2023-11-23 Chengyu Wang , Junbing Yan , Wei Zhang , Jun Huang

Large language models (LLMs) have achieved strong performance across a wide range of natural language processing tasks. However, deploying LLMs at scale for domain specific applications, such as job-person fit and explanation in job seeking…

Large Language Models (LLMs) have seen great advance in both academia and industry, and their popularity results in numerous open-source frameworks and techniques in accelerating LLM pre-training, fine-tuning, and inference. Training and…

Performance · Computer Science 2023-12-04 Longteng Zhang , Xiang Liu , Zeyu Li , Xinglin Pan , Peijie Dong , Ruibo Fan , Rui Guo , Xin Wang , Qiong Luo , Shaohuai Shi , Xiaowen Chu

Pretrained large language models (LLMs) are currently state-of-the-art for solving the vast majority of natural language processing tasks. While many real-world applications still require fine-tuning to reach satisfactory levels of…

Personalization in Large Language Models (LLMs) often relies on user-specific soft prompts. However, these prompts become obsolete when the foundation model is upgraded, necessitating costly, full-scale retraining. To overcome this…

Computation and Language · Computer Science 2026-01-21 Ziyi Zhao , Chongming Gao , Yang Zhang , Haoyan Liu , Weinan Gan , Huifeng Guo , Yong Liu , Fuli Feng

Large Language Models (LLMs) have showcased remarkable generalizability in language comprehension and hold significant potential to revolutionize human-computer interaction in smart homes. Existing LLM-based smart home assistants typically…

Cryptography and Security · Computer Science 2025-07-15 Xinyu Huang , Leming Shen , Zijing Ma , Yuanqing Zheng

Predicting a user's next search query from recent interaction behaviors is a critical problem in modern e-commerce systems, particularly in scenarios where user intent evolves rapidly. Large Language Models (LLMs) offer strong semantic…

Information Retrieval · Computer Science 2026-05-07 Bin Zhang , Weipeng Huang , Dimin Wang , Jialin Zhu , Yuning Jiang , Zhaode Wang , Chengfei Lv , Jian Wang , Qichao Ma , Li Chen , Junqing Wu , Yipeng Yu

Alignment algorithms are widely used to align large language models (LLMs) to human users based on preference annotations. Typically these (often divergent) preferences are aggregated over a diverse set of users, resulting in fine-tuned…

Computation and Language · Computer Science 2025-05-21 Cristina Garbacea , Chenhao Tan

Personalization of Large Language Models (LLMs) has recently become increasingly important with a wide range of applications. Despite the importance and recent progress, most existing works on personalized LLMs have focused either entirely…

Large Language Models (LLMs) fine-tuning technologies have achieved remarkable results. However, traditional LLM fine-tuning approaches face significant challenges: they require large Floating Point (FP) computation, raising privacy…

Machine Learning · Computer Science 2025-05-30 Sifan Zhou , Shuo Wang , Zhihang Yuan , Mingjia Shi , Yuzhang Shang , Dawei Yang

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

Computation and Language · Computer Science 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

Large Language Models (LLMs) have achieved excellent performances in various tasks. However, fine-tuning an LLM requires extensive supervision. Human, on the other hand, may improve their reasoning abilities by self-thinking without…

Computation and Language · Computer Science 2022-10-26 Jiaxin Huang , Shixiang Shane Gu , Le Hou , Yuexin Wu , Xuezhi Wang , Hongkun Yu , Jiawei Han

This paper demonstrates that pre-trained language models (PLMs) are strong foundation models for on-device meteorological variables modeling. We present LM-Weather, a generic approach to taming PLMs, that have learned massive sequential…

Atmospheric and Oceanic Physics · Physics 2024-06-03 Shengchao Chen , Guodong Long , Jing Jiang , Chengqi Zhang

The recent emergence of Large Language Models (LLMs) has heralded a new era of human-AI interaction. These sophisticated models, exemplified by Chat-GPT and its successors, have exhibited remarkable capabilities in language understanding.…

Computation and Language · Computer Science 2024-07-26 Christopher Clarke , Yuzhao Heng , Lingjia Tang , Jason Mars