English
Related papers

Related papers: Merino: Entropy-driven Design for Generative Langu…

200 papers

Large language models (LLMs) are useful in many NLP tasks and become more capable with size, with the best open-source models having over 50 billion parameters. However, using these 50B+ models requires high-end hardware, making them…

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

The rapid advancement of Large Language Models (LLMs) has revolutionized various sectors by automating routine tasks, marking a step toward the realization of Artificial General Intelligence (AGI). However, they still struggle to…

Machine Learning · Computer Science 2024-02-21 Zihao Tang , Zheqi Lv , Shengyu Zhang , Fei Wu , Kun Kuang

This paper introduces an innovative design for robotic operating platforms, underpinned by a transformative Internet of Things (IoT) architecture, seamlessly integrating cutting-edge technologies such as large language models (LLMs),…

Networking and Internet Architecture · Computer Science 2025-07-01 Huiwen Han

Large Language Models (LLMs) have demonstrated remarkable capabilities across various fields, from natural language understanding to text generation. Compared to non-generative LLMs like BERT and DeBERTa, generative LLMs like GPT series and…

Hardware Architecture · Computer Science 2025-06-16 Jinhao Li , Jiaming Xu , Shan Huang , Yonghua Chen , Wen Li , Jun Liu , Yaoxiu Lian , Jiayi Pan , Li Ding , Hao Zhou , Yu Wang , Guohao Dai

Large language models (LLMs) have emerged as a powerful foundation for intelligent reasoning and decision-making, demonstrating substantial impact across a wide range of domains and applications. However, their massive parameter scales and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-12-29 Mingyu Sun , Xiao Zhang , Shen Qu , Yan Li , Mengbai Xiao , Yuan Yuan , Dongxiao Yu

Large language models (LLMs) have demonstrated impressive performance on many tasks. However, to achieve optimal performance, specially designed prompting methods are still needed. These methods either rely on task-specific few-shot…

Computation and Language · Computer Science 2024-02-29 Haoxiang Guan , Jiyan He , Shuxin Zheng , En-Hong Chen , Weiming Zhang , Nenghai Yu

The advent of large language models (LLMs) revolutionized natural language processing applications, and running LLMs on edge devices has become increasingly attractive for reasons including reduced latency, data localization, and…

Computation and Language · Computer Science 2024-09-17 Jiajun Xu , Zhiyuan Li , Wei Chen , Qun Wang , Xin Gao , Qi Cai , Ziyuan Ling

Large language models (LLMs) on smartphones enable real-time AI assistance and privacy-preserving, offline operation. However, resource constraints of smartphones limit current deployments to small language models (SLMs), significantly…

Machine Learning · Computer Science 2024-12-13 Zhenliang Xue , Yixin Song , Zeyu Mi , Xinrui Zheng , Yubin Xia , Haibo Chen

Although large language models (LLMs) have advanced the state-of-the-art in NLP significantly, deploying them for downstream applications is still challenging due to cost, responsiveness, control, or concerns around privacy and security. As…

Computation and Language · Computer Science 2023-11-01 Dong-Ho Lee , Jay Pujara , Mohit Sewak , Ryen W. White , Sujay Kumar Jauhar

Can we leverage LLMs to model the process of discovering novel language model (LM) architectures? Inspired by real research, we propose a multi-agent LLM approach that simulates the conventional stages of research, from ideation and…

Artificial Intelligence · Computer Science 2025-06-26 Junyan Cheng , Peter Clark , Kyle Richardson

Large Language Models (LLMs) have significantly advanced artificial intelligence by optimizing traditional Natural Language Processing (NLP) workflows, facilitating their integration into various systems. Many such NLP systems, including…

Computation and Language · Computer Science 2025-05-13 Jiliang Ni , Jiachen Pu , Zhongyi Yang , Kun Zhou , Hui Wang , Xiaoliang Xiao , Dakui Wang , Xin Li , Jingfeng Luo , Conggang Hu

The rapid expansion of IoT devices has outpaced current identification methods, creating significant risks for security, privacy, and network accountability. These challenges are heightened in open-world environments, where traffic metadata…

Machine Learning · Computer Science 2025-10-17 Rameen Mahmood , Tousif Ahmed , Sai Teja Peddinti , Danny Yuxing Huang

Large language models (LLMs) are central to modern natural language processing, delivering exceptional performance in various tasks. However, their substantial computational and memory requirements present challenges, especially for devices…

Large language models (LLMs) are increasingly seen as assistants, copilots, and consultants, capable of supporting a wide range of tasks through natural conversation. However, most systems remain constrained by a linear request-response…

Computation and Language · Computer Science 2026-05-05 Jiaqi Chen , Yanzhe Zhang , Yutong Zhang , Yijia Shao , Diyi Yang

The evolving requirements of Internet of Things (IoT) applications are driving an increasing shift toward bringing intelligence to the edge, enabling real-time insights and decision-making within resource-constrained environments. Tiny…

Software Engineering · Computer Science 2025-04-08 Guanghan Wu , Sasu Tarkoma , Roberto Morabito

Large language models (LLMs) have revolutionized natural language processing by achieving state-of-the-art performance across various tasks. Recently, their effectiveness as embedding models has gained attention, marking a paradigm shift…

Computation and Language · Computer Science 2025-07-28 Chongyang Tao , Tao Shen , Shen Gao , Junshuo Zhang , Zhen Li , Kai Hua , Wenpeng Hu , Zhengwei Tao , Shuai Ma

Next-generation Multiple-Input Multiple-Output (MIMO) is expected to be intelligent and scalable. In this paper, we study Large Language Model (LLM)-enabled next-generation MIMO networks. Firstly, we provide an overview of the development,…

Networking and Internet Architecture · Computer Science 2025-11-11 Zhe Wang , Jiayi Zhang , Hongyang Du , Ruichen Zhang , Dusit Niyato , Bo Ai , Khaled B. Letaief

Large Language Models (LLMs) and Multimodal Large Language Models (MLLMs) have made significant advancements in reasoning capabilities. However, they still face challenges such as high computational demands and privacy concerns. This paper…

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Artificial Intelligence · Computer Science 2024-11-25 Haolin Chen , Yihao Feng , Zuxin Liu , Weiran Yao , Akshara Prabhakar , Shelby Heinecke , Ricky Ho , Phil Mui , Silvio Savarese , Caiming Xiong , Huan Wang