English
Related papers

Related papers: Efficient Large Language Models with Zero-Shot Adj…

200 papers

Automating code documentation through explanatory text can prove highly beneficial in code understanding. Large Language Models (LLMs) have made remarkable strides in Natural Language Processing, especially within software engineering tasks…

Large scale Vision-Language (VL) models have shown tremendous success in aligning representations between visual and text modalities. This enables remarkable progress in zero-shot recognition, image generation & editing, and many other…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Wei Lin , Leonid Karlinsky , Nina Shvetsova , Horst Possegger , Mateusz Kozinski , Rameswar Panda , Rogerio Feris , Hilde Kuehne , Horst Bischof

Multilingual large language models (MLLMs), trained on multilingual balanced data, demonstrate better zero-shot learning performance in non-English languages compared to large language models trained on English-dominant data. However, the…

Computation and Language · Computer Science 2024-10-03 Hwichan Kim , Jun Suzuki , Tosho Hirasawa , Mamoru Komachi

This paper presents null-shot prompting. Null-shot prompting exploits hallucination in large language models (LLMs) by instructing LLMs to utilize information from the "Examples" section that never exists within the provided context to…

Computation and Language · Computer Science 2024-11-19 Pittawat Taveekitworachai , Febri Abdullah , Ruck Thawonmas

Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (CoT) prompting, a…

Computation and Language · Computer Science 2023-01-31 Takeshi Kojima , Shixiang Shane Gu , Machel Reid , Yutaka Matsuo , Yusuke Iwasawa

Zero-shot slot filling is a well-established subtask of Natural Language Understanding (NLU). However, most existing methods primarily focus on single-turn text data, overlooking the unique complexities of conversational dialogue.…

Computation and Language · Computer Science 2024-12-02 Mansi Rana , Kadri Hacioglu , Sindhuja Gopalan , Maragathamani Boothalingam

With the rapid development of large language models (LLM), robots are starting to enjoy the benefits of new interaction methods that large language models bring. Because edge computing fulfills the needs for rapid response, privacy, and…

Robotics · Computer Science 2024-12-16 Yuxuan Chen , Yixin Han , Xiao Li

Abbreviation expansion is a strategy used to speed up communication by limiting the amount of typing and using a language model to suggest expansions. Here we look at personalizing a Large Language Model's (LLM) suggestions based on prior…

Computation and Language · Computer Science 2023-12-25 Katrin Tomanek , Shanqing Cai , Subhashini Venugopalan

This paper introduces a novel approach for efficiently distilling LLMs into smaller, application-specific models, significantly reducing operational costs and manual labor. Addressing the challenge of deploying computationally intensive…

Computation and Language · Computer Science 2024-03-26 Lukas Vöge , Vincent Gurgul , Stefan Lessmann

Large language models (LLMs) have brought about significant transformations in human society. Among the crucial computations in LLMs, the softmax unit holds great importance. Its helps the model generating a probability distribution on…

Machine Learning · Computer Science 2023-07-18 Yichuan Deng , Zhihang Li , Sridhar Mahadevan , Zhao Song

In this paper, we investigate the usage of large language models (LLMs) to improve the performance of competitive speech recognition systems. Different from previous LLM-based ASR error correction methods, we propose a novel multi-stage…

Computation and Language · Computer Science 2024-06-18 Jie Pu , Thai-Son Nguyen , Sebastian Stüker

Large Language Models (LLMs) have demonstrated exceptional abilities across a broad range of language-related tasks, including generating solutions to complex reasoning problems. An effective technique to enhance LLM performance is…

Computation and Language · Computer Science 2024-12-25 Shuzhang Cai , Twumasi Mensah-Boateng , Xander Kuksov , Jing Yuan , Shaojie Tang

Recent advancements in Large Language Models (LLMs) have emphasized the critical role of fine-tuning (FT) techniques in adapting LLMs to specific tasks, especially when retraining from scratch is computationally infeasible. Fine-tuning…

Artificial Intelligence · Computer Science 2025-10-23 Xiao Han , Zimo Zhao , Wanyu Wang , Maolin Wang , Zitao Liu , Yi Chang , Xiangyu Zhao

The emergence of large language models (LLMs) has substantially influenced natural language processing, demonstrating exceptional results across various tasks. In this study, we employ ``Introspective Tips" to facilitate LLMs in…

Artificial Intelligence · Computer Science 2023-05-22 Liting Chen , Lu Wang , Hang Dong , Yali Du , Jie Yan , Fangkai Yang , Shuang Li , Pu Zhao , Si Qin , Saravan Rajmohan , Qingwei Lin , Dongmei Zhang

Modern large language models (LLMs) driven by scaling laws, achieve intelligence emergency in large model sizes. Recently, the increasing concerns about cloud costs, latency, and privacy make it an urgent requirement to develop compact edge…

Machine Learning · Computer Science 2025-02-13 Xingrun Xing , Zheng Liu , Shitao Xiao , Boyan Gao , Yiming Liang , Wanpeng Zhang , Haokun Lin , Guoqi Li , Jiajun Zhang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable proficiency in diverse tasks across different domains, with an increasing focus on improving their zero-shot generalization capabilities for unseen multimodal tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ying Shen , Zhiyang Xu , Qifan Wang , Yu Cheng , Wenpeng Yin , Lifu Huang

Finite state machines (FSMs) are widely used to manage robot behavior logic, particularly in real-world applications that require a high degree of reliability and structure. However, traditional manual FSM design and modification processes…

Robotics · Computer Science 2024-12-10 Xiangyu Robin Gan , Yuxin Ray Song , Nick Walker , Maya Cakmak

Large language models (LLMs) have shown impressive performance on language tasks but face challenges when deployed on resource-constrained devices due to their extensive parameters and reliance on dense multiplications, resulting in high…

Machine Learning · Computer Science 2024-11-20 Haoran You , Yipin Guo , Yichao Fu , Wei Zhou , Huihong Shi , Xiaofan Zhang , Souvik Kundu , Amir Yazdanbakhsh , Yingyan Celine Lin

Slot filling is a crucial subtask in spoken language understanding (SLU), traditionally implemented as a cascade of speech recognition followed by one or more natural language understanding (NLU) components. The recent advent of…

Computation and Language · Computer Science 2025-10-20 Kadri Hacioglu , Manjunath K E , Andreas Stolcke

In 2012, the United Nations introduced 17 Sustainable Development Goals (SDGs) aimed at creating a more sustainable and improved future by 2030. However, tracking progress toward these goals is difficult because of the extensive scale and…