English
Related papers

Related papers: Knowledge Distillation from Language-Oriented to E…

200 papers

Recently, Unmanned Aerial Vehicles (UAVs) are increasingly being investigated to collect sensory data in post-disaster monitoring scenarios, such as tsunamis, where early actions are critical to limit coastal damage. A major challenge is to…

Artificial Intelligence · Computer Science 2025-10-08 Yousef Emami , Seyedsina Nabavirazavi , Jingjing Zheng , Hao Zhou , Miguel Gutierrez Gaitan , Kai Li , Luis Almeida

Emotion recognition in conversations (ERC) is challenging due to the multimodal nature of the emotion expression. In this paper, we propose to pretrain a text-based recognition model from unsupervised speech transcripts with LLM guidance.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-22 Soumya Dutta , Sriram Ganapathy

Multi-Agent Systems (MAS) have emerged as a powerful paradigm for modeling complex interactions among autonomous entities in distributed environments. In Multi-Agent Reinforcement Learning (MARL), communication enables coordination but can…

Multiagent Systems · Computer Science 2025-11-13 Xinren Zhang , Jiadong Yu , Zixin Zhong

We present LARL-RM (Large language model-generated Automaton for Reinforcement Learning with Reward Machine) algorithm in order to encode high-level knowledge into reinforcement learning using automaton to expedite the reinforcement…

Machine Learning · Computer Science 2024-02-13 Shayan Meshkat Alsadat , Jean-Raphael Gaglione , Daniel Neider , Ufuk Topcu , Zhe Xu

Semantic communication transmits the extracted features of information rather than raw data, significantly reducing redundancy, which is crucial for addressing spectrum and energy challenges in 6G networks. In this paper, we introduce…

Machine Learning · Computer Science 2025-05-27 Wenjun Zhang , Qiong Wu , Pingyi Fan , Kezhi Wang , Nan Cheng , Wen Chen , Khaled B. Letaief

While semantic communication succeeds in efficiently transmitting due to the strong capability to extract the essential semantic information, it is still far from the intelligent or human-like communications. In this paper, we introduce an…

Signal Processing · Electrical Eng. & Systems 2023-03-23 Huiqiang Xie , Zhijin Qin , Geoffrey Ye Li

Medical decision-making often involves integrating knowledge from multiple clinical specialties, typically achieved through multidisciplinary teams. Inspired by this collaborative process, recent work has leveraged large language models…

Artificial Intelligence · Computer Science 2025-09-19 Xiao Wu , Ting-Zhu Huang , Liang-Jian Deng , Yanyuan Qiao , Imran Razzak , Yutong Xie

Economic decision-making depends not only on structured signals such as prices and taxes, but also on unstructured language, including peer dialogue and media narratives. While multi-agent reinforcement learning (MARL) has shown promise in…

Artificial Intelligence · Computer Science 2026-03-24 Heyang Ma , Qirui Mi , Qipeng Yang , Zijun Fan , Bo Li , Haifeng Zhang

A recent trend in Natural Language Processing is the exponential growth in Language Model (LM) size, which prevents research groups without a necessary hardware infrastructure from participating in the development process. This study…

Computation and Language · Computer Science 2023-01-31 Jan Philip Wahle

Recent advancements in Large Language Models (LLMs) have led to significant breakthroughs in various natural language processing tasks. However, generating factually consistent responses in knowledge-intensive scenarios remains a challenge…

Computation and Language · Computer Science 2025-01-03 Shengbin Yue , Siyuan Wang , Wei Chen , Xuanjing Huang , Zhongyu Wei

Large language models have become increasingly popular and demonstrated remarkable performance in various natural language processing (NLP) tasks. However, these models are typically computationally expensive and difficult to be deployed in…

Computation and Language · Computer Science 2024-09-20 Dongheng Li , Yongchang Hao , Lili Mou

Recent research has explored distilling knowledge from large language models (LLMs) to optimize retriever models, especially within the retrieval-augmented generation (RAG) framework. However, most existing training methods rely on…

Information Retrieval · Computer Science 2024-06-19 Zizhong Li , Haopeng Zhang , Jiawei Zhang

The rapid development of the Large Language Model (LLM) presents huge opportunities for 6G communications, e.g., network optimization and management by allowing users to input task requirements to LLMs by nature language. However, directly…

Artificial Intelligence · Computer Science 2023-12-14 Feibo Jiang , Li Dong , Yubo Peng , Kezhi Wang , Kun Yang , Cunhua Pan , Dusit Niyato , Octavia A. Dobre

Transformer-based large language models (LLMs) rely on contextual embeddings which generate different (continuous) representations for the same token depending on its surrounding context. Nonetheless, words and tokens typically have a…

Computation and Language · Computer Science 2025-07-10 Qitong Wang , Mohammed J. Zaki , Georgios Kollias , Vasileios Kalantzis

Interactions with virtual assistants typically start with a trigger phrase followed by a command. In this work, we explore the possibility of making these interactions more natural by eliminating the need for a trigger phrase. Our goal is…

Recent advances in multimodal ECG representation learning center on aligning ECG signals with paired free-text reports. However, suboptimal alignment persists due to the complexity of medical language and the reliance on a full 12-lead…

Machine Learning · Computer Science 2025-02-26 Che Liu , Cheng Ouyang , Zhongwei Wan , Haozhe Wang , Wenjia Bai , Rossella Arcucci

We address the challenge of coordinating multiple robots in narrow and confined environments, where congestion and interference often hinder collective task performance. Drawing inspiration from insect colonies, which achieve robust…

Machine Learning · Computer Science 2026-03-17 Kehinde O. Aina , Sehoon Ha

Emotional Support Conversation (ESC) systems aim to alleviate users' emotional difficulties and provide long-term, systematic support for emotional well-being. However, most large language model (LLM)-based ESC systems rely on predefined…

Artificial Intelligence · Computer Science 2025-08-19 Ting Yang , Li Chen , Huimin Wang

Conversational Assistants (CA) are increasingly supporting human workers in knowledge management. Traditionally, CAs respond in specific ways to predefined user intents and conversation patterns. However, this rigidness does not handle the…

Human-Computer Interaction · Computer Science 2024-07-15 Samuel Kernan Freire , Chaofan Wang , Evangelos Niforatos

Controlling robots through natural language is pivotal for enhancing human-robot collaboration and synthesizing complex robot behaviors. Recent works that are trained on large robot datasets show impressive generalization abilities.…