English
Related papers

Related papers: Task-Oriented Communication with Out-of-Distributi…

200 papers

Deep learning has become the most powerful machine learning tool in the last decade. However, how to efficiently train deep neural networks remains to be thoroughly solved. The widely used minibatch stochastic gradient descent (SGD) still…

Machine Learning · Computer Science 2021-05-18 Xinyu Peng , Jiawei Zhang , Fei-Yue Wang , Li Li

In this work, we generalize the information bottleneck (IB) approach to the multi-view learning context. The exponentially growing complexity of the optimal representation motivates the development of two novel formulations with more…

Information Theory · Computer Science 2022-09-20 Teng-Hui Huang , Aly El Gamal , Hesham El Gamal

Real-time intelligence applications in Internet of Things (IoT) environment depend on timely data communication. However, it is challenging to transmit and analyse massive data of various modalities. Recently proposed task-oriented…

Information Theory · Computer Science 2023-02-07 Shiqi Wang , Qianqian Yang , Zhiguo Shi , Zhaohui Yang , Zhaoyang Zhang

Existing studies in conversational AI mostly treat task-oriented dialog (TOD) and question answering (QA) as separate tasks. Towards the goal of constructing a conversational agent that can complete user tasks and support information…

Computation and Language · Computer Science 2022-06-28 Miaoran Li , Baolin Peng , Jianfeng Gao , Zhu Zhang

The vigorous developments of Internet of Things make it possible to extend its computing and storage capabilities to computing tasks in the aerial system with collaboration of cloud and edge, especially for artificial intelligence (AI)…

Computer Vision and Pattern Recognition · Computer Science 2021-12-22 Xu Kang , Bin Song , Jie Guo , Zhijin Qin , F. Richard Yu

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

Machine Learning · Computer Science 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Semantic communications for multi-modal data can transmit task-relevant information efficiently over noisy and bandwidth-limited channels. However, a key challenge is to simultaneously compress inter-modal redundancy and improve semantic…

Image and Video Processing · Electrical Eng. & Systems 2025-11-13 Jingwen Fu , Ming Xiao , Zhonghao Lyu , Mikael Skoglund , Celimuge Wu

In the realm of task-oriented dialogue systems, a robust intent detection mechanism must effectively handle malformed utterances encountered in real-world scenarios. This study presents a novel fine-tuning framework for large language…

Computation and Language · Computer Science 2024-09-23 Bo Liu , Liming Zhan , Yujie Feng , Zexin Lu , Chengqiang Xie , Lei Xue , Albert Y. S. Lam , Xiao-Ming Wu

Despite their success, Machine Learning (ML) models do not generalize effectively to data not originating from the training distribution. To reliably employ ML models in real-world healthcare systems and avoid inaccurate predictions on…

Machine Learning · Computer Science 2023-09-29 Mohammad Azizmalayeri , Ameen Abu-Hanna , Giovanni Ciná

In this article, we present a novel framework, named distributed task-oriented communication networks (DTCN), based on recent advances in multimodal semantic transmission and edge intelligence. In DTCN, the multimodal knowledge of semantic…

Signal Processing · Electrical Eng. & Systems 2024-01-22 Jie Guo , Hao Chen , Bin Song , Yuhao Chi , Chau Yuen , Fei Richard Yu , Geoffrey Ye Li , Dusit Niyato

Combining the Information Bottleneck model with deep learning by replacing mutual information terms with deep neural nets has proved successful in areas ranging from generative modelling to interpreting deep neural networks. In this paper,…

Machine Learning · Computer Science 2020-02-19 Aleksander Wieczorek , Volker Roth

Out-of-Distribution (OOD) generalization, a cornerstone for building robust machine learning models capable of handling data diverging from the training set's distribution, is an ongoing challenge in deep learning. While significant…

Machine Learning · Computer Science 2023-12-05 Sergey Kolesnikov

Out-of-distribution (OOD) detection is crucial for the deployment of machine learning models in the open world. While existing OOD detectors are effective in identifying OOD samples that deviate significantly from in-distribution (ID) data,…

Machine Learning · Computer Science 2024-12-10 Hao Fu , Prashanth Krishnamurthy , Siddharth Garg , Farshad Khorrami

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

Computer Vision and Pattern Recognition · Computer Science 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

The rapid advancement of large language models (LLMs) such as ChatGPT, DeepSeek, and Claude has significantly increased the presence of AI-generated text in digital communication. This trend has heightened the need for reliable detection…

Computation and Language · Computer Science 2025-10-13 Cong Zeng , Shengkun Tang , Yuanzhou Chen , Zhiqiang Shen , Wenchao Yu , Xujiang Zhao , Haifeng Chen , Wei Cheng , Zhiqiang Xu

Integration of data from multiple omics techniques is becoming increasingly important in biomedical research. Due to non-uniformity and technical limitations in omics platforms, such integrative analyses on multiple omics, which we refer to…

Machine Learning · Computer Science 2021-02-11 Changhee Lee , Mihaela van der Schaar

This paper studies task-oriented, otherwise known as goal-oriented, communications, in a setting where a transmitter communicates with multiple receivers, each with its own task to complete on a dataset, e.g., images, available at the…

Networking and Internet Architecture · Computer Science 2023-08-15 Yalin E. Sagduyu , Tugba Erpek , Aylin Yener , Sennur Ulukus

Numerous machine learning (ML) models have been developed, including those for software engineering (SE) tasks, under the assumption that training and testing data come from the same distribution. However, training and testing distributions…

Software Engineering · Computer Science 2025-03-04 Yanfu Yan , Viet Duong , Huajie Shao , Denys Poshyvanyk

When deploying a trained machine learning model in the real world, it is inevitable to receive inputs from out-of-distribution (OOD) sources. For instance, in continual learning settings, it is common to encounter OOD samples due to the…

Machine Learning · Computer Science 2024-01-23 Chuanwen Feng , Wenlong Chen , Ao Ke , Yilong Ren , Xike Xie , S. Kevin Zhou

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou