English
Related papers

Related papers: Halo: Learning Semantics-Aware Representations for…

200 papers

In this paper, we study two challenging problems in explainable AI (XAI) and data clustering. The first is how to directly design a neural network with inherent interpretability, rather than giving post-hoc explanations of a black-box…

Machine Learning · Computer Science 2022-04-25 Xi Peng , Yunnan Li , Ivor W. Tsang , Hongyuan Zhu , Jiancheng Lv , Joey Tianyi Zhou

Building agents capable of understanding language instructions is critical to effective and robust human-AI collaboration. Recent work focuses on training these agents via reinforcement learning in environments with synthetic language;…

Computation and Language · Computer Science 2021-11-02 Suvir Mirchandani , Siddharth Karamcheti , Dorsa Sadigh

Vision-Language-Action (VLA) models have shown strong performance in robotic manipulation, but often struggle in long-horizon or out-of-distribution scenarios due to the lack of explicit mechanisms for multimodal reasoning and anticipating…

Similarity-preserving hashing is a commonly used method for nearest neighbour search in large-scale image retrieval. For image retrieval, deep-networks-based hashing methods are appealing since they can simultaneously learn effective image…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Hanjiang Lai , Pan Yan , Xiangbo Shu , Yunchao Wei , Shuicheng Yan

In large language models built upon the Transformer architecture, recent studies have shown that inter-head interaction can enhance attention performance. Motivated by this, we propose Multi-head Explicit Attention (MEA), a simple yet…

Machine Learning · Computer Science 2026-01-28 Runyu Peng , Yunhua Zhou , Demin Song , Kai Lv , Bo Wang , Qipeng Guo , Xipeng Qiu

Node classification on graphs is an important task in many practical domains. It usually requires labels for training, which can be difficult or expensive to obtain in practice. Given a budget for labelling, active learning aims to improve…

Machine Learning · Computer Science 2022-07-21 Juncheng Liu , Yiwei Wang , Bryan Hooi , Renchi Yang , Xiaokui Xiao

Neural networks can be trained to learn task-relevant representations from data. Understanding how these networks make decisions falls within the Explainable AI (XAI) domain. This paper proposes to study an XAI topic: uncovering the unknown…

Audio and Speech Processing · Electrical Eng. & Systems 2026-05-29 Yanze Xu , Wenwu Wang , Mark D. Plumbley

In this study, we propose a method that distils representations of word meaning in context from a pre-trained masked language model in both monolingual and crosslingual settings. Word representations are the basis for context-aware lexical…

Computation and Language · Computer Science 2024-09-16 Yuki Arase , Tomoyuki Kajiwara

Semantic role labeling (SRL) identifies predicate-argument structure(s) in a given sentence. Although different languages have different argument annotations, polyglot training, the idea of training one model on multiple languages, has…

Computation and Language · Computer Science 2020-11-11 Ishan Jindal , Yunyao Li , Siddhartha Brahma , Huaiyu Zhu

The representation learning of speech, without textual resources, is an area of significant interest for many low resource speech applications. In this paper, we describe an approach to self-supervised representation learning from raw audio…

Audio and Speech Processing · Electrical Eng. & Systems 2023-07-17 Varun Krishna , Tarun Sai , Sriram Ganapathy

Detecting objects accurately from a large or open vocabulary necessitates the vision-language alignment on region representations. However, learning such a region-text alignment by obtaining high-quality box annotations with text labels or…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Size Wu , Wenwei Zhang , Lumin Xu , Sheng Jin , Wentao Liu , Chen Change Loy

While the volume of scholarly publications has increased at a frenetic pace, accessing and consuming the useful candidate papers, in very large digital libraries, is becoming an essential and challenging task for scholars. Unfortunately,…

Information Retrieval · Computer Science 2019-01-01 Zhuoren Jiang , Yue Yin , Liangcai Gao , Yao Lu , Xiaozhong Liu

Histopathology image analysis plays a critical role in cancer diagnosis and treatment. To automatically segment the cancerous regions, fully supervised segmentation algorithms require labor-intensive and time-consuming labeling at the pixel…

Image and Video Processing · Electrical Eng. & Systems 2019-08-29 Gang Xu , Zhigang Song , Zhuo Sun , Calvin Ku , Zhe Yang , Cancheng Liu , Shuhao Wang , Jianpeng Ma , Wei Xu

Information Extraction (IE) seeks to derive structured information from unstructured texts, often facing challenges in low-resource scenarios due to data scarcity and unseen classes. This paper presents a review of neural approaches to…

Computation and Language · Computer Science 2024-10-29 Shumin Deng , Yubo Ma , Ningyu Zhang , Yixin Cao , Bryan Hooi

In-context learning (ICL) enables large language models (LLMs) to perform new tasks using only a few demonstrations. However, in Named Entity Recognition (NER), existing ICL methods typically rely on task-agnostic semantic similarity for…

Computation and Language · Computer Science 2025-10-30 Fan Bai , Hamid Hassanzadeh , Ardavan Saeedi , Mark Dredze

We propose a Cross-lingual Encoder-Decoder model that simultaneously translates and generates sentences with Semantic Role Labeling annotations in a resource-poor target language. Unlike annotation projection techniques, our model does not…

Computation and Language · Computer Science 2019-08-30 Angel Daza , Anette Frank

Contrastive learning has emerged as a powerful tool for graph representation learning. However, most contrastive learning methods learn features of graphs with fixed coarse-grained scale, which might underestimate either local or global…

Machine Learning · Computer Science 2022-10-24 Jun Wang , Weixun Li , Changyu Hou , Xin Tang , Yixuan Qiao , Rui Fang , Pengyong Li , Peng Gao , Guotong Xie

Self-Supervised Learning (SSL) has emerged as the solution of choice to learn transferable representations from unlabeled data. However, SSL requires to build samples that are known to be semantically akin, i.e. positive views. Requiring…

Machine Learning · Computer Science 2023-10-02 Vivien Cabannes , Leon Bottou , Yann Lecun , Randall Balestriero

Multimodal information extraction (MIE) constitutes a set of essential tasks aimed at extracting structural information from Web texts with integrating images, to facilitate the structural construction of Web-based semantic knowledge. To…

Multimedia · Computer Science 2026-03-18 Baohang Zhou , Kehui Song , Rize Jin , Yu Zhao , Xuhui Sui , Xinying Qian , Xingyue Guo , Ying Zhang

Multi-label recognition with partial labels (MLR-PL), in which only some labels are known while others are unknown for each image, is a practical task in computer vision, since collecting large-scale and complete multi-label datasets is…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Haoxian Ruan , Zhihua Xu , Zhijing Yang , Yongyi Lu , Jinghui Qin , Tianshui Chen