English
Related papers

Related papers: H-Net++: Hierarchical Dynamic Chunking for Tokeniz…

200 papers

Being a popular mode of text-based communication in multilingual communities, code-mixing in online social media has became an important subject to study. Learning the semantics and morphology of code-mixed language remains a key challenge,…

Computation and Language · Computer Science 2022-04-28 Ayan Sengupta , Tharun Suresh , Md Shad Akhtar , Tanmoy Chakraborty

As a promising field, Multi-Query Image Retrieval (MQIR) aims at searching for the semantically relevant image given multiple region-specific text queries. Existing works mainly focus on a single-level similarity between image regions and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Zhong Ji , Zhihao Li , Yan Zhang , Haoran Wang , Yanwei Pang , Xuelong Li

In this paper we aim to automatically discover high quality frame-level speech features and acoustic tokens directly from unlabeled speech data. A Multi-granular Acoustic Tokenizer (MAT) was proposed for automatic discovery of multiple sets…

Computation and Language · Computer Science 2017-07-19 Cheng-Tao Chung , Cheng-Yu Tsai , Chia-Hsiang Liu , Lin-Shan Lee

Ultra-high-resolution (UHR) remote sensing imagery couples kilometer-scale context with query-critical evidence that may occupy only a few pixels. Such vast spatial scale leads to a quadratic explosion of visual tokens and hinders the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Yunkai Dang , Minxin Dai , Yuekun Yang , Zhangnan Li , Wenbin Li , Feng Miao , Yang Gao

In the field of medical CT image processing, convolutional neural networks (CNNs) have been the dominant technique.Encoder-decoder CNNs utilise locality for efficiency, but they cannot simulate distant pixel interactions properly.Recent…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Hongyang He , Feng Ziliang , Yuanhang Zheng , Shudong Huang , HaoBing Gao

We tackle the problem of localizing 3D point cloud submaps using complex and diverse natural language descriptions, and present Text2Loc++, a novel neural network designed for effective cross-modal alignment between language and point…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Yan Xia , Letian Shi , Yilin Di , Joao F. Henriques , Daniel Cremers

Arabic dialect recognition presents a significant challenge in speech technology due to the linguistic diversity of Arabic and the scarcity of large annotated datasets, particularly for underrepresented dialects. This research investigates…

Audio and Speech Processing · Electrical Eng. & Systems 2025-06-27 Ghazal Al-Shwayyat , Omer Nezih Gerek

In an effort to reduce the computational load of Transformers, research on linear attention has gained significant momentum. However, the improvement strategies for attention mechanisms typically necessitate extensive retraining, which is…

Computation and Language · Computer Science 2024-04-02 Hanting Chen , Zhicheng Liu , Xutao Wang , Yuchuan Tian , Yunhe Wang

Recent advancements in multi-modal retrieval-augmented generation (mRAG), which enhance multi-modal large language models (MLLMs) with external knowledge, have demonstrated that the collective intelligence of multiple agents can…

Artificial Intelligence · Computer Science 2025-11-26 Weizi Shao , Taolin Zhang , Zijie Zhou , Chen Chen , Chengyu Wang , Xiaofeng He

Recently, Deep Convolutional Neural Networks (DCNNs) including the ResNet-20 architecture have been privately evaluated on encrypted, low-resolution data with the Residue-Number-System Cheon-Kim-Kim-Song (RNS-CKKS) homomorphic encryption…

Cryptography and Security · Computer Science 2024-01-30 Vivian Maloney , Richard F. Obrecht , Vikram Saraph , Prathibha Rama , Kate Tallaksen

Text corpora are essential for training models used in tasks like summarization, translation, and large language models (LLMs). While various efforts have been made to collect monolingual and multilingual datasets in many languages, Persian…

Computation and Language · Computer Science 2025-02-14 Sara Bourbour Hosseinbeigi , Fatemeh Taherinezhad , Heshaam Faili , Hamed Baghbani , Fatemeh Nadi , Mostafa Amiri

Neural Machine Translation (NMT) models are strong enough to convey semantic and syntactic information from the source language to the target language. However, these models are suffering from the need for a large amount of data to learn…

Computation and Language · Computer Science 2023-01-13 Mohaddeseh Bastan , Shahram Khadivi

Multi-modal recommendation has gained traction as items possess rich attributes like text and images. Semantic ID-based approaches effectively discretize this information into compact tokens. However, two challenges persist: (1) Suboptimal…

Artificial Intelligence · Computer Science 2026-05-27 Pingjun Pan , Tingting Zhou , Peiyao Lu , Tingting Fei , Hongxiang Chen , Chuanjiang Luo

Quantization-Aware Training from scratch has emerged as a promising approach for building efficient large language models (LLMs) with extremely low-bit weights (sub 2-bit), which can offer substantial advantages for edge deployment.…

Machine Learning · Computer Science 2026-02-27 Wenzheng Zhang , Bingzheng Liu , Yang Hu , Xiaoying Bai , Wentao Zhang , Bin Cui

Recent advancements in multimodal large language models (MLLMs) have demonstrated remarkable capabilities in processing diverse data types, yet significant disparities persist between human cognitive processes and computational approaches…

Computation and Language · Computer Science 2025-05-09 Dongxing Yu

Argument mining is a subfield of natural language processing to identify and extract the argument components, like premises and conclusions, within a text and to recognize the relations between them. It reveals the logical structure of…

Computation and Language · Computer Science 2025-11-27 Ali Jahan , Masood Ghayoomi , Annette Hautli-Janisz

Tokenization is a critical part of modern NLP pipelines. However, contemporary tokenizers for Large Language Models are based on statistical analysis of text corpora, without much consideration to the linguistic features. I propose a…

Computation and Language · Computer Science 2024-02-06 Haris Jabbar

Purely character-based language models (LMs) have been lagging in quality on large scale datasets, and current state-of-the-art LMs rely on word tokenization. It has been assumed that injecting the prior knowledge of a tokenizer into the…

Computation and Language · Computer Science 2019-08-28 Dokook Choe , Rami Al-Rfou , Mandy Guo , Heeyoung Lee , Noah Constant

One fundamental task for NLP is to determine the similarity between two texts and evaluate the extent of their likeness. The previous methods for the Persian language have low accuracy and are unable to comprehend the structure and meaning…

Computation and Language · Computer Science 2024-07-30 Seyed Mojtaba Sadjadi , Zeinab Rajabi , Leila Rabiei , Mohammad-Shahram Moin

Most widely-used pre-trained language models operate on sequences of tokens corresponding to word or subword units. By comparison, token-free models that operate directly on raw text (bytes or characters) have many benefits: they can…

Computation and Language · Computer Science 2022-03-09 Linting Xue , Aditya Barua , Noah Constant , Rami Al-Rfou , Sharan Narang , Mihir Kale , Adam Roberts , Colin Raffel