English
Related papers

Related papers: Hierarchical Mamba Meets Hyperbolic Geometry: A Ne…

200 papers

With the explosive growth of data, long-sequence modeling has become increasingly important in tasks such as natural language processing and bioinformatics. However, existing methods face inherent trade-offs between efficiency and memory.…

Machine Learning · Computer Science 2025-10-07 Youjin Wang , Yangjingyi Chen , Jiahao Yan , Jiaxuan Lu , Xiao Sun

Many high-dimensional and large-volume data sets of practical relevance have hierarchical structures induced by trees, graphs or time series. Such data sets are hard to process in Euclidean spaces and one often seeks low-dimensional…

Machine Learning · Computer Science 2021-09-16 Eli Chien , Chao Pan , Puoya Tabaghi , Olgica Milenkovic

Recent advances in deep learning structured state space models, especially the Mamba architecture, have demonstrated remarkable performance improvements while maintaining linear complexity. In this study, we introduce functional…

Machine Learning · Computer Science 2025-03-24 Yuxiang Wei , Anees Abrol , Vince Calhoun

High-dimensional multiplex graphs are characterized by their high number of complementary and divergent dimensions. The existence of multiple hierarchical latent relations between the graph dimensions poses significant challenges to…

Machine Learning · Computer Science 2025-01-30 Kamel Abdous , Nairouz Mrabah , Mohamed Bouguessa

Mamba extends earlier state space models (SSMs) by introducing input-dependent dynamics, and has demonstrated strong empirical performance across a range of domains, including language modeling, computer vision, and foundation models.…

Machine Learning · Computer Science 2025-05-15 Annan Yu , N. Benjamin Erichson

Recently, deep learning models have achieved excellent performance in hyperspectral image (HSI) classification. Among the many deep models, Transformer has gradually attracted interest for its excellence in modeling the long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Lingbo Huang , Yushi Chen , Xin He

Diffusion models have achieved great success in image generation, with the backbone evolving from U-Net to Vision Transformers. However, the computational cost of Transformers is quadratic to the number of tokens, leading to significant…

Computer Vision and Pattern Recognition · Computer Science 2024-07-11 Yao Teng , Yue Wu , Han Shi , Xuefei Ning , Guohao Dai , Yu Wang , Zhenguo Li , Xihui Liu

In recent years, artificial intelligence has significantly advanced medical image segmentation. Nonetheless, challenges remain, including efficient 3D medical image processing across diverse modalities and handling data variability. In this…

Image and Video Processing · Electrical Eng. & Systems 2026-02-09 Szymon Płotka , Gizem Mert , Maciej Chrabaszcz , Ewa Szczurek , Arkadiusz Sitek

Recent advancements in transformers, specifically self-attention mechanisms, have significantly improved hyperspectral image (HSI) classification. However, these models often suffer from inefficiencies, as their computational complexity…

Deploying Multimodal Large Language Models as the brain of embodied agents remains challenging, particularly under long-horizon observations and limited context budgets. Existing memory assisted methods often rely on textual summaries,…

Robotics · Computer Science 2026-03-03 Ji Li , Bo Wang , Jing Xia , Mingyi Li , Shiyan Hu

Human activity recognition (HAR) from inertial sensors is essential for ubiquitous computing, mobile health, and ambient intelligence. Conventional deep models such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks (RNNs),…

Human-Computer Interaction · Computer Science 2025-11-27 Thai-Khanh Nguyen , Uyen Vo , Tan M. Nguyen , Thieu N. Vo , Trung-Hieu Le , Cuong Pham

Recently, integrating visual foundation models into large language models (LLMs) to form video understanding systems has attracted widespread attention. Most of the existing models compress diverse semantic information within the whole…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Dingxin Cheng , Mingda Li , Jingyu Liu , Yongxin Guo , Bin Jiang , Qingbin Liu , Xi Chen , Bo Zhao

Sequential recommendation (SR), which encodes user activity to predict the next action, has emerged as a widely adopted strategy in developing commercial personalized recommendation systems. Although Transformer-based models have proven…

Information Retrieval · Computer Science 2025-04-11 Jun Yuan

Learning in hyperbolic spaces has attracted increasing attention due to its superior ability to model hierarchical structures of data. Most existing hyperbolic learning methods use fixed distance measures for all data, assuming a uniform…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Pengxiang Li , Yuwei Wu , Zhi Gao , Xiaomeng Fan , Wei Wu , Zhipeng Lu , Yunde Jia , Mehrtash Harandi

We consider the problem of multi-label classification where the labels lie in a hierarchy. However, unlike most existing works in hierarchical multi-label classification, we do not assume that the label-hierarchy is known. Encouraged by the…

Machine Learning · Computer Science 2021-01-14 Soumya Chatterjee , Ayush Maheshwari , Ganesh Ramakrishnan , Saketha Nath Jagaralpudi

Long-context language modeling is commonly framed as a scalability challenge of token-level attention, yet local-to-global information structuring remains largely implicit in existing approaches. Drawing on cognitive theories of discourse…

Computation and Language · Computer Science 2026-04-10 Xiangyu Zeng , Qi Xu , Yunke Wang , Chang Xu

Hierarchy is a natural representation of semantic taxonomies, including the ones routinely used in image segmentation. Indeed, recent work on semantic segmentation reports improved accuracy from supervised training leveraging hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Simon Weber , Barış Zöngür , Nikita Araslanov , Daniel Cremers

While end-to-end Vision-Language-Action (VLA) models offer a promising paradigm for robotic manipulation, fine-tuning them on narrow control data often compromises the profound reasoning capabilities inherited from their base…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Tianshuo Yang , Guanyu Chen , Yutian Chen , Zhixuan Liang , Yitian Liu , Zanxin Chen , Chunpu Xu , Haotian Liang , Jiangmiao Pang , Yao Mu , Ping Luo

The field of computer vision has experienced significant advancements through scalable vision encoders and multimodal pre-training frameworks. However, existing approaches often treat vision encoders and large language models (LLMs) as…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Eugene Lee , Ting-Yu Chang , Jui-Huang Tsai , Jiajie Diao , Chen-Yi Lee

Text-to-motion generation, which converts motion language descriptions into coherent 3D human motion sequences, has attracted increasing attention in fields, such as avatar animation and humanoid robotic interaction. Though existing models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xingzu Zhan , Chen Xie , Honghang Chen , Yixun Lin , Xiaochun Mai