English
Related papers

Related papers: InterMamba: Efficient Human-Human Interaction Gene…

200 papers

Spatio-temporal graph (STG) forecasting is a critical task with extensive applications in the real world, including traffic and weather forecasting. Although several recent methods have been proposed to model complex dynamics in STGs,…

Machine Learning · Computer Science 2024-06-18 Jinhyeok Choi , Heehyeon Kim , Minhyeong An , Joyce Jiyoung Whang

Mamba, a selective state-space model (SSM), has emerged as an efficient alternative to Transformers for speech modeling, enabling long-sequence processing with linear complexity. While effective in speech separation, existing approaches,…

Sound · Computer Science 2026-01-26 Ke Xue , Chang Sun , Rongfei Fan , Jing Wang , Han Hu

High-Density surface Electromyography (HDsEMG) has emerged as a pivotal resource for Human-Computer Interaction (HCI), offering direct insights into muscle activities and motion intentions. However, a significant challenge in practical…

Signal Processing · Electrical Eng. & Systems 2026-02-25 Mehran Shabanpour , Kasra Rad , Sadaf Khademi , Arash Mohammadi

The Interspeech 2025 URGENT Challenge aimed to advance universal, robust, and generalizable speech enhancement by unifying speech enhancement tasks across a wide variety of conditions, including seven different distortion types and five…

Sound · Computer Science 2025-10-01 Rong Chao , Rauf Nasretdinov , Yu-Chiang Frank Wang , Ante Jukić , Szu-Wei Fu , Yu Tsao

Transformers have widely adopted attention networks for sequence mixing and MLPs for channel mixing, playing a pivotal role in achieving breakthroughs across domains. However, recent literature highlights issues with attention networks,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Badri N. Patro , Vijay S. Agneeswaran

In this paper, we introduce Matten, a cutting-edge latent diffusion model with Mamba-Attention architecture for video generation. With minimal computational cost, Matten employs spatial-temporal attention for local video content modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Yu Gao , Jiancheng Huang , Xiaopeng Sun , Zequn Jie , Yujie Zhong , Lin Ma

Wearable sensor-based human activity recognition (HAR) is a critical research domain in activity perception. However, achieving high efficiency and long sequence recognition remains a challenge. Despite the extensive investigation of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-09 Shuangjian Li , Tao Zhu , Furong Duan , Liming Chen , Huansheng Ning , Christopher Nugent , Yaping Wan

State-of-the-art transformer-based large multimodal models (LMMs) struggle to handle hour-long video inputs due to the quadratic complexity of the causal self-attention operations, leading to high computational costs during training and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Weiming Ren , Wentao Ma , Huan Yang , Cong Wei , Ge Zhang , Wenhu Chen

3D multi-person motion prediction is a highly complex task, primarily due to the dependencies on both individual past movements and the interactions between agents. Moreover, effectively modeling these interactions often incurs substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yuanhong Zheng , Ruixuan Yu , Jian Sun

Grasp detection is a fundamental robotic task critical to the success of many industrial applications. However, current language-driven models for this task often struggle with cluttered images, lengthy textual descriptions, or slow…

Robotics · Computer Science 2024-09-24 Huy Hoang Nguyen , An Vuong , Anh Nguyen , Ian Reid , Minh Nhat Vu

In applications such as e-commerce, online education, and streaming services, sequential recommendation systems play a critical role. Despite the excellent performance of self-attention-based sequential recommendation models in capturing…

Information Retrieval · Computer Science 2026-02-06 Jinzhao Su , Zhenhua Huang

The perception and generation of Human-Object Interaction (HOI) are crucial for fields such as robotics, AR/VR, and human behavior understanding. However, current approaches model this task in an offline setting, where information at each…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Yihong Ji , Yunze Liu , Yiyao Zhuo , Weijiang Yu , Fei Ma , Joshua Huang , Fei Yu

Generating realistic 3D human-human interactions from textual descriptions remains a challenging task. Existing approaches, typically based on diffusion models, often produce results lacking realism and fidelity. In this work, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Muhammad Gohar Javed , Chuan Guo , Li Cheng , Xingyu Li

Transformers have significantly advanced the field of 3D human pose estimation (HPE). However, existing transformer-based methods primarily use self-attention mechanisms for spatio-temporal modeling, leading to a quadratic complexity,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Yunlong Huang , Junshuo Liu , Ke Xian , Robert Caiming Qiu

Long-term dense action anticipation is very challenging since it requires predicting actions and their durations several minutes into the future based on provided video observations. To model the uncertainty of future outcomes, stochastic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Olga Zatsarynna , Emad Bahrami , Yazan Abu Farha , Gianpiero Francesca , Juergen Gall

Multimodal semantic learning plays a critical role in embodied intelligence, especially when robots perceive their surroundings, understand human instructions, and make intelligent decisions. However, the field faces technical challenges…

Robotics · Computer Science 2025-09-24 Zeyi Kang , Liang He , Yanxin Zhang , Zuheng Ming , Kaixing Zhao

Depression is a prevalent mental health disorder that severely impairs daily functioning and quality of life. While recent deep learning approaches for depression detection have shown promise, most rely on limited feature types, overlook…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Bowen Zhou , Marc-André Fiedler , Ayoub Al-Hamadi

Accurate chemical kinetics modeling is essential for combustion simulations, as it governs the evolution of complex reaction pathways and thermochemical states. In this work, we introduce Kinetic-Mamba, a Mamba-based neural operator…

Machine Learning · Computer Science 2026-04-07 Additi Pandey , Liang Wei , Hessam Babaee , George Em Karniadakis

In visually ambiguous manipulation such as detecting button click tactile feedback is often the sole source of ground truth. However, fusing tactile data poses a significant challenge due to a spatiotemporal mismatch: tactile perception…

Robotics · Computer Science 2026-03-03 Zhenan Wang , Yanzhe Wang , Meixuan Ren , Peng Li , Yang Liu , Yifei Nie , Limin Long , Yun Ye , Xiaofeng Wang , Zhen Zhu , Huixu Dong

Time series prediction plays a pivotal role across diverse domains such as finance, healthcare, energy systems, and environmental modeling. However, existing approaches often struggle to balance efficiency, scalability, and accuracy,…

Machine Learning · Computer Science 2026-01-13 Xingsheng Chen , Regina Zhang , Bo Gao , Xingwei He , Xiaofeng Liu , Pietro Lio , Kwok-Yan Lam , Siu-Ming Yiu