English
Related papers

Related papers: Collaborative Transformers for Grounded Situation …

200 papers

Predicting molecular ground-state conformation (i.e., energy-minimized conformation) is crucial for many chemical applications such as molecular docking and property prediction. Classic energy-based simulation is time-consuming when solving…

Biomolecules · Quantitative Biology 2025-05-23 Fanmeng Wang , Minjie Cheng , Hongteng Xu

Long-term complex activity recognition and localisation can be crucial for decision making in autonomous systems such as smart cars and surgical robots. Here we address the problem via a novel deformable, spatiotemporal scene graph…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Salman Khan , Fabio Cuzzolin

Group activity detection (GAD) is the task of identifying members of each group and classifying the activity of the group at the same time in a video. While GAD has been studied recently, there is still much room for improvement in both…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Dongkeun Kim , Youngkil Song , Minsu Cho , Suha Kwak

Monocular 3D human pose estimation technologies have the potential to greatly increase the availability of human movement data. The best-performing models for single-image 2D-3D lifting use graph convolutional networks (GCNs) that typically…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Sebastian Lutz , Richard Blythman , Koustav Ghosal , Matthew Moynihan , Ciaran Simms , Aljosa Smolic

Accurate trajectory prediction is crucial for ensuring safe and efficient autonomous driving. However, most existing methods overlook complex interactions between traffic participants that often govern their future trajectories. In this…

Artificial Intelligence · Computer Science 2024-05-08 Zixu Wang , Zhigang Sun , Juergen Luettin , Lavdim Halilaj

3D human pose estimation can be handled by encoding the geometric dependencies between the body parts and enforcing the kinematic constraints. Recently, Transformer has been adopted to encode the long-range dependencies between the joints…

Computer Vision and Pattern Recognition · Computer Science 2022-03-28 Mohammed Hassanin , Abdelwahed Khamiss , Mohammed Bennamoun , Farid Boussaid , Ibrahim Radwan

In recent years, transformer-based models have exhibited considerable potential in point cloud instance segmentation. Despite the promising performance achieved by existing methods, they encounter challenges such as instance query…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Lei Yao , Yi Wang , Moyun Liu , Lap-Pui Chau

There is a recent trend in the LiDAR perception field towards unifying multiple tasks in a single strong network with improved performance, as opposed to using separate networks for each task. In this paper, we introduce a new LiDAR…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zixiang Zhou , Dongqiangzi Ye , Weijia Chen , Yufei Xie , Yu Wang , Panqu Wang , Hassan Foroosh

Multi-view action recognition aims to recognize human actions using multiple camera views and deals with occlusion caused by obstacles or crowds. In this task, cooperation among views, which generates a joint representation by combining…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Taiga Yamane , Satoshi Suzuki , Ryo Masumura , Shotaro Tora

Multi-person motion prediction remains a challenging problem, especially in the joint representation learning of individual motion and social interactions. Most prior methods only involve learning local pose dynamics for individual motion…

Computer Vision and Pattern Recognition · Computer Science 2023-02-07 Xiaogang Peng , Yaodi Shen , Haoran Wang , Binling Nie , Yigang Wang , Zizhao Wu

Dynamic representation learning plays a pivotal role in understanding the evolution of linguistic content over time. On this front both context and time dynamics as well as their interplay are of prime importance. Current approaches model…

Computation and Language · Computer Science 2024-10-23 Talia Tseriotou , Adam Tsakalidis , Maria Liakata

Providing care for ageing populations is an onerous task, and as life expectancy estimates continue to rise, the number of people that require senior care is growing rapidly. This paper proposes a methodology based on Transformer Neural…

Signal Processing · Electrical Eng. & Systems 2020-11-25 Luke Hicks , Ariel Ruiz-Garcia , Vasile Palade , Ibrahim Almakky

Accurate and reliable energy forecasting is essential for power grid operators who strive to minimize extreme forecasting errors that pose significant operational challenges and incur high intra-day trading costs. Incorporating planning…

Computers and Society · Computer Science 2026-05-13 Raffael Theiler , Leandro Von Krannichfeldt , Giovanni Sansavini , Michael F. Howland , Olga Fink

Accepted in the ICIP 2025 We present a novel transformer-based framework for whole-body grasping that addresses both pose generation and motion infilling, enabling realistic and stable object interactions. Our pipeline comprises three…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Edward Effendy , Kuan-Wei Tseng , Rei Kawakami

Action detection is an essential and challenging task, especially for densely labelled datasets of untrimmed videos. The temporal relation is complex in those datasets, including challenges like composite action, and co-occurring action.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Rui Dai , Srijan Das , Kumara Kahatapitiya , Michael S. Ryoo , Francois Bremond

Named entity recognition (NER) is an important research problem in natural language processing. There are three types of NER tasks, including flat, nested and discontinuous entity recognition. Most previous sequential labeling models are…

Computation and Language · Computer Science 2023-03-21 Ying Mo , Hongyin Tang , Jiahao Liu , Qifan Wang , Zenglin Xu , Jingang Wang , Wei Wu , Zhoujun Li

4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xiaokai Bai , Lianqing Zheng , Si-Yuan Cao , Xiaohan Zhang , Zhe Wu , Beinan Yu , Fang Wang , Jie Bai , Hui-Liang Shen

DAVIS camera, streaming two complementary sensing modalities of asynchronous events and frames, has gradually been used to address major object detection challenges (e.g., fast motion blur and low-light). However, how to effectively…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Dianze Li , Jianing Li , Yonghong Tian

Link prediction is an important and frequently studied task that contributes to an understanding of the structure of knowledge graphs (KGs) in statistical relational learning. Inspired by the success of graph convolutional networks (GCN) in…

Machine Learning · Computer Science 2019-10-03 Ling Cai , Bo Yan , Gengchen Mai , Krzysztof Janowicz , Rui Zhu

Co-Salient Object Detection (CoSOD) aims at simulating the human visual system to discover the common and salient objects from a group of relevant images. Recent methods typically develop sophisticated deep learning based models have…

Computer Vision and Pattern Recognition · Computer Science 2022-09-23 Lv Tang , Bo Li