English
Related papers

Related papers: Dynamic LIBRAS Gesture Recognition via CNN over Sp…

200 papers

This paper employs a multimodal approach for continuous sign recognition by first using ML for detecting the start and end frames of signs in videos of American Sign Language (ASL) sentences, and then by recognizing the segmented signs. For…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Mingyu Zhao , Zhanfu Yang , Yang Zhou , Zhaoyang Xia , Can Jin , Xiaoxiao He , Dimitris N. Metaxas

We present a novel framework for real-time sign language recognition using lightweight DNNs trained on limited data. Our system addresses key challenges in sign language recognition, including data scarcity, high computational costs, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Nikita Nikitin , Eugene Fomin

Sign language is a gesture-based symbolic communication medium among speech and hearing impaired people. It also serves as a communication bridge between non-impaired and impaired populations. Unfortunately, in most situations, a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-19 Prasun Roy , Saumik Bhattacharya , Partha Pratim Roy , Umapada Pal

Collocated tactile sensing is a fundamental enabling technology for dexterous manipulation. However, deformable sensors introduce complex dynamics between the robot, grasped object, and environment that must be considered for fine…

Robotics · Computer Science 2022-09-28 Miquel Oller , Mireia Planas , Dmitry Berenson , Nima Fazeli

Devices like the Myo armband available in the market today enable us to collect data about the position of a user's hands and fingers over time. We can use these technologies for sign language translation since each sign is roughly a…

Computer Vision and Pattern Recognition · Computer Science 2017-01-10 Hardie Cate , Fahim Dalvi , Zeshan Hussain

This study introduces an advanced gesture recognition and user interface (UI) interaction system powered by deep learning, highlighting its transformative impact on UI design and functionality. By utilizing optimized convolutional neural…

Human-Computer Interaction · Computer Science 2024-11-26 Qi Sun , Tong Zhang , Shang Gao , Liuqingqing Yang , Fenghua Shao

Robotic grasp should be carried out in a real-time manner by proper accuracy. Perception is the first and significant step in this procedure. This paper proposes an improved pipeline model trying to detect grasp as a rectangle…

Robotics · Computer Science 2024-03-12 Hamed Hosseini , Mehdi Tale Masouleh , Ahmad Kalhor

Hand gestures have evolved into a natural and intuitive means of engaging with technology. The objective of this research is to develop a robust system that can accurately recognize and classify hand gestures representing numbers. The…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Sangeetha K , Balaji VS , Kamalesh P , Anirudh Ganapathy PS

In this paper, we propose a micro hand gesture recognition system and methods using ultrasonic active sensing. This system uses micro dynamic hand gestures for recognition to achieve human-computer interaction (HCI). The implemented system,…

Signal Processing · Electrical Eng. & Systems 2024-12-02 Yu Sang , Laixi Shi , Yimin Liu

Hand segmentation and fingertip detection play an indispensable role in hand gesture-based human-machine interaction systems. In this study, we propose a method to discriminate hand components and to locate fingertips in RGB-D images. The…

Computer Vision and Pattern Recognition · Computer Science 2020-03-12 Duong Hai Nguyen , Tai Nhu Do , In-Seop Na , Soo-Hyung Kim

Hand gesture recognition possesses extensive applications in virtual reality, sign language recognition, and computer games. The direct interface of hand gestures provides us a new way for communicating with the virtual environment. In this…

Computer Vision and Pattern Recognition · Computer Science 2014-08-11 Reza Azad , Babak Azad , Iman Tavakoli Kazerooni

This paper addresses the problem of continuous gesture recognition from sequences of depth maps using convolutional neutral networks (ConvNets). The proposed method first segments individual gestures from a depth sequence based on quantity…

Computer Vision and Pattern Recognition · Computer Science 2016-09-13 Pichao Wang , Wanqing Li , Song Liu , Yuyao Zhang , Zhimin Gao , Philip Ogunbona

Hand gesture-based Sign Language Recognition (SLR) serves as a crucial communication bridge between deaf and non-deaf individuals. While Graph Convolutional Networks (GCNs) are common, they are limited by their reliance on fixed skeletal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Koki Hirooka , Abu Saleh Musa Miah , Tatsuya Murakami , Md. Al Mehedi Hasan , Yong Seok Hwang , Jungpil Shin

This paper presents a framework to automate the labelling process for gestures in musical performance videos with a 3D Convolutional Neural Network (CNN). While this idea was proposed in a previous study, this paper introduces several…

Computer Vision and Pattern Recognition · Computer Science 2022-05-25 Foteini Simistira Liwicki , Richa Upadhyay , Prakash Chandra Chhipa , Killian Murphy , Federico Visi , Stefan Östersjö , Marcus Liwicki

Manipulation of thin materials is critical for many everyday tasks and remains a significant challenge for robots. While existing research has made strides in tasks like material smoothing and folding, many studies struggle with common…

Robotics · Computer Science 2025-08-12 Ankush Kundan Dhawan , Camille Chungyoun , Karina Ting , Monroe Kennedy

In this work, we investigate the influence of labeling methods on the classification of human movements on data recorded using a marker-based motion capture system. The dataset is labeled using two different approaches, one based on video…

Computer Vision and Pattern Recognition · Computer Science 2022-02-08 Sadique Adnan Siddiqui , Lisa Gutzeit , Frank Kirchner

Using physical interactive devices like mouse and keyboards hinders naturalistic human-machine interaction and increases the probability of surface contact during a pandemic. Existing gesture-recognition systems do not possess user…

Human-Computer Interaction · Computer Science 2022-09-08 Ankit Jha , Ishita , Pratham G. Shenwai , Ayush Batra , Siddharth Kotian , Piyush Modi

This study presents a novel method to recognize human physical activities using CNN followed by LSTM. Achieving high accuracy by traditional machine learning algorithms, (such as SVM, KNN and random forest method) is a challenging task…

Signal Processing · Electrical Eng. & Systems 2020-03-16 Waqar Ahmad , Misbah Kazmi , Hazrat Ali

Researchers have been developing Hand Gesture Recognition (HGR) systems to enhance natural, efficient, and authentic human-computer interaction, especially benefiting those who rely solely on hand gestures for communication. Despite…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Jungpil Shin , Abu Saleh Musa Miah , Md. Humaun Kabir , Md. Abdur Rahim , Abdullah Al Shiam

Recognizing human activities in a sequence is a challenging area of research in ubiquitous computing. Most approaches use a fixed size sliding window over consecutive samples to extract features---either handcrafted or learned…

Computer Vision and Pattern Recognition · Computer Science 2017-02-22 Rui Yao , Guosheng Lin , Qinfeng Shi , Damith Ranasinghe