Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures

Download Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures PDF Online Free

Author :
Release : 2011
Genre :
Kind :
Book Rating : /5 ( reviews)

Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures - read free eBook in online reader or directly download on the web page. Select files or add your book in reader. Download and read online ebook Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures write by Gan Lu. This book was released on 2011. Real-time Immersive Human-computer Interaction Based on Tracking and Recognition of Dynamic Hand Gestures available in PDF, EPUB and Kindle. With fast developing and ever growing use of computer based technologies, human-computer interaction (HCI) plays an increasingly pivotal role. In virtual reality (VR), HCI technologies provide not only a better understanding of three-dimensional shapes and spaces, but also sensory immersion and physical interaction. With the hand based HCI being a key HCI modality for object manipulation and gesture based communication, challenges are presented to provide users a natural, intuitive, effortless, precise, and real-time method for HCI based on dynamic hand gestures, due to the complexity of hand postures formed by multiple joints with high degrees-of-freedom, the speed of hand movements with highly variable trajectories and rapid direction changes, and the precision required for interaction between hands and objects in the virtual world. Presented in this thesis is the design and development of a novel real-time HCI system based on a unique combination of a pair of data gloves based on fibre-optic curvature sensors to acquire finger joint angles, a hybrid tracking system based on inertia and ultrasound to capture hand position and orientation, and a stereoscopic display system to provide an immersive visual feedback. The potential and effectiveness of the proposed system is demonstrated through a number of applications, namely, hand gesture based virtual object manipulation and visualisation, hand gesture based direct sign writing, and hand gesture based finger spelling. For virtual object manipulation and visualisation, the system is shown to allow a user to select, translate, rotate, scale, release and visualise virtual objects (presented using graphics and volume data) in three-dimensional space using natural hand gestures in real-time. For direct sign writing, the system is shown to be able to display immediately the corresponding SignWriting symbols signed by a user using three different signing sequences and a range of complex hand gestures, which consist of various combinations of hand postures (with each finger open, half-bent, closed, adduction and abduction), eight hand orientations in horizontal/vertical plans, three palm facing directions, and various hand movements (which can have eight directions in horizontal/vertical plans, and can be repetitive, straight/curve, clockwise/anti-clockwise). The development includes a special visual interface to give not only a stereoscopic view of hand gestures and movements, but also a structured visual feedback for each stage of the signing sequence. An excellent basis is therefore formed to develop a full HCI based on all human gestures by integrating the proposed system with facial expression and body posture recognition methods. Furthermore, for finger spelling, the system is shown to be able to recognise five vowels signed by two hands using the British Sign Language in real-time.

Real-Time Immersive Human-Computer Interaction

Download Real-Time Immersive Human-Computer Interaction PDF Online Free

Author :
Release : 2012
Genre :
Kind :
Book Rating : 870/5 ( reviews)

Real-Time Immersive Human-Computer Interaction - read free eBook in online reader or directly download on the web page. Select files or add your book in reader. Download and read online ebook Real-Time Immersive Human-Computer Interaction write by Gan Lu. This book was released on 2012. Real-Time Immersive Human-Computer Interaction available in PDF, EPUB and Kindle. Presented in this thesis is the design and development of a novel real-time HCI system based on a unique combination of a pair of data gloves based on fibre-optic curvature sensors to acquire finger joint angles, a hybrid tracking system based on inertia and ultrasound sensors to capture hand position and orientation, and a stereoscopic display to provide an immersive visual feedback. The potential and effectiveness of the proposed system is demonstrated through a number of hand gesture based applications, namely, virtual object manipulation and visualisation, direct sign writing, and finger spelling. For virtual object manipulation and visualisation, the system is shown to allow a user to manipulate and visualise virtual objects in 3D space using natural hand gestures in real-time. For direct sign writing, the system is shown to be able to display immediately the corresponding SignWriting symbols signed by a user using a range of complex hand gestures. Furthermore, for finger spelling, the system is shown to be able to recognise five vowels signed by two hands using the British Sign Language in real-time.

Human Computer Interaction Using Hand Gestures

Download Human Computer Interaction Using Hand Gestures PDF Online Free

Author :
Release : 2014-03-20
Genre : Technology & Engineering
Kind :
Book Rating : 696/5 ( reviews)

Human Computer Interaction Using Hand Gestures - read free eBook in online reader or directly download on the web page. Select files or add your book in reader. Download and read online ebook Human Computer Interaction Using Hand Gestures write by Prashan Premaratne. This book was released on 2014-03-20. Human Computer Interaction Using Hand Gestures available in PDF, EPUB and Kindle. Human computer interaction (HCI) plays a vital role in bridging the 'Digital Divide', bringing people closer to consumer electronics control in the 'lounge'. Keyboards and mouse or remotes do alienate old and new generations alike from control interfaces. Hand Gesture Recognition systems bring hope of connecting people with machines in a natural way. This will lead to consumers being able to use their hands naturally to communicate with any electronic equipment in their 'lounge.' This monograph will include the state of the art hand gesture recognition approaches and how they evolved from their inception. The author would also detail his research in this area for the past 8 years and how the future might turn out to be using HCI. This monograph will serve as a valuable guide for researchers (who would endeavour into) in the world of HCI.

Real-time Hand Gesture Detection and Recognition for Human Computer Interaction

Download Real-time Hand Gesture Detection and Recognition for Human Computer Interaction PDF Online Free

Author :
Release : 2012
Genre : Gesture
Kind :
Book Rating : /5 ( reviews)

Real-time Hand Gesture Detection and Recognition for Human Computer Interaction - read free eBook in online reader or directly download on the web page. Select files or add your book in reader. Download and read online ebook Real-time Hand Gesture Detection and Recognition for Human Computer Interaction write by Nasser Hasan Abdel-Qader Dardas. This book was released on 2012. Real-time Hand Gesture Detection and Recognition for Human Computer Interaction available in PDF, EPUB and Kindle. This thesis focuses on bare hand gesture recognition by proposing a new architecture to solve the problem of real-time vision-based hand detection, tracking, and gesture recognition for interaction with an application via hand gestures. The first stage of our system allows detecting and tracking a bare hand in a cluttered background using face subtraction, skin detection and contour comparison. The second stage allows recognizing hand gestures using bag-of-features and multi-class Support Vector Machine (SVM) algorithms. Finally, a grammar has been developed to generate gesture commands for application control. Our hand gesture recognition system consists of two steps: offline training and online testing. In the training stage, after extracting the keypoints for every training image using the Scale Invariance Feature Transform (SIFT), a vector quantization technique will map keypoints from every training image into a unified dimensional histogram vector (bag-of-words) after K-means clustering. This histogram is treated as an input vector for a multi-class SVM to build the classifier. In the testing stage, for every frame captured from a webcam, the hand is detected using my algorithm. Then, the keypoints are extracted for every small image that contains the detected hand posture and fed into the cluster model to map them into a bag-of-words vector, which is fed into the multi-class SVM classifier to recognize the hand gesture. Another hand gesture recognition system was proposed using Principle Components Analysis (PCA). The most eigenvectors and weights of training images are determined. In the testing stage, the hand posture is detected for every frame using my algorithm. Then, the small image that contains the detected hand is projected onto the most eigenvectors of training images to form its test weights. Finally, the minimum Euclidean distance is determined among the test weights and the training weights of each training image to recognize the hand gesture. Two application of gesture-based interaction with a 3D gaming virtual environment were implemented. The exertion videogame makes use of a stationary bicycle as one of the main inputs for game playing. The user can control and direct left-right movement and shooting actions in the game by a set of hand gesture commands, while in the second game, the user can control and direct a helicopter over the city by a set of hand gesture commands.

Real-Time Vision for Human-Computer Interaction

Download Real-Time Vision for Human-Computer Interaction PDF Online Free

Author :
Release : 2005-08-23
Genre : Computers
Kind :
Book Rating : 977/5 ( reviews)

Real-Time Vision for Human-Computer Interaction - read free eBook in online reader or directly download on the web page. Select files or add your book in reader. Download and read online ebook Real-Time Vision for Human-Computer Interaction write by Branislav Kisacanin. This book was released on 2005-08-23. Real-Time Vision for Human-Computer Interaction available in PDF, EPUB and Kindle. The need for natural and effective Human-Computer Interaction (HCI) is increasingly important due to the prevalence of computers in human activities. Computer vision and pattern recognition continue to play a dominant role in the HCI realm. However, computer vision methods often fail to become pervasive in the field due to the lack of real-time, robust algorithms, and novel and convincing applications. This state-of-the-art contributed volume is comprised of articles by prominent experts in computer vision, pattern recognition and HCI. It is the first published text to capture the latest research in this rapidly advancing field with exclusive focus on real-time algorithms and practical applications in diverse and numerous industries, and it outlines further challenges in these areas. Real-Time Vision for Human-Computer Interaction is an invaluable reference for HCI researchers in both academia and industry, and a useful supplement for advanced-level courses in HCI and Computer Vision.