Gesture based human motion and game principles to aid understanding of science and cultural practices

Prakash, E., Navarro-Newball, A., Moreno, I., Arya, A., Contreras, V.E., Quiceno, V.A., Lozano, S., Mejìa, J.D. and Loaiza, D.F. 2015. Gesture based human motion and game principles to aid understanding of science and cultural practices. Multimedia Tools and Applications. pp. 1-24.

TitleGesture based human motion and game principles to aid understanding of science and cultural practices
AuthorsPrakash, E., Navarro-Newball, A., Moreno, I., Arya, A., Contreras, V.E., Quiceno, V.A., Lozano, S., Mejìa, J.D. and Loaiza, D.F.
Abstract

We present a novel approach for recreating life-like experiences through an easy and natural gesture-based interaction. By focusing on the locations and transforming the role of the user, we are able to significantly maximise the understanding of an ancient cultural practice, behaviour or event over traditional approaches. Technology-based virtual environments that display object reconstructions, old landscapes, cultural artefacts, and scientific phenomena are coming into vogue. In traditional approaches the user is a visitor navigating through these virtual environments observing and picking objects. However, cultural practices and certain behaviours from nature are not normally made explicit and their dynamics still need to be understood. Thus, our research idea is to bring such practices to life by allowing the user to enact them. This means that user may re-live a step-by-step process to understand a practice, behaviour or event. Our solution is to enable the user to enact using gesture-based interaction with sensor-based technologies such as the versatile Kinect. This allows easier and natural ways to interact in multidimensional spaces such as museum exhibits. We use heuristic approaches and semantic models to interpret human gestures that are captured from the user’s skeletal representation. We present and evaluate three applications. For each of the three applications, we integrate these interaction metaphors with gaming elements, thereby achieving a gesture-set to enact a cultural practice, behaviour or event. User evaluation experiments revealed that our approach achieved easy and natural interaction with an overall enhanced learning experience.

KeywordsGesture, Human motion, Gamification, Museum
JournalMultimedia Tools and Applications
Journal citationpp. 1-24
ISSN1380-7501
Year2015
PublisherSpringer
Digital Object Identifier (DOI)doi:10.1007/s11042-015-2667-5
Publication dates
Published31 May 2015

Related outputs

Guest Editor's Introduction: Massively Multiplayer Online Games Technologies and Applications
Gomes, A.J.P. and Prakash, E. 2015. Guest Editor's Introduction: Massively Multiplayer Online Games Technologies and Applications. IEEE Transactions on Emerging Topics in Computing. 3 (2), pp. 258-259.

Taxonomy of optimisation techniques and applications
Maple, C., Prakash, E., Huang, W. and Qureshi, A.N. 2014. Taxonomy of optimisation techniques and applications. International Journal of Computer Applications in Technology. 49 (3-4), pp. 251-262.

Permalink - https://westminsterresearch.westminster.ac.uk/item/990y2/gesture-based-human-motion-and-game-principles-to-aid-understanding-of-science-and-cultural-practices


Share this
Tweet
Email