Towards an Interaction Blueprint for Mixed Reality Experiences in GLAM Spaces: The Augmented Telegrapher at Porthcurno Museum

Emerging mixed reality (MR) technologies, such as Microsoft HoloLens, present many exciting opportunities to the heritage sector. For example, the development of immersive experiences within gallery, library, archive, and museum (GLAM) spaces. Previous work on virtual and augmented reality (AR/VR) in such spaces is often limited to meta-layers of information beyond traditional modes. However, the affordances of MR potentially offer new ways to design content beyond AR/VR that can engage users as performers upon the stage of historically resonant and artistically charged places. This work-in-progress paper examines the case of the Augmented Telegrapher under development at Porthcurno Museum. A pilot study with 30 participants examined how to situate the Augmented Telegrapher into the context of a multi-player game, with particular attention given to which interaction style is more suitable: the use of sensors and gestures to manipulate virtual objects, or a tangible user interface grounded by relevant physical objects. Experimentation reveals a statistically significant difference in time taken to complete a data entry task (d = 1.32, p < .01) and data entry errors (d = 1.24, p < .01). This highlights several challenges in the manipulation of virtual objects, most notably the difficulty of manipulating virtual objects using unnatural maps of artificial gestures to intentions. This work-in-progress paper briefly outlines future directions in response to these challenges, paving the way towards an interaction design blueprint for mixed-reality experiences in GLAM spaces.

Content

Author and article information

Contributors

Michael James Scott

Jenny R Lee

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-5

Affiliations

[ ¹ ] Games Academy

Falmouth University

Cornwall, United Kingdom

[ ² ] Digital Coordination

Cornwall Museums Partnership

Cornwall, United Kingdom

Article

DOI: 10.14236/ewic/HCI2018.135

SO-VID: ad373c34-64ce-4eaf-860b-ceb557b294a0

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.135

Self URI (journal page): https://ewic.bcs.org/

References

R.T Azuma 1997 A Survey of Augmented Reality Presence: Teleoperators & Virtual Environments 6 4 355 385
M.K BekeleR PierdiccaE FrontoniE.S MalinverniJ. Gain 2018 A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage Journal on Computing and Cultural Heritage 11 2 Article 7
M. BekeleR. PierdiccaE. FrontoniE. MalinverniJ. Gain 2018 A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage Journal on Computing and Cultural Heritage 11 2 1 36
N. BugaliaS. KumarP. KalraS. Choudhary 2016 Mixed Reality based interaction system for digital heritage. Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, 1
J. Cohen 1992 A Power Primer Psychological Bulletin 112 1 155 159
M. FunkM. KritzlerF. Michahelles 2017 HoloLens is more than Air Tap: Natural and Intuitive Interaction with Holograms Proceedings of the Seventh International Conference on the Internet of Things
E.L. HutchinsJ.D. HollanD.A. Norman 1985 Direct Manipulation Interfaces Human-Computer Interaction 1 4 311 338
F. LiarokapisP. PetridisD. AndrewsS. de Freitas 2017 Multimodal Serious Game Technologies for Cultural Heritage M IoannidesN Manenat-ThalmannG. Papagiannakis Mixed Reality and Gamification for Cultural Heritage Springer Interantional Publishing Cham, Switzerland
M.J Mahoney 1978 Experimental Methods and Outcome Evaluation Journal of Consulting and Clinical Psychology 46 4 660 672
P. MilgramF. Kishino 1994 A Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information Systems 77 12 1321 1329
J. PineJ.H. Gilmore 2011 The Experience Economy Harvard Business Review Press Boston, MA
C. PollalisW. FarnbullehJ. TynesO. Shaer 2017 HoloMuse: Enhancing Engagement with Archaeological Artifacts through Gesture-Based Interaction with Holograms Eleventh International Conference on Tangible, Embedded, and Embodied Interaction
A. SannaF. Manuri 2016 A Survey on Applications of Augmented Reality Advances in Computer Science 5 1 18 27
B.H Thomas 2012 A Survey of Visual, Mixed, and Augmented Reality Gaming ACM Transactions on Computer Entertainment 10 3 Article 3
M. WolfF. GrodzinskyK. Miller 2016 Augmented reality all around us ACM SIGCAS Computers and Society 45 3 126 131
C. ZimmerM. BertramF. BüntigD. DrochtertC. Geiger 2018 Mobile Augmented Reality Illustrations that entertain and inform: Design and Implementation issues with the Hololens SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications (SA ’17)

Comments

Comment on this article

[1] R.T Azuma 1997 A Survey of Augmented Reality Presence: Teleoperators & Virtual Environments 6 4 355 385

[2] M.K BekeleR PierdiccaE FrontoniE.S MalinverniJ. Gain 2018 A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage Journal on Computing and Cultural Heritage 11 2 Article 7

[3] M. BekeleR. PierdiccaE. FrontoniE. MalinverniJ. Gain 2018 A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage Journal on Computing and Cultural Heritage 11 2 1 36

[4] N. BugaliaS. KumarP. KalraS. Choudhary 2016 Mixed Reality based interaction system for digital heritage. Proceedings of the 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, 1

[5] J. Cohen 1992 A Power Primer Psychological Bulletin 112 1 155 159

[6] M. FunkM. KritzlerF. Michahelles 2017 HoloLens is more than Air Tap: Natural and Intuitive Interaction with Holograms Proceedings of the Seventh International Conference on the Internet of Things

[7] E.L. HutchinsJ.D. HollanD.A. Norman 1985 Direct Manipulation Interfaces Human-Computer Interaction 1 4 311 338

[8] F. LiarokapisP. PetridisD. AndrewsS. de Freitas 2017 Multimodal Serious Game Technologies for Cultural Heritage M IoannidesN Manenat-ThalmannG. Papagiannakis Mixed Reality and Gamification for Cultural Heritage Springer Interantional Publishing Cham, Switzerland

[9] M.J Mahoney 1978 Experimental Methods and Outcome Evaluation Journal of Consulting and Clinical Psychology 46 4 660 672

[10] P. MilgramF. Kishino 1994 A Taxonomy of Mixed Reality Visual Displays IEICE Transactions on Information Systems 77 12 1321 1329

[11] J. PineJ.H. Gilmore 2011 The Experience Economy Harvard Business Review Press Boston, MA

[12] C. PollalisW. FarnbullehJ. TynesO. Shaer 2017 HoloMuse: Enhancing Engagement with Archaeological Artifacts through Gesture-Based Interaction with Holograms Eleventh International Conference on Tangible, Embedded, and Embodied Interaction

[13] A. SannaF. Manuri 2016 A Survey on Applications of Augmented Reality Advances in Computer Science 5 1 18 27

[14] B.H Thomas 2012 A Survey of Visual, Mixed, and Augmented Reality Gaming ACM Transactions on Computer Entertainment 10 3 Article 3

[15] M. WolfF. GrodzinskyK. Miller 2016 Augmented reality all around us ACM SIGCAS Computers and Society 45 3 126 131

[16] C. ZimmerM. BertramF. BüntigD. DrochtertC. Geiger 2018 Mobile Augmented Reality Illustrations that entertain and inform: Design and Implementation issues with the Hololens SIGGRAPH Asia 2017 Mobile Graphics & Interactive Applications (SA ’17)

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65