Data Visualization for Asynchronous VR Classroom

As a teaching tool for instructors, immersive Virtual Reality (VR) has the potential to deliver practice-oriented lessons to a large group of students. The instructor can record a demonstration inside VR and distribute the record to the students for viewing and practicing. Furthermore, the students’ activities and other biometric data can be recorded while they are learning. The instructor can potentially use these data to improve the lesson or detect early signs of problems in the virtual classroom. However, evaluating entire classroom datasets of students in 3DVR can drastically increase the instructor’s workload. To reduce this workload and improve the virtual classroom’s scalability, a visualization tool is required to summarise and communicate crucial information to the instructor. In this paper, we examine existing visualization solutions and propose a 3D visualization design that is suitable for classroom contexts. We then discuss, how this tool could be evaluated.

Content

Author and article information

Contributors

Santawat Thanyadit

Matthias Heintz

Effie Lai-Chong Law

Conference

Publication date (Print): July 2021

Pages: 1-5

Affiliations

[0001]University of Leicester

Article

DOI: 10.14236/ewic/HCI2021-W2.1

SO-VID: 9174bf69-0d46-480b-9668-e50f23988999

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: 34th British HCI Workshop and Doctoral Consortium

Conference acronym: HCI2021-WDC

Conference number: 34

Conference location: London, UK

Conference date: 20th - 21st July 2021

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Post-pandemic HCI – Living Digitally

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2021-W2.1

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

K ChowC CoyiutoC NguyenD Yoon, 2019. Challenges and design considerations for multimodal asynchronous collaboration in VR Proc. ACM Human-Computer Interact 3 https://doi.org/10.1145/3359142
J.E CorterJ. V NickersonS.K EscheC ChassapisS ImJ Ma 2007 Constructing reality: A study of remote, hands-on, and simulated laboratories ACM Trans. Comput. Interact 14 https://doi.org/10.1145/1275511.1275513
A DeyH ChenC ZhuangM BillinghurstR.W Lindeman 2019 Effects of Sharing Real-Time Multi-Sensory Heart Rate Feedback in Different Immersive Collaborative Virtual Environments Proc. 2018 IEEE Int. Symp. Mix. Augment. Reality, ISMAR 2018 165 173 https://doi.org/10.1109/ISMAR.2018.00052
A DeyT PiumsomboonY LeeM Billinghurst 2017 Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay Proc. 2017 CHI Conf. Hum. Factors Comput. Syst. - CHI ’17 4045 4056 https://doi.org/10.1145/3025453.3026028
A DrachenA Canossa 2011 Evaluating motion: Spatial user behaviour in virtual environments Int. J. Arts Technol 4 294 314 https://doi.org/10.1504/IJART.2011.041483
F KirschnerF PaasP.A Kirschner 2009 A cognitive load approach to collaborative learning: United brains for complex tasks Educ. Psychol. Rev 21 31 42 https://doi.org/10.1007/s10648-008-9095-2
H NguyenC PontonnierS HiltT DuvalG Dumont 2017 VR-based operating modes and metaphors for collaborative ergonomic design of industrial workstations J. Multimodal User Interfaces 11 97 111 https://doi.org/10.1007/s12193-016-0231-x
G.M OlsonJ.S Olson 2000 Distance matters Human-Computer Interact 15 139 178 https://doi.org/10.1207/S15327051HCI1523_4
J.V.V ParrR.J FosterG WoodN.M ThomasM.A Hollands 2020 Children With Developmental Coordination Disorder Show Altered Visuomotor Control During Stair Negotiation Associated With Heightened State Anxiety Front. Hum. Neurosci 14 589502 https://doi.org/10.3389/fnhum.2020.589502
T PiumsomboonA DeyB EnsG LeeM Billinghurst 2019 The effects of sharing awareness cues in collaborative mixed reality Front. Robot. AI 6 1 18 https://doi.org/10.3389/frobt.2019.00005
T PiumsomboonY LeeG.A LeeA DeyM Billinghurst 2017 Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See Proc. - 2017 Int. Symp. Ubiquitous Virtual Reality, ISUVR 2017 38 41 https://doi.org/10.1109/ISUVR.2017.20
C PontonnierT DuvalG Dumont 2015 Collaborative virtual environments for ergonomics: Embedding the design engineer role in the loop 2014 Int. Work. Collab. Virtual Environ. 3DCVE 2014 17 21 https://doi.org/10.1109/3DCVE.2014.7160930
Y RahmanS.M AsishN.P FisherE.C BruceA.K KulshreshthC.W Borst 2020 Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VR 868 877 https://doi.org/10.1109/vr46266.2020.00009
C ShiS FuQ ChenH Qu, 2015. VisMOOC: Visualizing video clickstream data from Massive Open Online Courses IEEE Pacific Vis. Symp 2015 July 159 166 https://doi.org/10.1109/PACIFICVIS.2015.7156373
B Shneiderman 1996 The eyes have it: a task by data type taxonomy for information visualizations Proceedings of IEEE Symposium on Visual Languages. Proc. 1996 IEEE Symp. Vis. Lang 28 336 343
Y YanC YuX MaS HuangH IqbalY Shi 2018 Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality 1 13 https://doi.org/10.1145/3173574.3173616
B YoonH. Il KimS.Y OhW Woo 2020 Evaluating Remote Virtual Hands Models on Social Presence in Hand-based 3D Remote Collaboration Proc. - 2020 IEEE Int. Symp. Mix. Augment. Reality, ISMAR 2020 520 532 https://doi.org/10.1109/ISMAR50242.2020.00080
H ZengX ShuYanbang WangYong WangL ZhangT.-C PongH Qu 2020 EmotionCues : Emotion-Oriented Visual Summarization of Classroom Videos IEEE Trans. Vis. Comput. Graph 27 3168 3181 https://doi.org/10.1109/tvcg.2019.2963659

Comments

Comment on this article

[1] K ChowC CoyiutoC NguyenD Yoon, 2019. Challenges and design considerations for multimodal asynchronous collaboration in VR Proc. ACM Human-Computer Interact 3 https://doi.org/10.1145/3359142

[2] J.E CorterJ. V NickersonS.K EscheC ChassapisS ImJ Ma 2007 Constructing reality: A study of remote, hands-on, and simulated laboratories ACM Trans. Comput. Interact 14 https://doi.org/10.1145/1275511.1275513

[3] A DeyH ChenC ZhuangM BillinghurstR.W Lindeman 2019 Effects of Sharing Real-Time Multi-Sensory Heart Rate Feedback in Different Immersive Collaborative Virtual Environments Proc. 2018 IEEE Int. Symp. Mix. Augment. Reality, ISMAR 2018 165 173 https://doi.org/10.1109/ISMAR.2018.00052

[4] A DeyT PiumsomboonY LeeM Billinghurst 2017 Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay Proc. 2017 CHI Conf. Hum. Factors Comput. Syst. - CHI ’17 4045 4056 https://doi.org/10.1145/3025453.3026028

[5] A DrachenA Canossa 2011 Evaluating motion: Spatial user behaviour in virtual environments Int. J. Arts Technol 4 294 314 https://doi.org/10.1504/IJART.2011.041483

[6] F KirschnerF PaasP.A Kirschner 2009 A cognitive load approach to collaborative learning: United brains for complex tasks Educ. Psychol. Rev 21 31 42 https://doi.org/10.1007/s10648-008-9095-2

[7] H NguyenC PontonnierS HiltT DuvalG Dumont 2017 VR-based operating modes and metaphors for collaborative ergonomic design of industrial workstations J. Multimodal User Interfaces 11 97 111 https://doi.org/10.1007/s12193-016-0231-x

[8] G.M OlsonJ.S Olson 2000 Distance matters Human-Computer Interact 15 139 178 https://doi.org/10.1207/S15327051HCI1523_4

[9] J.V.V ParrR.J FosterG WoodN.M ThomasM.A Hollands 2020 Children With Developmental Coordination Disorder Show Altered Visuomotor Control During Stair Negotiation Associated With Heightened State Anxiety Front. Hum. Neurosci 14 589502 https://doi.org/10.3389/fnhum.2020.589502

[10] T PiumsomboonA DeyB EnsG LeeM Billinghurst 2019 The effects of sharing awareness cues in collaborative mixed reality Front. Robot. AI 6 1 18 https://doi.org/10.3389/frobt.2019.00005

[11] T PiumsomboonY LeeG.A LeeA DeyM Billinghurst 2017 Empathic Mixed Reality: Sharing What You Feel and Interacting with What You See Proc. - 2017 Int. Symp. Ubiquitous Virtual Reality, ISUVR 2017 38 41 https://doi.org/10.1109/ISUVR.2017.20

[12] C PontonnierT DuvalG Dumont 2015 Collaborative virtual environments for ergonomics: Embedding the design engineer role in the loop 2014 Int. Work. Collab. Virtual Environ. 3DCVE 2014 17 21 https://doi.org/10.1109/3DCVE.2014.7160930

[13] Y RahmanS.M AsishN.P FisherE.C BruceA.K KulshreshthC.W Borst 2020 Exploring Eye Gaze Visualization Techniques for Identifying Distracted Students in Educational VR 868 877 https://doi.org/10.1109/vr46266.2020.00009

[14] C ShiS FuQ ChenH Qu, 2015. VisMOOC: Visualizing video clickstream data from Massive Open Online Courses IEEE Pacific Vis. Symp 2015 July 159 166 https://doi.org/10.1109/PACIFICVIS.2015.7156373

[15] B Shneiderman 1996 The eyes have it: a task by data type taxonomy for information visualizations Proceedings of IEEE Symposium on Visual Languages. Proc. 1996 IEEE Symp. Vis. Lang 28 336 343

[16] Y YanC YuX MaS HuangH IqbalY Shi 2018 Eyes-Free Target Acquisition in Interaction Space around the Body for Virtual Reality 1 13 https://doi.org/10.1145/3173574.3173616

[17] B YoonH. Il KimS.Y OhW Woo 2020 Evaluating Remote Virtual Hands Models on Social Presence in Hand-based 3D Remote Collaboration Proc. - 2020 IEEE Int. Symp. Mix. Augment. Reality, ISMAR 2020 520 532 https://doi.org/10.1109/ISMAR50242.2020.00080

[18] H ZengX ShuYanbang WangYong WangL ZhangT.-C PongH Qu 2020 EmotionCues : Emotion-Oriented Visual Summarization of Classroom Videos IEEE Trans. Vis. Comput. Graph 27 3168 3181 https://doi.org/10.1109/tvcg.2019.2963659

Studying business & IT? Drive your professional career forwards with BCS books - for a 20% discount click here: shop.bcs.org