Augmented Reality (AR) combines real and virtual objects, provides opportunities for real-time interaction and provides accurate registration of 3D virtual and real objects. Mobile AR creates unique opportunities for gameplay unrestricted by the screen size of mobile devices with interactions possible between players, game objects and the real world. Since the launch of Pokémon Go in 2016, AR gaming has gone mainstream, several commercial mobile AR games have been launched, and researchers have conducted several studies on the motivations, intentions, and experiences associated with playing AR games. However, most studies in this area have focused on Pokémon Go, and have not included issues reported by players. This paper presents a study conducted with the aim of understanding issues, specifically those associated with the use of AR in games, that mobile AR game players face. User reviews for 10 popular commercial mobile AR games that utilise AR in all significant gameplay activities were gathered and analysed using Thematic Analysis to identify 11 themes of issues. This study adds to the body of knowledge and understanding of issues facing mobile AR game players and includes commercial mobile AR games other than Pokémon Go in the research on AR games.
K. Alha, E. Koskinen, J. Paavilainen, & J. Hamari (2019). Why do people play location-based augmented reality games: A study on Pokémon GO. Computers in Human Behavior, 93, 114–122. [Cross Ref]
A. Angelopoulou, D. Economou, V. Bouki, A. Psarrou, L. Jin, C. Pritchard, & F. Kolyda (2012). Mobile Augmented Reality for Cultural Heritage (pp. 15–22). [Cross Ref]
AppsFlyer. (2016). The State of In-App Spending: Global & Regional Benchmarks, 2016.
AR Insider. (2021). How Big is the Mobile AR Market? https://arinsider.co/2021/02/23/how-big-is-the-mobile-ar-market-2/
R. T. Azuma (1997). A Survey of Augmented Reality. Presence: Teleoperators and Virtual Environments, 6(4), 355–385. [Cross Ref]
C. Botella, J. Breton-López, S. Quero, R. M. Baños, A. García-Palacios, I. Zaragoza, & M. Alcaniz (2011). Treating cockroach phobia using a serious game on a mobile phone and augmented reality exposure: A single case study. Computers in Human Behavior, 27(1), 217–227. [Cross Ref]
V. Braun, & V. Clarke (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. [Cross Ref]
V. Braun, & V. Clarke (2012). Thematic analysis. In APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. (pp. 57–71). American Psychological Association. [Cross Ref]
S. Bueno, M. D. Gallego, & J. Noyes (2020). Uses and Gratifications on Augmented Reality Games: An Examination of Pokémon Go. Applied Sciences, 10(5), 1644. [Cross Ref]
H. Chen, Y. Dai, H. Meng, Y. Chen, & T. Li (2018). Understanding the Characteristics of Mobile Augmented Reality Applications. 2018 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS), 128–138. [Cross Ref]
I. Civelek, Y. Liu, & S. R. Marston (2018). Design of Free-to-Play Mobile Games for the Competitive Marketplace. International Journal of Electronic Commerce, 22(2), 258–288. [Cross Ref]
A. Di Sorbo, S. Panichella, C. V. Alexandru, C. A. Visaggio, & G. Canfora (2017). SURF: Summarizer of User Reviews Feedback. 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C), 55–58. [Cross Ref]
A. I. Etxeberria, M. Asensio, N. Vicent, & J. M. Cuenca (2012). Mobile devices: a tool for tourism and learning at archaeological sites. International Journal of Web Based Communities, 8(1), 57. [Cross Ref]
S. Fagernäs, W. Hamilton, N. Espinoza, A. Miloff, P. Carlbring, & P. Lindner (2021). What do users think about Virtual Reality relaxation applications? A mixed methods study of online user reviews using natural language processing. Internet Interventions, 24, 100370. [Cross Ref]
N. Faric, H. W. W. Potts, A. Hon, L. Smith, K. Newby, A. Steptoe, & A. Fisher (2019). What Players of Virtual Reality Exercise Games Want: Thematic Analysis of Web-Based Reviews. Journal of Medical Internet Research, 21(9), e13833. [Cross Ref]
K. Frie, J. Hartmann-Boyce, S. Jebb, C. Albury, R. Nourse, & P. Aveyard (2017). Insights From Google Play Store User Reviews for the Development of Weight Loss Apps: Mixed-Method Analysis. JMIR MHealth and UHealth, 5(12), e203. [Cross Ref]
D. Furió, M.-C. Juan, I. Seguí, & R. Vivó (2015). Mobile learning vs. traditional classroom lessons: a comparative study. Journal of Computer Assisted Learning, 31(3), 189–201. [Cross Ref]
C. Gao, J. Zeng, M. R. Lyu, & I. King (2018). Online app review analysis for identifying emerging issues. Proceedings of the 40th International Conference on Software Engineering, 48–58. [Cross Ref]
J. A. Garcia, & K. F. Navarro (2014). The Mobile RehAppTM: an AR-based mobile game for ankle sprain rehabilitation. 2014 IEEE 3nd International Conference on Serious Games and Applications for Health (SeGAH), 1–6. [Cross Ref]
Y. Ghazwani, & S. Smith (2020). Interaction in Augmented Reality. Proceedings of the 2020 4th International Conference on Virtual and Augmented Reality Simulations, 39–44. [Cross Ref]
E. Guzman, & W. Maalej (2014). How Do Users Like This Feature? A Fine Grained Sentiment Analysis of App Reviews. 2014 IEEE 22nd International Requirements Engineering Conference (RE), 153–162. [Cross Ref]
J. Hamari, A. Malik, J. Koski, & A. Johri (2019). Uses and Gratifications of Pokémon Go: Why do People Play Mobile Location-Based Augmented Reality Games? International Journal of Human-Computer Interaction, 35(9), 804–819. [Cross Ref]
L. Hoon, R. Vasa, J.-G. Schneider, & K. Mouzakis (2012). A preliminary analysis of vocabulary in mobile app user reviews. Proceedings of the 24th Australian Computer-Human Interaction Conference on - OzCHI ’12, 245–248. [Cross Ref]
K.-L. Hsiao, M. D. Lytras, & C.-C. Chen (2019). An in-app purchase framework for location-based AR games: the case of Pokémon Go. Library Hi Tech, 38(3), 638–653. [Cross Ref]
J. Huebner, R. M. Frey, C. Ammendola, E. Fleisch, & A. Ilic (2018). What People Like in Mobile Finance Apps. Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia, 293–304. [Cross Ref]
C. Iacob, & R. Harrison (2013). Retrieving and analyzing mobile apps feature requests from online reviews. 2013 10th Working Conference on Mining Software Repositories (MSR), 41–44. [Cross Ref]
M, C. Juan, D. Furió, L. Alem, P. Ashworth, & J. Cano (2011). ARGreenet and BasicGreenet: Two mobile games for learning how to recycle. 19th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, WSCG 2011 - In Co-Operation with EUROGRAPHICS, Full Papers Proceedings, 25–32.
S. Kang, H. Choi, S. Park, C. Park, J. Lee, U. Lee, & S.-J. Lee (2019). Fire in Your Hands: Understanding Thermal Behavior of Smartphones. The 25th Annual International Conference on Mobile Computing and Networking, 1–16. [Cross Ref]
S. Karimi, & F. Wang (2017). Online review helpfulness: Impact of reviewer profile image. Decision Support Systems, 96, 39–48. [Cross Ref]
M. Kesim, & Y. Ozarslan (2012). Augmented Reality in Education: Current Technologies and the Potential for Education. Procedia - Social and Behavioral Sciences, 47, 297–302. [Cross Ref]
H. Khalid, E. Shihab, M. Nagappan, & A. E. Hassan (2015). What Do Mobile App Users Complain About? IEEE Software, 32(3), 70–77. [Cross Ref]
S. M. Ko, W. S. Chang, & Y. G. Ji (2013). Usability Principles for Augmented Reality Applications in a Smartphone Environment. International Journal of Human-Computer Interaction, 29(8), 501–515. [Cross Ref]
S. Koceski, & N. Koceska (2011). Interaction between players of mobile phone game with augmented reality (AR) interface. 2011 International Conference on User Science and Engineering (i-USEr ), 245–250. [Cross Ref]
T. Laine (2018). Mobile Educational Augmented Reality Games: A Systematic Literature Review and Two Case Studies. Computers, 7(1), 19. [Cross Ref]
W. Maalej, & H. Nabil (2015). Bug report, feature request, or simply praise? On automatically classifying app reviews. 2015 IEEE 23rd International Requirements Engineering Conference (RE), 116–125. [Cross Ref]
W. Martin, M. Harman, Y. Jia, F. Sarro, & Y. Zhang (2015). The App Sampling Problem for App Store Mining. 2015 IEEE/ACM 12th Working Conference on Mining Software Repositories, 123–133. [Cross Ref]
I. J. Mojica Ruiz, M. Nagappan, B. Adams, T. Berger, S. Dienst, & A. E. Hassan (2016). Examining the Rating System Used in Mobile-App Stores. IEEE Software, 33(6), 86–92. [Cross Ref]
C. Moro, C. Phelps, P. Redmond, & Z. Stromberga (2021). HoloLens and mobile augmented reality in medical and health science education: A randomised controlled trial. British Journal of Educational Technology, 52(2), 680–694. [Cross Ref]
A. Mulloni, J. Grubert, H. Seichter, T. Langlotz, R. Grasset, G. Reitmayr, & D. Schmalstieg (2012). Experiences with the Impact of Tracking Technology in Mobile Augmented Reality Evaluations. Proc. MobileHCI Workshop on Mobile Vision and HCI (MobiVis) 2012, 2. http://data.icg.tugraz.at/~dieter/publications/Schmalstieg_237.pdf
Niantic - The Pokémon GO Team. (2016). 200,000 trips around the Earth! https://pokemongo.nianticlabs.com/post/milestones/?hl=en
J. Nicholas, A. S. Fogarty, K. Boydell, & H. Christensen (2017). The Reviews Are in: A Qualitative Content Analysis of Consumer Perspectives on Apps for Bipolar Disorder. Journal of Medical Internet Research, 19(4), e105. [Cross Ref]
Z. Oufqir, A. El Abderrahmani, & K. Satori (2020). From Marker to Markerless in Augmented Reality (pp. 599–612). [Cross Ref]
R. Palmarini, J. A. Erkoyuncu, R. Roy, & H. Torabmostaedi (2018). A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing, 49, 215–228. [Cross Ref]
S. Panichella, A. Di Sorbo, E. Guzman, C. A. Visaggio, G. Canfora, & H. C. Gall (2015). How can i improve my app? Classifying user reviews for software maintenance and evolution. 2015 IEEE International Conference on Software Maintenance and Evolution (ICSME), 281–290. [Cross Ref]
A. Pyae, L. Mika, & J. Smed (2017). Understanding Players’ Experiences in Location-based Augmented Reality Mobile Games. Extended Abstracts Publication of the Annual Symposium on Computer-Human Interaction in Play, 535–541. [Cross Ref]
A. Pyae, & L. E. Potter (2016). A player engagement model for an augmented reality game. Proceedings of the 28th Australian Conference on Computer-Human Interaction - OzCHI ’16, 11–15. [Cross Ref]
J. Qian, J. Ma, X. Li, B. Attal, H. Lai, J. Tompkin, J. F. Hughes, & J. Huang (2019). Portalble: Intuitive Free-hand Manipulation in Unbounded Smartphone-based Augmented Reality. Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology, 133–145. [Cross Ref]
X. Qiao, P. Ren, S. Dustdar, L. Liu, H. Ma, & J. Chen (2019). Web AR: A Promising Future for Mobile Augmented Reality—State of the Art, Challenges, and Insights. Proceedings of the IEEE, 107(4), 651–666. [Cross Ref]
I. Radu, K. Guzdial, & S. Avram (2017). An Observational Coding Scheme for Detecting Children’s Usability Problems in Augmented Reality. Proceedings of the 2017 Conference on Interaction Design and Children, 643–649. [Cross Ref]
P. A. Rauschnabel, A. Rossmann, & M. C. tom Dieck (2017). An adoption framework for mobile augmented reality games: The case of Pokémon Go. Computers in Human Behavior, 76, 276–286. [Cross Ref]
M. M. T. Rodrigo, N. R. Caluya, W. D. A. Diy, & E. C. E. Vidal (2015). Igpaw: Intramuros - Design of an augmented reality game for philippine history. Proceedings of the 23rd International Conference on Computers in Education, ICCE 2015, 489–498.
A. Sanna, & F. Manuri (2016). A Survey on Applications of Augmented Reality. Advances in Computer Science : An International Journal, 5(1), 18–27. http://www.acsij.org/acsij/article/view/400
K. Saoane Thach, & T. Phuong Nam Phan (2019). Persuasive Design Principles in Mental Health Apps: A Qualitative Analysis of User Reviews. 2019 IEEE-RIVF International Conference on Computing and Communication Technologies (RIVF), 1–6. [Cross Ref]
M. L. Tan, R. Prasanna, K. Stock, E. E. H. Doyle, G. Leonard, & D. Johnston (2020). Modified Usability Framework for Disaster Apps: A Qualitative Thematic Analysis of User Reviews. International Journal of Disaster Risk Science, 11(5), 615–629. [Cross Ref]
G. Terry, N. Hayfield, V. Clarke, & V. Braun (2017). Thematic Analysis. In The SAGE Handbook of Qualitative Research in Psychology (pp. 17–36). SAGE Publications Ltd. [Cross Ref]
K. S. Thach (2018). User’s perception on mental health applications: a qualitative analysis of user reviews. 2018 5th NAFOSTED Conference on Information and Computer Science (NICS), 47–52. [Cross Ref]
N. Tuli, & A. Mantri (2020). Usability Principles for Augmented Reality based Kindergarten Applications. Procedia Computer Science, 172, 679–687. [Cross Ref]
M. Vaismoradi, H. Turunen, & T. Bondas (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398–405. [Cross Ref]
R. Vasa, L. Hoon, K. Mouzakis, & A. Noguchi (2012). A preliminary analysis of mobile app user reviews. Proceedings of the 24th Australian Computer-Human Interaction Conference on - OzCHI ’12, 241–244. [Cross Ref]
R. Wetzel, L. Blum, W. Broll, & L. Oppermann (2011). Designing Mobile Augmented Reality Games. In B. Furht (Ed.), Handbook of Augmented Reality (pp. 513–539). Springer New York. [Cross Ref]
M. M. Zarzuela, F. J. D. Pernas, L. B. Martínez, D. G. Ortega, & M. A. Rodríguez (2013). Mobile Serious Game Using Augmented Reality for Supporting Children’s Learning About Animals. Procedia Computer Science, 25, 375–381. [Cross Ref]
Á. Zsila, G. Orosz, B. Bőthe, I. Tóth-Király, O. Király, M. Griffiths, & Z. Demetrovics (2018). An empirical study on the motivations underlying augmented reality games: The case of Pokémon Go during and after Pokémon fever. Personality and Individual Differences, 133, 56–66. [Cross Ref]