+1 Recommend
1 collections
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      User-based Evaluation of Gamification Elements in an Educational Application


      1 , 1

      Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI)

      Human Computer Interaction Conference

      4 - 6 July 2018

      Gamification elements, education, user experience, interaction design, eye tracking



            Gamification has increasingly been utilised to motivate students to use technological tools and applications to learn. Although the existing research seems to recognise the benefits that gamification has in and outside classroom, little has been explored about individual gamification elements. To bridge this gap, we conducted a user-based evaluation of an educational application, Knowma+, with different gamification elements to understand which are more desirable to use from the teacher and student perspectives. Knowma+ is built upon relevant pedagogical concepts such as learning by questioning that fit well with the inclusion of gamification elements to enhance learning experience. Results of eye-tracking data suggest that more visually attractive gamification elements could capture the initial attention of both teacher and student participants. However, there were slight differences between the two groups in self-reported preferences with regard to the perceived usefulness of each gamification element as part of their teaching or learning approaches.


            Author and article information

            July 2018
            July 2018
            : 1-13
            [1 ] University of Leicester

            University Road, Leicester

            LE1 7RH, United Kingdom
            © Andrade et al. Published by BCS Learning and Development Ltd. Proceedings of British HCI 2018. Belfast, UK.

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            Proceedings of the 32nd International BCS Human Computer Interaction Conference
            Belfast, UK
            4 - 6 July 2018
            Electronic Workshops in Computing (eWiC)
            Human Computer Interaction Conference
            Product Information: 1477-9358BCS Learning & Development
            Self URI (journal page): https://ewic.bcs.org/
            Electronic Workshops in Computing
            1. 2013 May Steering user behavior with badges In Proceedings of the 22nd international conference on World Wide Web 95 106 ACM

            2. 2015 Mapping learning and game mechanics for serious games analysis British Journal of Educational Technology 46 2 391 411

            3. 2015 Gamification in assessment: Do points affect test performance?. Computers & Education 83 57 63

            4. 2014 Increasing student intrinsic motivation and self-efficacy through gamification pedagogy Contemporary Issues in Education Research (Online) 7 4 291

            5. 2016 Gamification in the Classroom: Old Wine in New Badges Learning, Education and Games 61 67

            6. 2006 Distance Education Trends: Integrating new technologies to foster student interaction and collaboration Distance Education 27 2 139 153

            7. 2016 Analyzing qualitative data: Systematic approaches SAGE publications

            8. 2010 Inside the Black Box: Raising Standards through Classroom Assessment Phi Delta Kappan 92 1 81 90

            9. 1996 SUS-A quick and dirty usability scale Usability evaluation in industry 189 194 4 7

            10. 2015 September An empirical study of the effects of three think-aloud protocols on identification of usability problems In Human-Computer Interaction 159 176 Springer Cham

            11. 2013 Classroom strategies for interactive learning Newark, USA International Reading Association

            12. 2010 Gamification 101: An introduction to the use of game dynamics to influence behavior. White paper, 9

            13. 2018 Watch IT: The risks and promises of information technologies for education. Routledge

            14. 2014 Towards the gamification of learning: Investigating student perceptions of game elements Journal of Information Systems Education 25 3 233

            15. 2006 What teacher educators need to know about inquiry-based instruction. Paper presented at the annual meeting of the Association for Education of Teachers in Science, Akron, OH

            16. 2010 Self‐determination John Wiley & Sons, Inc.

            17. 2017 May Why is This Happening to Me?: How Player Attribution can Broaden our Understanding of Player Experience In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems 1040 1052 ACM

            18. 2012 Gamification: designing for motivation interactions 19 4 14 17

            19. 2011 September From game design elements to gamefulness: defining gamification In Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments 9 15 ACM

            20. 2015 Gamification in education: a systematic mapping study Journal of Educational Technology & Society 18 3 75

            21. 2010 Transforming formative assessment in lifelong learning Berkshire, England Open University Press

            22. 2007 September Identifying web usability problems from eye-tracking data In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI... but not as we know it-Volume 1 119 128 British Computer Society

            23. 2010 Towards discursive education New York Cambridge University Press

            24. 2017 September A Review of Gamification Platforms for Higher Education In Proceedings of the 8th Balkan Conference in Informatics 28 ACM

            25. 2014 January Does gamification work?--a literature review of empirical studies on gamification In System Sciences (HICSS), 2014 47th Hawaii International Conference on 3025 3034 IEEE

            26. 2015 Game Elements-Attributes Model: a First Step towards a Structured Comparison of Educational Games. In DiGRA Conference

            27. 2014 March An experience report on using gamification in technical higher education In Proceedings of the 45th ACM technical symposium on Computer science education 27 32 ACM

            28. 2005 A theory of fun for game design. Scottsdale, AZ: Paraglyph Press

            29. 2017 Gamification of task performance with leaderboards: A goal setting experiment Computers in Human Behavior 71 508 515

            30. 2015 Building school 2.0 John Wiley & Sons

            31. 2016 Social network analysis of a gamified e-learning course: Small-world phenomenon and network metrics as predictors of academic performance Computers in Human Behavior 60 312 321

            32. 2011 The Sage handbook of visual research methods. Sage. 433 435

            33. 2017 Towards understanding the effects of individual gamification elements on intrinsic motivation and performance Computers in Human Behavior 71 525 534

            34. 2013 October Do points, levels and leaderboards harm intrinsic motivation?: an empirical analysis of common gamification elements In Proceedings of the First International Conference on gameful design, research, and applications 66 73 ACM

            35. 2011 October Raising engagement in e-learning through gamification In Proc. 6th International Conference on Virtual Learning ICVL (Vol. 1). sn

            36. 2017 The maturing of gamification research Computers in Human Behavior 71 450 454

            37. 2013 July Gamification of education using computer games In International Conference on Human Interface and the Management of Information 99 107 Springer Berlin, Heidelberg

            38. 2015 A recipe for meaningful gamification In Gamification in education and business 1 20 Springer Cham

            39. 1994 April Enhancing the explanatory power of usability heuristics In Proceedings of the SIGCHI conference on Human Factors in Computing Systems 152 158 ACM

            40. 2018 A Practical Approach to Measuring User Engagement with the Refined User Engagement Scale (UES) and New UES Short Form. International Journal of Human-Computer Studies 112 28 39

            41. 2016 Areas of interest as a signal detection problem in behavioral eye‐tracking research. Journal of Behavioral Decision Making 29 2-3 103 115

            42. 2000 Toward computers that recognize and respond to user emotion. IBM systems journal 39 3.4 705 719

            43. 2006 Eye tracking in HCI and usability research. Encyclopedia of human computer interaction, 1 211 219

            44. 2009 E-education between Pedagogical and Didactic Theory and Practice. Organizacija 42 1

            45. 2014 October Beyond designing for motivation: the importance of context in gamification. In Proceedings of the first ACM SIGCHI annual symposium on Computer-human interaction in play 217 226 ACM

            46. 2015 Is it all a game? Understanding the principles of gamification Business Horizons 58 4 411 420

            47. 2015 The ludic drive as innovation driver: Introduction to the gamification of innovation Creativity and Innovation Management 24 2 300 306

            48. 2017 How gamification motivates: An experimental study of the effects of specific game design elements on psychological need satisfaction Computers in Human Behavior 69 371 380

            49. 2012 Encyclopedia of the sciences of learning. Germany: Springer

            50. 2006 How computer games help children learn. Macmillan

            51. 2006 Online learner’s ‘flow’experience: an empirical study. British Journal of Educational Technology 37 5 705 720

            52. 2013 A social gamification framework for a K-6 learning platform Computers in Human Behavior 29 2 345 353

            53. 2014 March A systematic mapping on gamification applied to education In Proceedings of the 29th Annual ACM Symposium on Applied Computing 216 222 ACM

            54. 2000 System dynamics and interactive learning environments: Lessons learned and implications for the future. Simulation & Gaming 31 4 528 535

            55. (Eds.) 2010 Sage handbook of mixed methods in social & behavioral research (pp 305-306). Sage

            56. 2018 A Theory of Gamification Principles Through Goal-Setting Theory. In Proceedings of the 51st Hawaii International Conference on System Sciences (HICSS

            57. 1999 Towards expert knowledge? A comparison between a constructivist and a traditional learning environment in the university. International journal of educational research 31 5 357 442

            58. 2011 September Game reward systems: Gaming experiences and social meanings In DiGRA Conference

            59. 2012 For the win: How game thinking can revolutionize your business. Wharton Digital Press

            60. 2012 Digital schools. Washington D.C.: Brookings Institution Press

            61. 2011 Research methods. Journal of Business & Economics Research (JBER) 5 3

            62. 2007 Towards an ontological language for game analysis. Worlds in Play: International Perspectives on Digital Games Research, 21, 21

            63. 2011 Gamification by design: Implementing game mechanics in web and mobile apps. O’Reilly Media, Inc


            Comment on this article