+1 Recommend
1 collections
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      A Method Impact Assessment Framework for User Experience Evaluations with Children


      , ,

      Proceedings of the 31st International BCS Human Computer Interaction Conference (HCI 2017) (HCI)

      digital make-believe, with delegates considering our expansive

      3 - 6 July 2017

      Child Computer Interaction, Evaluation Methods, User Experience



            Based upon a review of the literature, this paper presents a Method Impact Assessment Framework. Theoretically synthesized, the framework offers five dimensions: (1) the role of the child, (2) the user experience construct, (3) system, (4) epistemological perspective, (5) Practical and Ethical Concerns. Although other dimensions could have been construed, these were judged to be the most pertinent to understanding evaluation methods with children. The framework thus provides a critical lens in which evaluation methods can be assessed by the Children Computer Interaction (CCI) Community to inform method selection.


            Author and article information

            July 2017
            July 2017
            : 1-9
            [0001]University of Central Lancashire

            Preston, UK.
            [0002]KU Leuven

            Leuven, Belgium.
            © Sim et al. Published by BCS Learning and Development Ltd. Proceedings of British HCI 2017 – Digital Make-Believe. Sunderland, UK.

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            Proceedings of the 31st International BCS Human Computer Interaction Conference (HCI 2017)
            Sunderland, UK
            3 - 6 July 2017
            Electronic Workshops in Computing (eWiC)
            digital make-believe, with delegates considering our expansive
            Product Information: 1477-9358BCS Learning & Development
            Self URI (journal page): https://ewic.bcs.org/
            Electronic Workshops in Computing


            1. 2014 Empowering Teenagers to Perform a Heuristic Evaluation of a Game 28th British HCI Conference. Southport, UK BCS

            2. 2014 ‘Draw, write and tell’: A literature review and methodological development on the ‘draw and write’research method Journal of Early Childhood Research 1476718X14538592

            3. 2008 Child-based personas: need, ability and experience Cognition, Technology & Work 10 155 166

            4. 2011 Springboard: Designing image schema based embodied interaction for an abstract domain Whole Body Interaction Springer

            5. 2013 Critical and Cultural Approaches to HCI The SAGE Handbook of Digital Technology Research 130

            6. Interaction criticism: a proposal and framework for a new discipline of hci CHI'08 Extended Abstracts on Human Factors in Computing Systems 2008 ACM 2463 2472

            7. 2008 Development and evaluation of the problem identification picture cards method Cognition, Technology and Work 10 95 105

            8. 2006 Identifying usability and fun problems in a computer game during first use and some practice International Journal Human Computer Interaction 64 830 846

            9. 2011 Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Vancouver, BC, Canada ACM

            10. 2006 Assessing the applicability of the structured expert evaluation method (SEEM) for a wider age group Interaction Design and Children Tampere ACM

            11. 2007 Designing and testing questionnaires for children Journal of Research in Nursing 12 461 469

            12. 2011 Ethical Guidelines for Educational Research 22/07/15

            13. 2008 Play in focus

            14. 2010 Adults' perception of children's height and reaching capability Acta psychologica 135 24 29

            15. A Systematic Review of Cybersickness. Proceedings of the 2014 Conference on Interactive Entertainment 2014 ACM 1 9

            16. 2007 Framework of Product Experience International Journal of Design 1 57 66

            17. 1999 The design of children's technology Morgan Kaufmann Publishers San Francisco

            18. 2008 The product ecology: Understanding social product use and supporting design culture International Journal of design 2 11 20

            19. 2004 Understanding experience in interactive systems Proceedings of the 5th conference on Designing interactive systems: processes, practices, methods, and techniques. Cambridge, MA, USA ACM

            20. 2008 Methodological Immaturity in Childhood Research? Thinking through 'participatory methods’ Childhood 15 499 516

            21. 2007 Creative explorations: New approaches to identities and audiences Routledge

            22. 2011 Creative Explorations: New Approaches to Identities and Audiences. London Routledge

            23. 1979 The Ecological Approach to visual Perception Boston Houghton Miffflin

            24. 1997 Guidelines for usability testing with children Interactions 4 9 14

            25. 1992 Children's participation: From tokenism to citizenship UNICEF Innocenti Research Centre

            26. 2003 Criteria for Evaluating Usability Evaluation Methods International Journal Human Computer Interaction 15 145 181

            27. 2005 The thing and I: understanding the relationship between user and product Funology. Springer

            28. 2010 Needs, affects, and interactive products - facets of user experience Interacting with Computers 22 353 362

            29. 2010 Handbook of Emergent Methods New York Guilford Press

            30. 2006 Children's Voices on Ways of Having a Voice Children's and young people's perspectives on methods used in reserach and consultation Childhood 13 69 89

            31. 1997 Three Important Research Agendas for Educational Multimedia: Learning, Children and Gender Educationi MultiMedia 97 Calgary

            32. Iso 2010 Ergonomics of human system interaction - Prt 210: Human-centred design for interactive system Switserland International Standards Organisation

            33. 1999 Well-being: Foundations of hedonic psychology Russell Sage Foundation

            34. 2004 "Just Teach us the Skills Please, We'll Do the Rest": Empowering Ten-Year-Olds as Researchers Children and Society 18 329 343

            35. 2011 UX Curve: A method for evaluating long-term user experience Interacting with Computers 23 473 483

            36. 2001 Promoting children's participation in democratic decision-making UNICEF Innocenti Research Centre

            37. 2009 Understanding, scoping and defining user experience: a survey approach Proceedings of the SIGCHI Conference on Human Factors in Computing Systems Boston, MA, USA ACM

            38. 2008 Towards a Shared Definition of User Experience CHI 2008. Florence ACM Press

            39. 2002 Child witnesses and the oath In: Children's testimony: A handbook of psychological research and forensic practice Chichester Wiley

            40. 1984 Heuristics for designing enjoyable user interfaces : Lessons from computer games Norwood, N .J Ablex

            41. 2003 On assessment of usability testing methods for children Interacting with Computers 15 227 243

            42. 2011 PLU-E: a proposed framework for planning and conducting evaluation studies with children Proceedings of the 25th BCS Conference on Human-Computer Interaction Newcastle-upon-Tyne, United Kingdom British Computer Society

            43. 2006 Involving Young Service Usres as Co-Reserachers: Possibilities, Benefits and Costs British Journal of Social Work 36 1395 1410

            44. 2015 A Formal Analysis of the ISO 9241-210 Definition of User Experience Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems Seoul, Republic of Korea ACM

            45. 1996 The ethics of social research with children: An overview Children & Society 10 90 105

            46. 2000 Youth research on video selfproductions reflections on a social- aesthetic approach Visual Studies 15 135 153

            47. 2004 Emotional design: Why we love (or hate) everyday things Basic books

            48. 2015 A value sensitive design approach to parental software for young children Proceedings of the 14th International Conference on Interaction Design and Children. Boston, Massachusetts ACM

            49. 2014 A framework for user experience, needs and affordances Design Studies 35 160 179

            50. 2002 RESEARCH WITH CHILDREN The same or different from research with adults? Childhood 9 321 341

            51. 2012 Evaluating artefacts with children: age and technology effects in the reporting of expected and experienced fun 14th ACM International Conference on Multimodal Interaction Santa Monica ACM

            52. 2013 CHECk: a tool to inform and encourage ethical practice in participatory design with children CHI '13 Extended Abstracts on Human Factors in Computing Systems Paris, France ACM

            53. 2006 Using the Fun Toolkit and Other Survey Methods to Gather Opinions in Child Computer Interaction Interaction Design and Children Tampere ACM Press

            54. Engagement and Expectations: Measuring Children's Fun Interaction Design and Children, 2002 Eindhoven, The Netherlands Shaker Publishing 189 198

            55. 2003 Core Affect and the Psychological Construction of Emotion Psychological Review 110 145 172

            56. 2010 A framework to measure user experience of interactive online products Proceedings of the 7th International Conference on Methods and Techniques in Behavioral Research Eindhoven, The Netherlands ACM

            57. 2012 Investigating children's opinions of games: Fun Toolkit vs This or That Interaction Design and Children Bremen, Germany ACM

            58. 2005 Evaluating usability, fun and learning in educational software for children World Conference on Educational Multimedia, Hypermedia and Telecommunications Montreal AACE

            59. 1989 UN Convention on the Rights of the child [Online] Available: http://www.unicef.org/crc/ 02/07/15 2015

            60. 2013 MemoLine: evaluating long-term UX with children Proceedings of the 12th International Conference on Interaction Design and Children New York, New York ACM

            61. 2005 Exploring Meaning in Interviews with Children In: Reseraching Children's Experience London Sage

            62. 2004 Technology as experience MIT Press

            63. 2013 Children’s participation and intergenerational dialogue: Bringing adults back into the analysis Childhood 20 429 442

            64. Introduction and validation of a pairwise comparison scale for UX evaluations and benchmarking with preschoolers Interact 2009 Uppsala Springer 634 637

            65. 2010 Laddering with Young Children in User Experence Evaluations: Theoretical Groundings and a Practical Case IDC Barcelona ACM

            66. 2013 Measuring product liking in preschool children: An evaluation of the Smileyometer and This or That methods International Journal of ChildComputer interaction 1 61 70


            Comment on this article