For Publishers
DiscoveryMetadataPeer reviewHostingPublishing
For Researchers
JoinPublishReviewCollect
Register
Blog
About
Search
Advanced search
My ScienceOpen
Search
For Publishers
For Researchers
Blog
About
7,019
views
63
references
 Top references
cited by
2
    
0 reviews
 Review
0
comments
 Comment
0
recommends
+1 Recommend
1 collections
    4
    shares
      376
      similar
       All similar

      Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65

      scite_
       
      • Record: found
      • Abstract: found
      • Conference Proceedings: found
      Is Open Access

      The Usability of E-learning Platforms in Higher Education: A Systematic Mapping Study

      proceedings-article
      Author(s): 1 , 1
      Publication date (Print):
      Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference (HCI)
      Conference theme: Human Computer Interaction Conference
      Conference date: 4 - 6 July 2018
      Keywords: Usability, E-learning, Virtual Learning Environment, Higher Education, Systematic Mapping Study
      Bookmark

            Abstract

            The use of e-learning in higher education has increased significantly in recent years, which has led to several studies being conducted to investigate the usability of the platforms that support it. A variety of different usability evaluation methods and attributes have been used, and it has therefore become important to start reviewing this work in a systematic way to determine how the field has developed in the last 15 years. This paper describes a systematic mapping study that performed searches on five electronic libraries to identify usability issues and methods that have been used to evaluate e-learning platforms. Sixty-one papers were selected and analysed, with the majority of studies using a simple research design reliant on questionnaires. The usability attributes measured were mostly related to effectiveness, satisfaction, efficiency, and perceived ease of use. Furthermore, several research gaps have been identified and recommendations have been made for further work in the area of the usability of online learning.

            Content

            Author and article information

            Contributors
            Khaled Abuhlfaia
            Ed de Quincey
            Conference
            Publication date: July 2018
            Publication date (Print): July 2018
            Pages: 1-13
            Affiliations
            [0001]Keele University School of Computing and Mathematics Staffordshire, UK, ST5 5BG
            Article
            DOI: 10.14236/ewic/HCI2018.7
            SO-VID: c13818aa-430c-4f13-ac09-63ae438433a1
            Copyright © © Abuhlfaia et al. Published by BCS Learning and Development Ltd. Proceedings of British HCI 2018. Belfast, UK.
            License:

            This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

            Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference
            Conference acronym: HCI
            Conference number: 32
            Conference location: Belfast, UK
            Conference date: 4 - 6 July 2018
            Conference sponsor: Electronic Workshops in Computing (eWiC)
            Conference theme: Human Computer Interaction Conference
            History
            Product

            1477-9358 BCS Learning & Development

            Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.7
            Self URI (journal page): https://ewic.bcs.org/
            Categories
            Series title: Electronic Workshops in Computing

            ScienceOpen disciplines: Applied computer science,Computer science,Security & Cryptology,Graphics & Multimedia design,General computer science,Human-computer-interaction
            Keywords: Usability,Higher Education,E-learning,Systematic Mapping Study,Virtual Learning Environment

            REFERENCES

            1. 2006 Usability in e-learning Online: http://www.epic.co.uk/content/resources/white_papers/pdf_versions/Development/Epic_White_Paper_Us ability.pdf (accessed 19.09.08)

            2. 2007 The relationship between national culture and the usability of an e-learning system International Journal on ELearning 6 1 119 146 (Ref P39)

            3. 2012 A Hybrid approach for selecting a course management system: A case study Journal of Information Technology Education: Innovations in Practice 11 283 300

            4. 2008 Why moodle. In Future Trends of Distributed Computing Systems, 2008 FTDCS’08. 12th IEEE International Workshop on 58 64 IEEE

            5. 2010 Three different modes of avatars as virtual lecturers in e-learning interfaces: a comparative usability study The Open Virtual Reality Journal, Bentham Open, ISSN: 1875-323X 2 1 8 17 (Ref P45)

            6. 2011 The role of earcons and auditory icons in the usability of avatar-based e-learning interfaces In Developments in E-systems Engineering (DeSE) 2011 276 281 IEEE (Ref P41)

            7. 2014 A Comparative Usability Study on the Use of Auditory Icons to Support Virtual Lecturers in E-Learning Interfaces Journal of Advanced Computer Science & Applications 5 4 (Ref P3)

            8. 2015 Design and usability evaluation of adaptive e-learning systems based on learner knowledge and learning style In Human-Computer Interaction 584 591 Springer, Cham (Ref P12)

            9. 2016 May Usability and effectiveness evaluation of adaptivity in e-learning systems In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems 2984 2991 ACM (Ref P48)

            10. 2006 An approach to usability evaluation of e-learning applications Universal access in the information society 4 3 270 283 (Ref P6)

            11. 2004 May Usability of e-learning tools In Proceedings of the working conference on Advanced visual interfaces 80 84 ACM (Ref 55)

            12. 2013 E‐learning: the essential usability perspective The clinical teacher 10 1 47 50 (Ref P16)

            13. 2010 A Peek at the Position of Pedagogical Aspects in Usability Evaluation of E-learning System-A Literature Review of Usability Evaluation of E-learning System conducted since 2000 (Bachelor’s thesis)

            14. 2004 Usability and user-centred design, a necessity for efficient e-learning International Journal of The Computer, the Internet and Management 12 2 20 25 (Ref P51)

            15. 2004 Usability evaluation of distributed groupware in distance learning In Information Technology Based Higher Education and Training, 2004. ITHET 2004. Proceedings of the FIfth International Conference on 500 504 IEEE (Ref P52)

            16. 2007 Lessons from applying the systematic literature review process within the software engineering domain Journal of Systems and Software 80 4 571 583

            17. 2010 Evaluation of Web 2.0 tools in the e-learning context: Case studies related to pedagogy and usability In University Information Systems-Selected Problems. Difin SA. (Ref P25)

            18. 2012 Development of usability criteria for e-learning content development software Turkish Online Journal of Distance Education 13 2 336 345 (Ref P14)

            19. 2015 Towards Adapting Sakai for e-Learning Provider In CSEDU 1 306 314

            20. 2005 Usability, quality, value and e-learning continuance decisions Computers & education 45 4 399 416 (Ref P57)

            21. 2016 Lear ’ E U b y D Features of Chinese as a Foreign Language E-Learning Websites International Journal of Learning and Teaching 2 1 91 98 (Ref P31)

            22. 2016 Developing and Implementing a LGBT Family Studies Course: A Pre-Post Evaluation

            23. 2005 On the usability evaluation of e-learning applications In System Sciences, 2005. HICSS’05. Proceedings of the 38th Annual Hawaii International Conference on 6b 6b IEEE

            24. 2008 Assessing the usability of a visual tool for the definition of e-learning processes Journal of Visual Languages & Computing 19 6 721 737 (Ref P11)

            25. 2015 Usability study of the EduMod eLearning Program for contouring nodal stations of the head and neck Practical radiation oncology 5 3 169 175 (Ref P56)

            26. 2011 The virtual anatomy laboratory: Usability testing to improve an online learning resource for anatomy education Anatomical sciences education 4 6 318 326 (Ref P44)

            27. 2014 Exploring faculty adoption and utilization of Blackboard at a community college in the Kentucky Community and Technical College System Doctoral dissertation, University of Kentucky, USA

            28. 2016 Perceived ease of use and perceived usefulness of social media for e-learning in Libyan higher education: a structural equation modeling analysis International Journal of Information and Education Technology 6 3 192 (Ref P34)

            29. Evaluating usability of e-learning systems in universities International Journal of Advanced Computer Science and Applications 5 8 97 102 (Ref P22)

            30. 2011 Usability evaluation methods for the web: A systematic mapping study Information and Software Technology 53 8 789 817

            31. 2012 A literature review about usability evaluation methods for e-learning platforms Work, 41(Supplement 1) 1038 1044

            32. 2012 Web-based education in Spanish Universities A Comparison of Open Source E-Learning Platforms. Journal of Systemics, Cybernetics and Informatics 10 6 47 53

            33. 2007 User Centered Desing in E-Learning Environments: from Usability to Learner Experience In Proceedings of the EDEN 2007 Annual Conference June 13-16 Naples Italy (Ref P59)

            34. 2016 Exploring user satisfaction for e-learning systems via usage-based metrics and system usability scale analysis Computers in Human Behavior 61 463 471 (Ref P26)

            35. 2007 June Evaluation of usability and assessment capabilities of an e-Learning System for Nursing Radiation Protection In Computer-Based Medical Systems, 2007. CBMS’07. Twentieth IEEE International Symposium on 301 306 IEEE (Ref P24)

            36. 2012 Service Quality and Ease-of-Use of a Learning Management System Portal: Perceptions of Distance Learners Age 25 49 10 9 (Ref P36)

            37. International Standards Organization 1998 ISO 9241 – 11, Ergonomics of human system interaction

            38. 2015 Virtual learning environment International Journal in IT & Engineering 3 5 75 84

            39. 2007 USERS’CURRENT VIEWS ABOUT APPLIED E-LEARNING COURSEWARE USABILITY: A CASE STUDY AT UNIVERSITI SAINS MALAYSI A In: 1st International Malaysian Educational Technology Convention 2007 (Ref P61)

            40. 2011 Knowledge mobilization through e-learning systems: Understanding the mediating roles of self-efficacy and anxiety on perceptions of ease of use Information Systems Management 28 1 71 83 (Ref P30)

            41. 2009 Assessing effectiveness of the cognitive abilities and individual differences on e-learning portal usability evaluation Procedia-Social and Behavioral Sciences 1 1 368 380 (Ref P9)

            42. 2014

            43. 2007 Guidelines for performing systematic literature reviews in software engineering Keele University and Durham University Joint Report

            44. 2015 Evidence-based software engineering and systematic reviews 4 CRC Press

            45. 2003 Effect of prior experience with the Internet on graduate ’ w w b y and web-based distance learning instruction: An exploratory study in a hybrid instruction environment Issues in Information Systems 4 2 535 542 (Ref P18)

            46. 2015 Predictors of success in e-Learning courseware usability design Issues in Information Systems 16 2 116 122 (Ref P35)

            47. 2011 Usability inspection through heuristic evaluation in e-Learning environments: The LAMS case In VII International Conference on ICT in Education, Challenges 617 630 (Ref P53)

            48. 2011 April A comparative study of moodle with other e-learning systems. In Electronics Computer Technology (ICECT) 2011 3rd International Conference on 5 414 418 IEEE

            49. 2011 e-Learning continuance intention: Moderating effects of user e-learning experience Computers & Education 56 2 515 526 (Ref P15)

            50. 2012 A case study of using eye tracking techniques to evaluate the usability of e-learning courses International Journal of Learning Technology 7 2 154 171 (Ref P1)

            51. 2010 Comparison of blackboard 9.1 and moodle 2.0 Learning Technologies Unit, Institute of Education, University of London, London, UK

            52. 2012 Learning style as a factor which affects the quality of e-learning Artificial Intelligence Review 38 4 303 312

            53. 2015 The Usability and its Influence of an e-Learning System on Student Participation Procedia-Social and Behavioral Sciences 197 2325 2330 (Ref P43)

            54. 2008 Development of an e-learning system for occupational medicine: Usability issues Studies in health technology and informatics 136 579 (Ref P13)

            55. 2006 June Effects of computer competency on usability and learning experience in online learning environments In Software Engineering, Artificial Intelligence, Networking, and Parallel/Distributed Computing, 2006. SNPD 2006. Seventh ACIS International Conference on 339 342 IEEE (Ref P19)

            56. Moodle.org “Moodle Statistic” 18 [Online]. Available: http://moodle.net/stats/. [Accessed 14 30 2018]

            57. 2011 A weighted usability measure for e-learning systems J Am Sci 7 2 670 686 (Ref P 5)

            58. 2017 Usability and User Experience Evaluation of Learning Management Systems- A Systematic Mapping Study In Proceedings of the 19th International Conference on Enterprise Information Systems (ICEIS 2017) 3 97 108

            59. NielsenJacob 1993 Usability engineering Cambridge, MA Academic Press

            60. 2009 An E valuation of the Usability and Interactivity of e-Learning Platforms Used In Kenyan Universities In: E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education. Association for the Advancement of Computing in Education (AACE) 1016 1025 (Ref P7)

            61. 2013 A machine learning-based usability evaluation method for eLearning systems Decision Support Systems 56 63 73 (Ref P4)

            62. 2010 UseLearn: A novel checklist and usability evaluation method for eLearning systems by criticality metric analysis International Journal of Industrial Ergonomics 40 4 455 469 (Ref P58)

            63. 2010 A comparison of usability evaluation methods for e-learning systems DAAAM International Scientific Book 271 288

            64. 2009 Evaluating the Perceived Usability of Virtual Learning Environment in Teaching ICT Courses Globalilluminators. Org 1 63 76

            65. 2008 November Usability and acceptance of e-learning in statistics education, based on the compendium platform In Proceedings of the International Conference of Education, Research and Innovation 1 10 (Ref P47)

            66. 2015 Evaluation of the e-Learning developed for casemix and clinical coding: Quality of the material and usability of the system (Ref P23)

            67. 2014 Success factors for e-learning in a developing country: A case study of Serbia The International Review of Research in Open and Distributed Learning 15 3 1 23

            68. 2002 Usability and Instructional Design Heuristics for E Learning Evaluation In Proc. of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2002 1 1615 1621 (Ref P49)

            69. 2008 Lifelong learning and e-learning 2.0: The contribution of usability studies Journal of e-Learning and Knowledge Society 4 1 221 229 (Ref P32)

            70. 2007 A Gentle guide to research methods Open University Press England

            71. Sakaiproject.org 2018 Overview |Sakai [online] at: http://sakaiproject.org/overview (accessed 04-03-18)

            72. 2009 USABILITY OF E-LEARNING PORTAL AND HOW IT AFFECTS STUDENTS’ATTITUDE AND SATISFACTION, AN EXPLORATORY STUD Y PACIS 2009 Proceedings 71 (Ref P54)

            73. 2014 September In-progress: User experience evaluation of Student Centered E-Learning Environment for computer science program In User Science and Engineering (i-USEr), 2014 3rd International Conference on 52 55 IEEE (Ref P60)

            74. 2016 August Usability testing of e-learning system: A case study on CeL in TARUC, Johor Branch Campus In User Science and Engineering (i-USEr), 2016 4th International Conference on 63 68 IEEE (Ref P10)

            75. 2008 eLearning: Usability and Learnability of an ESP Online Course In Proceedings of the 7th Wseas International Conference on E-Activities-Recent Advances in E-Activities 74 79 (Ref P20)

            76. 2016 Impact of technology quality, perceived ease of use and perceived usefulness in the formation of m ’ x -learning Abasyn J. Soc. Sci 9 1 124 140 (Ref P27)

            77. 2007a Usability and learning: A framework for evaluation of web-based e-learning applications In EdMedia: World Conference on Educational Media and Technology 906 913 Association for the Advancement of Computing in Education (AACE) (Ref P50)

            78. 2007b A comparative study of two usability evaluation methods using a web-based e-learning application In Proceedings of the 2007 annual research conference of the South African institute of computer scientists and information technologists on IT research in developing countries 132 142 ACM (Ref P2)

            79. 2009 December Implementing Usability Attributes In E-learning System Using Hybrid Heuristics In Information and Multimedia Technology, 2009. ICIMT’09. International Conference on 189 193 IEEE (Ref P28)

            80. 2008 Kansei Engineering Assessing System to enhance the usability in e-learning web interfaces: Colour basis In 16th International Conference on Computers in Education 1 1 145 150 (Ref P29)

            81. 2012 Evaluating usability and efficaciousness of an e-learning system: A quantitative, model-driven approach In Advanced Learning Technologies (ICALT), 2012 IEEE 12th International Conference on 303 307 IEEE (Ref P21)

            82. 2014 Students’ Assessment on the Usability of E-leaming Websites Procedia-Social and Behavioral Sciences 141 916 922 (Ref P37)

            83. 2015 The Usability Analysis of An E-Learning Environment Turkish Online Journal of Distance Education (Ref P42)

            84. 2013 October Ease of use and usefulness of webinars in an open distance learning environment: an activity theory perspective In Proceedings of the South African Institute for Computer Scientists and Information Technologists Conference 262 270 ACM (Ref P17)

            85. 2016 The anatomy of E‐Learning tools: Does software usability influence learning outcomes? Anatomical sciences education 9 4 378 390 (Ref P38)

            86. 2015 Engaging students in Group based Learning through e-learning techniques in Higher Education System International Journal of Emerging Trends in Science and Technology 2 01 1741 1746

            87. 2010 October Triangulating methods for exploring the link between user experience and e-learning In Proceedings of the 14th International Academic MindTrek Conference: Envisioning Future Media Environments 171 177 ACM (Ref P46)

            88. 2012 An Investigation on the Relationship between Online Distance Learning with Learning Usability Procedia-Social and Behavioral Sciences 65 1066 1070 (Ref P8)

            89. 2010 December Online distance learning: Quality characteristics and usability evaluation In Science and Social Research (CSSR), 2010 International Conference on 575 579 IEEE (Ref P33)

            90. 2010 January The role of cognitive styles in investigating E-learning usability In e-Education, e-Business, e-Management, and e-Learning, 2010. IC4E’10. International Conference on 3 6 IEEE (Ref P40)

            Comments

            Comment on this article