15 Usability Recommendations for Delivering Clinical Guidelines on Mobile Devices

Local point of care clinical guidelines exist in numerous formats and cover a variety of clinical information, normally created on a national and local level. They are generally available as basic web pages, PDFs or documents. Despite widespread availability and use, accessing clinical guidelines and information can be highly inefficient and restrictive. This reflective study investigates the evaluation of a clinical guidelines mobile application in the challenging area of co-design with clinicians. It aimed to answer if the selected methods of user centred design were suitable when working with limited access to users and what design recommendations can be elicited/changed by utilising user centred design (UCD) methods to gather feedback on features and functions. Specifically, this study utilised a mixed-method UCD approach and triangulation technique (Think-aloud and idea writing, screen recording and system usability scale). This culminated into the creation of 15 recommendations for developing clinical guidelines applications for mobile devices.

Content

Author and article information

Contributors

James Mitchell

Ed de Quincey

Charles Pantin

Naveed Mustfa

Conference

Publication date: July 2021

Publication date (Print): July 2021

Pages: 82-93

Affiliations

[0001]Keele University

Article

DOI: 10.14236/ewic/HCI2021.7

SO-VID: ce0c6521-03f5-4eff-a255-aa16c9aaf0ec

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: 34th British HCI Conference

Conference acronym: HCI2021

Conference number: 34

Conference location: London, UK

Conference date: 20th - 21st July 2021

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Post-pandemic HCI – Living Digitally

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2021.7

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

C. Abras, D. Maloney-Krichmar, J. Preece, 2004. User-Centered Design.
M. Austin, 1994. Needs Assessment By Focus Groups. American Society for Training and Development.
J. Brookes, 1996. SUS: a “quick and dirty’ usability Scale, Usability Evaluation In Industry. [Cross Ref]
Z. Burton, H. Edwards, 2019. A little less conversation, a little more high impact action. Futur Healthc J 6, 201–201. [Cross Ref]
F. Cossu, A. Marrella, M. Mecella, A. Russo, S. Kimani, G. Bertazzoni, A. Colabianchi, A. Corona, A.D. Luise, F. Grasso, M. Suppa, 2014. Supporting Doctors through Mobile Multimodal Interaction and Process-Aware Execution of Clinical Guidelines, in: 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications (SOCA). p. 183 190. [Cross Ref]
K. Davies, 2007. The information-seeking behaviour of doctors: a review of the evidence. Health Information & Libraries Journal 24, 78–94. [Cross Ref]
C. Free, G. Phillips, L. Watson, L. Galli, L. Felix, P. Edwards, V. Patel, A. Haines, 2013. The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis. Plos Med 10, e1001363. [Cross Ref]
R. Heale, D. Forbes, 2013. Understanding triangulation in research. .v id Based Nurs 16, 98. [Cross Ref]
A. Kwa, M. Carter, D. Page, T. Wilson, M. Brown, B. Baxendale, 2015. NOTTINGHAM UNIVERSITY HOSPITAL GUIDELINES APP–IMPROVING ACCESSIBLITY TO 650 HOSPITAL CLINICAL GUIDELINES. Proceedings of the International Conference on Ergonomics & Human Factors 2015 220.
A. Kwa, T. Wilson, M. Carter, D. Page, M. Brown, O. Bennett, G. Miles, B. Baxendale, 2014. 0162 Developing A Mobile App To Improve Access And Application Of Key Hospital Guidelines. Bmj Simul Technology Enhanc Learn 1, A25.2-A25. [Cross Ref]
A.C. Li, J.L. Kannry, A. Kushniruk, D. Chrimes, T.G. McGinn, D. Edonyabo, D.M. Mann, 2012. Integrating usability testing and think-aloud protocol analysis with “near-live” clinical simulations in evaluating clinical decision support. Int J Med Inform 81, 761–772. [Cross Ref]
P. Littlejohns, J.C. Wyatt, L. Garvican, 2003. Evaluating computerised health information systems: hard lessons still to be learnt. Bmj 326, 860 863. [Cross Ref]
J. Mitchell, E. de Quincey, C. Pantin, N. Mustfa, 2020. The Development of a Point of Care Clinical Guidelines Mobile Application Following a User-Centred Design Approach. Lecture Notes in Computer Science 294–313. [Cross Ref]
NICE, 2020. NICE [WWW Document]. NICE Clinical Guidelines. URL : https://www.nice.org.uk/guidance (accessed 9.2.20).
Nielsen, 1992. Evaluating the thinking aloud technique for use by computer scientists. Advances in Human-Computer Interaction Vol. 3 69–82.
H. Noble, R. Heale, 2019. Triangulation in research, with examples. Évid Based Nurs 22, 67. [Cross Ref]
D.A. Norman, 1986. User Centered System Design. [Cross Ref]
C. Pantin, J. Mucklow, D. Rogers, M. Cross, J. Wall, T.B.C.G. Partnership, 2006. Bedside clinical guidelines: the missing link. Clin Med 6, 98–104. [Cross Ref]
K.F. Payne, L. Weeks, P. Dunning, 2014. A mixed methods pilot study to investigate the impact of a hospital-specific iPhone application (iTreat) within a British junior doctor cohort. Health Inform J 20, 59 73. [Cross Ref]
K.F.B. Payne, H. Wharrad, K. Watts, 2012. Smartphone and medical related App use among medical students and junior doctors in the United Kingdom (UK): a regional survey. Bmc Med Inform Decis 12, 121. [Cross Ref]
O. Prescott, E. Millar, G. Nimmo, A. Wales, S. Edgar, 2017. 21st century medical education: critical decision-making guidance through smartphone/tablet applications—the Lothian pilot. Bmj Simul Technology Enhanc Learn 3, 60–64. [Cross Ref]
H. Takeshita, D. Davis, S.E. Straus, 2002. Clinical Evidence at the Point of Care in Acute Medicine: A Handheld Usability Case Study. Proc Hum Factors Ergonomics Soc Annu Meet 46, 1409–1413. [Cross Ref]
usability.gov, 2019. User Centred Design, US Government [WWW Document]. URL https://www.usability.gov/what-and-why/user-centered-design.html
A.B. VanGundy, 1984. BRAIN WRITING FOR NEW PRODUCT IDEAS: AN ALTERNATIVE TO BRAINSTORMING. J Consum Mark 1, 67–74. [Cross Ref]
J. Wagemans, J.H. Elder, M. Kubovy, S.E. Palmer, M.A. Peterson, M. Singh, R. von der Heydt, 2012. A Century of Gestalt Psychology in Visual Perception: I. Perceptual Grouping and Figure–Ground Organization. Psychol Bull 138, 1172–1217. [Cross Ref]

Comments

Comment on this article

[1] C. Abras, D. Maloney-Krichmar, J. Preece, 2004. User-Centered Design.

[2] M. Austin, 1994. Needs Assessment By Focus Groups. American Society for Training and Development.

[3] J. Brookes, 1996. SUS: a “quick and dirty’ usability Scale, Usability Evaluation In Industry. [Cross Ref]

[4] Z. Burton, H. Edwards, 2019. A little less conversation, a little more high impact action. Futur Healthc J 6, 201–201. [Cross Ref]

[5] F. Cossu, A. Marrella, M. Mecella, A. Russo, S. Kimani, G. Bertazzoni, A. Colabianchi, A. Corona, A.D. Luise, F. Grasso, M. Suppa, 2014. Supporting Doctors through Mobile Multimodal Interaction and Process-Aware Execution of Clinical Guidelines, in: 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications (SOCA). p. 183 190. [Cross Ref]

[6] K. Davies, 2007. The information-seeking behaviour of doctors: a review of the evidence. Health Information & Libraries Journal 24, 78–94. [Cross Ref]

[7] C. Free, G. Phillips, L. Watson, L. Galli, L. Felix, P. Edwards, V. Patel, A. Haines, 2013. The Effectiveness of Mobile-Health Technologies to Improve Health Care Service Delivery Processes: A Systematic Review and Meta-Analysis. Plos Med 10, e1001363. [Cross Ref]

[8] R. Heale, D. Forbes, 2013. Understanding triangulation in research. .v id Based Nurs 16, 98. [Cross Ref]

[9] A. Kwa, M. Carter, D. Page, T. Wilson, M. Brown, B. Baxendale, 2015. NOTTINGHAM UNIVERSITY HOSPITAL GUIDELINES APP–IMPROVING ACCESSIBLITY TO 650 HOSPITAL CLINICAL GUIDELINES. Proceedings of the International Conference on Ergonomics & Human Factors 2015 220.

[10] A. Kwa, T. Wilson, M. Carter, D. Page, M. Brown, O. Bennett, G. Miles, B. Baxendale, 2014. 0162 Developing A Mobile App To Improve Access And Application Of Key Hospital Guidelines. Bmj Simul Technology Enhanc Learn 1, A25.2-A25. [Cross Ref]

[11] A.C. Li, J.L. Kannry, A. Kushniruk, D. Chrimes, T.G. McGinn, D. Edonyabo, D.M. Mann, 2012. Integrating usability testing and think-aloud protocol analysis with “near-live” clinical simulations in evaluating clinical decision support. Int J Med Inform 81, 761–772. [Cross Ref]

[12] P. Littlejohns, J.C. Wyatt, L. Garvican, 2003. Evaluating computerised health information systems: hard lessons still to be learnt. Bmj 326, 860 863. [Cross Ref]

[13] J. Mitchell, E. de Quincey, C. Pantin, N. Mustfa, 2020. The Development of a Point of Care Clinical Guidelines Mobile Application Following a User-Centred Design Approach. Lecture Notes in Computer Science 294–313. [Cross Ref]

[14] NICE, 2020. NICE [WWW Document]. NICE Clinical Guidelines. URL : https://www.nice.org.uk/guidance (accessed 9.2.20).

[15] Nielsen, 1992. Evaluating the thinking aloud technique for use by computer scientists. Advances in Human-Computer Interaction Vol. 3 69–82.

[16] H. Noble, R. Heale, 2019. Triangulation in research, with examples. Évid Based Nurs 22, 67. [Cross Ref]

[17] D.A. Norman, 1986. User Centered System Design. [Cross Ref]

[18] C. Pantin, J. Mucklow, D. Rogers, M. Cross, J. Wall, T.B.C.G. Partnership, 2006. Bedside clinical guidelines: the missing link. Clin Med 6, 98–104. [Cross Ref]

[19] K.F. Payne, L. Weeks, P. Dunning, 2014. A mixed methods pilot study to investigate the impact of a hospital-specific iPhone application (iTreat) within a British junior doctor cohort. Health Inform J 20, 59 73. [Cross Ref]

[20] K.F.B. Payne, H. Wharrad, K. Watts, 2012. Smartphone and medical related App use among medical students and junior doctors in the United Kingdom (UK): a regional survey. Bmc Med Inform Decis 12, 121. [Cross Ref]

[21] O. Prescott, E. Millar, G. Nimmo, A. Wales, S. Edgar, 2017. 21st century medical education: critical decision-making guidance through smartphone/tablet applications—the Lothian pilot. Bmj Simul Technology Enhanc Learn 3, 60–64. [Cross Ref]

[22] H. Takeshita, D. Davis, S.E. Straus, 2002. Clinical Evidence at the Point of Care in Acute Medicine: A Handheld Usability Case Study. Proc Hum Factors Ergonomics Soc Annu Meet 46, 1409–1413. [Cross Ref]

[23] usability.gov, 2019. User Centred Design, US Government [WWW Document]. URL https://www.usability.gov/what-and-why/user-centered-design.html

[24] A.B. VanGundy, 1984. BRAIN WRITING FOR NEW PRODUCT IDEAS: AN ALTERNATIVE TO BRAINSTORMING. J Consum Mark 1, 67–74. [Cross Ref]

[25] J. Wagemans, J.H. Elder, M. Kubovy, S.E. Palmer, M.A. Peterson, M. Singh, R. von der Heydt, 2012. A Century of Gestalt Psychology in Visual Perception: I. Perceptual Grouping and Figure–Ground Organization. Psychol Bull 138, 1172–1217. [Cross Ref]

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65