Evaluation of a European Data Analytic Framework

The multi-national MIDAS (Meaningful Integration of Data Analytics and Services) project is developing a big data platform to facilitate the utilisation of a wide range of health and social care data. The platform will enable the integration of heterogeneous data sources, providing privacy-preserving analytics, forecasting tools and bespoke visualisations of actionable epidemiological data. An evaluation framework starting with a logic model and using the principles of realist evaluation developed working with users, and software developers. The tools used are a series of parallel case studies to address the requirements of stakeholder groups at critical time points during the project to ensure IT systems development is in line with user’s requirements. The process includes longitudinal interviews with stakeholders, regular feedback to users and developers, and measurement of stakeholder’s attitudes to the project using Q-methodology.

Content

Author and article information

Contributors

Andrew Boilson

Dale Weston

Regina Connolly

Conference

Publication date: July 2018

Publication date (Print): July 2018

Pages: 1-5

Affiliations

[0001]Dublin City University

School of Nursing & Human Sciences

Glasnevin, Dublin 9

[0002]Emergency Response Department Science & Technology

Public Health England

Porton Down, Salisbury, SP4 0JG

[0003]Dublin City University

Business School

Glasnevin, Dublin 9

Article

DOI: 10.14236/ewic/HCI2018.140

SO-VID: d1b0df9a-dff3-41b1-bcf5-f6ba9171f4e2

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: Proceedings of the 32nd International BCS Human Computer Interaction Conference

Conference acronym: HCI

Conference number: 32

Conference location: Belfast, UK

Conference date: 4 - 6 July 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: Human Computer Interaction Conference

History

Product

1477-9358 BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/HCI2018.140

Self URI (journal page): https://ewic.bcs.org/

References

E. AmmenwerthS. GräberG. HerrmannT. BürkleJ. König 2003 Evaluation of health information systems—problems and challenges International Journal of Medical Informatics 71 2 125 135
F. P. Brooks Jr 1995 The Mythical Man-Month Anniversary Boston, MA, USA Addison-Wesley Longman Publishing Co., Inc
C. Chen 2010 Information visualization Wiley Interdisciplinary Reviews: Computational Statistics 2 4 387 403
S. B. D. DakhliM. B. Chouikha 2009 The knowledge-gap reduction in software engineering Research Challenges in Information Science 2009 RCIS 2009 Third International Conference on. IEEE 287 294
K. FonkychR. Taylor 2005 The state and pattern of health information technology adoption Santa Monica, California, USA Rand Corporation
C. P. FriedmanJ. Wyatt 2005 Evaluation methods in biomedical informatics. New York Springer Science & Business Media
Hennington AHJanz BD 2007 InformationSystems and Healthcare: Physicianadoption of electronic medical records: Applying the UTAUT model in a healthcare context Communications of the Association for Information Systems 19 60 80
P. V. IlavarasanA. K. Sharma 2003 Is software work routinized? Some empirical observations from Indian software industry Journal of Systems and Software 66 1 1 6
B. KaplanN. T. Shaw 2002 People, Organizational, and Social Issues: Evaluation as an exemplar R. HauxC. Kulikowski IMIA Yearbook 91 102
Foundation Kellogg 2004 Logic model development guide Michigan WK Kellogg Foundation 71
B. Marchalvan S. BelleJ. van OlmenT. HoeréeG. Kegels 2012 Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research Evaluation 18 2 192 212
T. B. MurdochA. S. Detsky 2013 The inevitable application of big data to health care Jama 309 13 1351 1352
R. PawsonN. Tilley 1997 Realistic evaluation London; Thousand Oaks, Calif Sage
B. RahimiV. Vimarlund 2007 Methods to evaluate health information systems in healthcare settings: a literature review Journal of Medical Systems 31 5 397 432
D; RankinM BlackJ WallaceM MulvennaR BondB Cleland 2017 The MIDAS Platform: Facilitating the Utilisation of Healthcare Big Data in Northern Ireland and Beyond 8th Annual Translational Medicine Conference, City Hotel, Derry/Londonderry, Northern Ireland. Clinical Translational Research and Innovation Centre (C-TRIC)
V. F. Reyna 2008 Theories of medical decision-making and health: an evidence-based approach Medical Decision Making 28 6 829 833
J. RitchieJ. Lewis 2003 Qualitative research practice: a guide for social science students and researchers London Sage
M. Rigby 2006 Evaluation–the Cinderella science of ICT in health IMIA Yearbook 114 120
J. StudnickiD. J. BerndtJ. W. Fisher 2008 Using information systems for public health administration. G. Benjamin Public Health Administration: Principles for Population-Based Management 2nd Sudbury, MA Jones and Bartlett 353 380
B. TilahunT. KauppinenC. KeßlerF. Fritz 2014 Design and Development of a Linked Open Databased Health Information Representation and Visualization System: Potentials and Preliminary Evaluation JMIR Medical Informatics 2 2
C. Toffolon 2000 The software dimensions’ theory. J. Filipe Enterprise Information Systems Springer 89 98
V Venkatesh 2016 Unified Theory of Technology Acceptance and Use of Technology - A Synthesis and the Road Ahead Journal of the Association for Information Systems 17 5 328 376
P.-Y. YenA. S. McAlearneyC. J. SieckJ. L. HefnerT. R. Huerta 2017 Health Information Technology (HIT) Adaptation: Refocusing on the Journey to Successful HIT Implementation JMIR Medical Informatics 5 3 e28
M. M. YusofA. PapazafeiropoulouR. J. PaulL. K. Stergioulas 2008 Investigating evaluation frameworks for health information systems International Journal of Medical Informatics 77 6 377 385
M. ZakkarK. Sedig 2017 Interactive visualization of public health indicators to support policymaking: An exploratory study Online Journal of Public Health Informatics 9 2 e190
C. ZiemkiewiczA. OttleyR. J. CrouserK. ChaunceyS. L. SuR. Chang 2012 Understanding visualization by understanding individual users IEEE Computer Graphics and Applications 32 6 88 94

Comments

Comment on this article

[1] E. AmmenwerthS. GräberG. HerrmannT. BürkleJ. König 2003 Evaluation of health information systems—problems and challenges International Journal of Medical Informatics 71 2 125 135

[2] F. P. Brooks Jr 1995 The Mythical Man-Month Anniversary Boston, MA, USA Addison-Wesley Longman Publishing Co., Inc

[3] C. Chen 2010 Information visualization Wiley Interdisciplinary Reviews: Computational Statistics 2 4 387 403

[4] S. B. D. DakhliM. B. Chouikha 2009 The knowledge-gap reduction in software engineering Research Challenges in Information Science 2009 RCIS 2009 Third International Conference on. IEEE 287 294

[5] K. FonkychR. Taylor 2005 The state and pattern of health information technology adoption Santa Monica, California, USA Rand Corporation

[6] C. P. FriedmanJ. Wyatt 2005 Evaluation methods in biomedical informatics. New York Springer Science & Business Media

[7] Hennington AHJanz BD 2007 InformationSystems and Healthcare: Physicianadoption of electronic medical records: Applying the UTAUT model in a healthcare context Communications of the Association for Information Systems 19 60 80

[8] P. V. IlavarasanA. K. Sharma 2003 Is software work routinized? Some empirical observations from Indian software industry Journal of Systems and Software 66 1 1 6

[9] B. KaplanN. T. Shaw 2002 People, Organizational, and Social Issues: Evaluation as an exemplar R. HauxC. Kulikowski IMIA Yearbook 91 102

[10] Foundation Kellogg 2004 Logic model development guide Michigan WK Kellogg Foundation 71

[11] B. Marchalvan S. BelleJ. van OlmenT. HoeréeG. Kegels 2012 Is realist evaluation keeping its promise? A review of published empirical studies in the field of health systems research Evaluation 18 2 192 212

[12] T. B. MurdochA. S. Detsky 2013 The inevitable application of big data to health care Jama 309 13 1351 1352

[13] R. PawsonN. Tilley 1997 Realistic evaluation London; Thousand Oaks, Calif Sage

[14] B. RahimiV. Vimarlund 2007 Methods to evaluate health information systems in healthcare settings: a literature review Journal of Medical Systems 31 5 397 432

[15] D; RankinM BlackJ WallaceM MulvennaR BondB Cleland 2017 The MIDAS Platform: Facilitating the Utilisation of Healthcare Big Data in Northern Ireland and Beyond 8th Annual Translational Medicine Conference, City Hotel, Derry/Londonderry, Northern Ireland. Clinical Translational Research and Innovation Centre (C-TRIC)

[16] V. F. Reyna 2008 Theories of medical decision-making and health: an evidence-based approach Medical Decision Making 28 6 829 833

[17] J. RitchieJ. Lewis 2003 Qualitative research practice: a guide for social science students and researchers London Sage

[18] M. Rigby 2006 Evaluation–the Cinderella science of ICT in health IMIA Yearbook 114 120

[19] J. StudnickiD. J. BerndtJ. W. Fisher 2008 Using information systems for public health administration. G. Benjamin Public Health Administration: Principles for Population-Based Management 2nd Sudbury, MA Jones and Bartlett 353 380

[20] B. TilahunT. KauppinenC. KeßlerF. Fritz 2014 Design and Development of a Linked Open Databased Health Information Representation and Visualization System: Potentials and Preliminary Evaluation JMIR Medical Informatics 2 2

[21] C. Toffolon 2000 The software dimensions’ theory. J. Filipe Enterprise Information Systems Springer 89 98

[22] V Venkatesh 2016 Unified Theory of Technology Acceptance and Use of Technology - A Synthesis and the Road Ahead Journal of the Association for Information Systems 17 5 328 376

[23] P.-Y. YenA. S. McAlearneyC. J. SieckJ. L. HefnerT. R. Huerta 2017 Health Information Technology (HIT) Adaptation: Refocusing on the Journey to Successful HIT Implementation JMIR Medical Informatics 5 3 e28

[24] M. M. YusofA. PapazafeiropoulouR. J. PaulL. K. Stergioulas 2008 Investigating evaluation frameworks for health information systems International Journal of Medical Informatics 77 6 377 385

[25] M. ZakkarK. Sedig 2017 Interactive visualization of public health indicators to support policymaking: An exploratory study Online Journal of Public Health Informatics 9 2 e190

[26] C. ZiemkiewiczA. OttleyR. J. CrouserK. ChaunceyS. L. SuR. Chang 2012 Understanding visualization by understanding individual users IEEE Computer Graphics and Applications 32 6 88 94

Celebrating 65 years of The Computer Journal - free-to-read perspectives - bcs.org/tcj65