User Performance Evaluation of Four Blood Glucose Monitoring Systems Applying ISO 15197:2013 Accuracy Criteria and Calculation of Insulin Dosing Errors

Abstract

Introduction

The international standard ISO 15197:2013 requires a user performance evaluation to assess if intended users are able to obtain accurate blood glucose measurement results with a self-monitoring of blood glucose (SMBG) system. In this study, user performance was evaluated for four SMBG systems on the basis of ISO 15197:2013, and possibly related insulin dosing errors were calculated. Additionally, accuracy was assessed in the hands of study personnel.

Methods

Accu-Chek ^® Performa Connect (A), Contour ^® plus ONE (B), FreeStyle Optium Neo (C), and OneTouch Select ^® Plus (D) were evaluated with one test strip lot. After familiarization with the systems, subjects collected a capillary blood sample and performed an SMBG measurement. Study personnel observed the subjects’ measurement technique. Then, study personnel performed SMBG measurements and comparison measurements. Number and percentage of SMBG measurements within ± 15 mg/dl and ± 15% of the comparison measurements at glucose concentrations < 100 and ≥ 100 mg/dl, respectively, were calculated. In addition, insulin dosing errors were modelled.

Results

In the hands of lay-users three systems fulfilled ISO 15197:2013 accuracy criteria with the investigated test strip lot showing 96% (A), 100% (B), and 98% (C) of results within the defined limits. All systems fulfilled minimum accuracy criteria in the hands of study personnel [99% (A), 100% (B), 99.5% (C), 96% (D)]. Measurements with all four systems were within zones of the consensus error grid and surveillance error grid associated with no or minimal risk. Regarding calculated insulin dosing errors, all 99% ranges were between dosing errors of − 2.7 and + 1.4 units for measurements in the hands of lay-users and between − 2.5 and + 1.4 units for study personnel. Frequent lay-user errors were not checking the test strips’ expiry date and applying blood incorrectly.

Conclusions

Data obtained in this study show that not all available SMBG systems complied with ISO 15197:2013 accuracy criteria when measurements were performed by lay-users.

Trial Registration

The study was registered at ClinicalTrials.gov (NCT02916576).

Funding

Ascensia Diabetes Care Deutschland GmbH.

Electronic supplementary material

The online version of this article (10.1007/s13300-018-0392-6) contains supplementary material, which is available to authorized users.