36
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Performance assessment in brain-computer interface-based augmentative and alternative communication

      review-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          A large number of incommensurable metrics are currently used to report the performance of brain-computer interfaces (BCI) used for augmentative and alterative communication (AAC). The lack of standard metrics precludes the comparison of different BCI-based AAC systems, hindering rapid growth and development of this technology. This paper presents a review of the metrics that have been used to report performance of BCIs used for AAC from January 2005 to January 2012. We distinguish between Level 1 metrics used to report performance at the output of the BCI Control Module, which translates brain signals into logical control output, and Level 2 metrics at the Selection Enhancement Module, which translates logical control to semantic control. We recommend that: (1) the commensurate metrics Mutual Information or Information Transfer Rate (ITR) be used to report Level 1 BCI performance, as these metrics represent information throughput, which is of interest in BCIs for AAC; 2) the BCI-Utility metric be used to report Level 2 BCI performance, as it is capable of handling all current methods of improving BCI performance; (3) these metrics should be supplemented by information specific to each unique BCI configuration; and (4) studies involving Selection Enhancement Modules should report performance at both Level 1 and Level 2 in the BCI system. Following these recommendations will enable efficient comparison between both BCI Control and Selection Enhancement Modules, accelerating research and development of BCI-based AAC systems.

          Related collections

          Most cited references76

          • Record: found
          • Abstract: found
          • Article: not found

          An efficient P300-based brain-computer interface for disabled subjects.

          A brain-computer interface (BCI) is a communication system that translates brain-activity into commands for a computer or other devices. In other words, a BCI allows users to act on their environment by using only brain-activity, without using peripheral nerves and muscles. In this paper, we present a BCI that achieves high classification accuracy and high bitrates for both disabled and able-bodied subjects. The system is based on the P300 evoked potential and is tested with five severely disabled and four able-bodied subjects. For four of the disabled subjects classification accuracies of 100% are obtained. The bitrates obtained for the disabled subjects range between 10 and 25bits/min. The effect of different electrode configurations and machine learning algorithms on classification accuracy is tested. Further factors that are possibly important for obtaining good classification accuracy in P300-based BCI systems for disabled subjects are discussed.
            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials.

            This paper describes the development and testing of a system whereby one can communicate through a computer by using the P300 component of the event-related brain potential (ERP). Such a system may be used as a communication aid by individuals who cannot use any motor system for communication (e.g., 'locked-in' patients). The 26 letters of the alphabet, together with several other symbols and commands, are displayed on a computer screen which serves as the keyboard or prosthetic device. The subject focuses attention successively on the characters he wishes to communicate. The computer detects the chosen character on-line and in real time. This detection is achieved by repeatedly flashing rows and columns of the matrix. When the elements containing the chosen character are flashed, a P300 is elicited, and it is this P300 that is detected by the computer. We report an analysis of the operating characteristics of the system when used with normal volunteers, who took part in 2 experimental sessions. In the first session (the pilot study/training session) subjects attempted to spell a word and convey it to a voice synthesizer for production. In the second session (the analysis of the operating characteristics of the system) subjects were required simply to attend to individual letters of a word for a specific number of trials while data were recorded for off-line analysis. The analyses suggest that this communication channel can be operated accurately at the rate of 0.20 bits/sec. In other words, under the conditions we used, subjects can communicate 12.0 bits, or 2.3 characters, per min.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Imagery of motor actions: differential effects of kinesthetic and visual-motor mode of imagery in single-trial EEG.

              Single-trial motor imagery classification is an integral part of a number of brain-computer interface (BCI) systems. The possible significance of the kind of imagery, involving rather kinesthetic or visual representations of actions, was addressed using the following experimental conditions: kinesthetic motor imagery (MIK), visual-motor imagery (MIV), motor execution (ME) and observation of movement (OOM). Based on multi-channel EEG recordings in 14 right-handed participants, we applied a learning classifier, the distinction sensitive learning vector quantization (DSLVQ) to identify relevant features (i.e., frequency bands, electrode sites) for recognition of the respective mental states. For ME and OOM, the overall classification accuracies were about 80%. The rates obtained for MIK (67%) were better than the results of MIV (56%). Moreover, the focus of activity during kinesthetic imagery was found close to the sensorimotor hand area, whereas visual-motor imagery did not reveal a clear spatial pattern. Consequently, to improve motor-imagery-based BCI control, user training should emphasize kinesthetic experiences instead of visual representations of actions.
                Bookmark

                Author and article information

                Journal
                Biomed Eng Online
                Biomed Eng Online
                BioMedical Engineering OnLine
                BioMed Central
                1475-925X
                2013
                16 May 2013
                : 12
                : 43
                Affiliations
                [1 ]Department of Biomedical Engineering, University of Michigan, Ann Arbor, MI, USA
                [2 ]Department of Physical Medicine and Rehabilitation, University of Michigan, Ann Arbor, MI, USA
                Article
                1475-925X-12-43
                10.1186/1475-925X-12-43
                3662584
                23680020
                430fe88a-a2ca-4e4e-951e-5ba5efcdc435
                Copyright ©2013 Thompson et al.; licensee BioMed Central Ltd.

                This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

                History
                : 27 November 2012
                : 17 April 2013
                Categories
                Review

                Biomedical engineering
                brain-computer interface,augmentative and alternative communication,outcome measures,information transfer rate

                Comments

                Comment on this article