83
views
0
recommends
+1 Recommend
1 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Architecture design for performing grasp-and-lift tasks in brain–machine-interface-based human-in-the-loop robotic system

      research-article
      IET Cyber-Physical Systems: Theory & Applications
      The Institution of Engineering and Technology
      electroencephalography, medical signal processing, neurophysiology, learning (artificial intelligence), medical robotics, brain-computer interfaces, human-robot interaction, mobile robots, hardware-in-the loop simulation, end effectors, grippers, human-in-the-loop robotic system, human intelligence, machine intelligence, grasp-and-lift tasks, human–robot interactions, human assistive GAL tasks, brain–machine interface controlled robots, human–robot collaborative manipulations, BMI-based human–robot systems, human brain activities, brain-controlled robot, brain–machine-interface-based human-in-the-loop robotic system, nonstationary signals

      Read this article at

      ScienceOpenPublisher
      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Human-in-the-loop robotic system is an emerging technique in recent years. Human intelligence as well as machine intelligence are incorporated to accomplish tasks efficiently and effectively. However, grasp-and-lift (GAL) tasks through human–robot interactions are still a problem in an unstructured environment like urban search and rescue. Human assistive GAL tasks enable robots to complete search or rescue procedures quickly and accurately. Brain–machine interface (BMI) controlled robots have demonstrated promising applications in human–robot collaborative manipulations. In this study, an architecture of human–robot team is proposed for performing GAL tasks in BMI-based human–robot systems. The proposed architecture contains several workflows from both human and robot aspects to improve performance. In addition, human brain activities are generally considered as non-stationary signals with varying spatial and temporal distributions. To enhance robustness and stability of brain-controlled robot's GAL tasks, a new method via adaptive boosting mechanism is proposed. The proposed multiple subjects' adaptive boosting is able to suppress noisy data and outliers in multiple subjects’ electroencephalogram signals, and therefore enhance accuracy and robustness of intention and sensation signal classification in GAL tasks. Preliminary results show that the new architecture is feasible with ethical establishment and the proposed method can outperform traditional methods.

          Most cited references25

          • Record: found
          • Abstract: found
          • Article: not found

          Active tactile exploration enabled by a brain-machine-brain interface

          Brain-machine interfaces (BMIs) 1,2 use neuronal activity recorded from the brain to establish direct communication with external actuators, such as prosthetic arms. While BMIs aim to restore the normal sensorimotor functions of the limbs, so far they have lacked tactile sensation. Here we demonstrate the operation of a brain-machine-brain interface (BMBI) that both controls the exploratory reaching movements of an actuator and enables the signalling of artificial tactile feedback through intracortical microstimulation (ICMS) of the primary somatosensory cortex (S1). Monkeys performed an active-exploration task in which an actuator (a computer cursor or a virtual-reality hand) was moved using a BMBI that derived motor commands from neuronal ensemble activity recorded in primary motor cortex (M1). ICMS feedback occurred whenever the actuator touched virtual objects. Temporal patterns of ICMS encoded the artificial tactile properties of each object. Neuronal recordings and ICMS epochs were temporally multiplexed to avoid interference. Two monkeys operated this BMBI to search and discriminate one out of three visually undistinguishable objects, using the virtual hand to identify the unique artificial texture (AT) associated with each. These results suggest that clinical motor neuroprostheses might benefit from the addition of ICMS feedback to generate artificial somatic perceptions associated with mechanical, robotic, or even virtual prostheses.
            Bookmark
            • Record: found
            • Abstract: not found
            • Article: not found

            Nonstationary nature of the brain activity as revealed by EEG/MEG: Methodological, practical and conceptual challenges

              Bookmark
              • Record: found
              • Abstract: found
              • Article: found
              Is Open Access

              Conscious Brain-to-Brain Communication in Humans Using Non-Invasive Technologies

              Human sensory and motor systems provide the natural means for the exchange of information between individuals, and, hence, the basis for human civilization. The recent development of brain-computer interfaces (BCI) has provided an important element for the creation of brain-to-brain communication systems, and precise brain stimulation techniques are now available for the realization of non-invasive computer-brain interfaces (CBI). These technologies, BCI and CBI, can be combined to realize the vision of non-invasive, computer-mediated brain-to-brain (B2B) communication between subjects (hyperinteraction). Here we demonstrate the conscious transmission of information between human brains through the intact scalp and without intervention of motor or peripheral sensory systems. Pseudo-random binary streams encoding words were transmitted between the minds of emitter and receiver subjects separated by great distances, representing the realization of the first human brain-to-brain interface. In a series of experiments, we established internet-mediated B2B communication by combining a BCI based on voluntary motor imagery-controlled electroencephalographic (EEG) changes with a CBI inducing the conscious perception of phosphenes (light flashes) through neuronavigated, robotized transcranial magnetic stimulation (TMS), with special care taken to block sensory (tactile, visual or auditory) cues. Our results provide a critical proof-of-principle demonstration for the development of conscious B2B communication technologies. More fully developed, related implementations will open new research venues in cognitive, social and clinical neuroscience and the scientific study of consciousness. We envision that hyperinteraction technologies will eventually have a profound impact on the social structure of our civilization and raise important ethical issues.
                Bookmark

                Author and article information

                Contributors
                Journal
                IET-CPS
                IET Cyber-Physical Systems: Theory & Applications
                IET Cyber-Phys. Syst., Theory Appl.
                The Institution of Engineering and Technology
                2398-3396
                2398-3396
                30 April 2019
                20 May 2019
                September 2019
                : 4
                : 3
                : 198-203
                Affiliations
                Department of Computer Science & Engineering Technology, University of Houston-Downtown , One Main Street, Houston, Texas 77002, USA
                Article
                IET-CPS.2018.5066 CPS.2018.5066.R1
                10.1049/iet-cps.2018.5066
                88a9d499-3cc7-46e7-ab72-af4d57ed84b5

                This is an open access article published by the IET under the Creative Commons Attribution-NoDerivs License ( http://creativecommons.org/licenses/by-nd/3.0/)

                History
                : 26 September 2018
                : 21 February 2019
                : 23 April 2019
                Page count
                Pages: 0
                Funding
                Funded by: U.S. Department of Defense
                Award ID: W911NF-17-1-0182
                Funded by: U.S. Nuclear Regulatory Commission
                Award ID: NRC-HQ-60-17-G-0019
                Categories
                Special Issue: Social and Human Aspects of Cyber-Physical Systems

                Software engineering,Data structures & Algorithms,Robotics,Networking & Internet architecture,Artificial intelligence,Human-computer-interaction
                mobile robots,brain-computer interfaces,medical signal processing,medical robotics,learning (artificial intelligence),human-robot interaction,neurophysiology,electroencephalography,nonstationary signals,hardware-in-the loop simulation,brain–machine-interface-based human-in-the-loop robotic system,brain-controlled robot,end effectors,human brain activities,BMI-based human–robot systems,grippers,human–robot collaborative manipulations,brain–machine interface controlled robots,human-in-the-loop robotic system,human assistive GAL tasks,human–robot interactions,human intelligence,grasp-and-lift tasks,machine intelligence

                Comments

                Comment on this article