4
views
0
recommends
+1 Recommend
0 collections
    0
    shares
      • Record: found
      • Abstract: found
      • Article: found
      Is Open Access

      Linking Multi-Layer Dynamical GCN With Style-Based Recalibration CNN for EEG-Based Emotion Recognition

      methods-article

      Read this article at

      Bookmark
          There is no author summary for this article yet. Authors can add summaries to their articles on ScienceOpen to make them more accessible to a non-specialist audience.

          Abstract

          Electroencephalography (EEG)-based emotion computing has become one of the research hotspots of human-computer interaction (HCI). However, it is difficult to effectively learn the interactions between brain regions in emotional states by using traditional convolutional neural networks because there is information transmission between neurons, which constitutes the brain network structure. In this paper, we proposed a novel model combining graph convolutional network and convolutional neural network, namely MDGCN-SRCNN, aiming to fully extract features of channel connectivity in different receptive fields and deep layer abstract features to distinguish different emotions. Particularly, we add style-based recalibration module to CNN to extract deep layer features, which can better select features that are highly related to emotion. We conducted two individual experiments on SEED data set and SEED-IV data set, respectively, and the experiments proved the effectiveness of MDGCN-SRCNN model. The recognition accuracy on SEED and SEED-IV is 95.08 and 85.52%, respectively. Our model has better performance than other state-of-art methods. In addition, by visualizing the distribution of different layers features, we prove that the combination of shallow layer and deep layer features can effectively improve the recognition performance. Finally, we verified the important brain regions and the connection relationships between channels for emotion generation by analyzing the connection weights between channels after model learning.

          Related collections

          Most cited references41

          • Record: found
          • Abstract: not found
          • Article: not found

          Investigating Critical Frequency Bands and Channels for EEG-Based Emotion Recognition with Deep Neural Networks

            Bookmark
            • Record: found
            • Abstract: found
            • Article: not found

            Functional grouping and cortical-subcortical interactions in emotion: a meta-analysis of neuroimaging studies.

            We performed an updated quantitative meta-analysis of 162 neuroimaging studies of emotion using a novel multi-level kernel-based approach, focusing on locating brain regions consistently activated in emotional tasks and their functional organization into distributed functional groups, independent of semantically defined emotion category labels (e.g., "anger," "fear"). Such brain-based analyses are critical if our ways of labeling emotions are to be evaluated and revised based on consistency with brain data. Consistent activations were limited to specific cortical sub-regions, including multiple functional areas within medial, orbital, and inferior lateral frontal cortices. Consistent with a wealth of animal literature, multiple subcortical activations were identified, including amygdala, ventral striatum, thalamus, hypothalamus, and periaqueductal gray. We used multivariate parcellation and clustering techniques to identify groups of co-activated brain regions across studies. These analyses identified six distributed functional groups, including medial and lateral frontal groups, two posterior cortical groups, and paralimbic and core limbic/brainstem groups. These functional groups provide information on potential organization of brain regions into large-scale networks. Specific follow-up analyses focused on amygdala, periaqueductal gray (PAG), and hypothalamic (Hy) activations, and identified frontal cortical areas co-activated with these core limbic structures. While multiple areas of frontal cortex co-activated with amygdala sub-regions, a specific region of dorsomedial prefrontal cortex (dmPFC, Brodmann's Area 9/32) was the only area co-activated with both PAG and Hy. Subsequent mediation analyses were consistent with a pathway from dmPFC through PAG to Hy. These results suggest that medial frontal areas are more closely associated with core limbic activation than their lateral counterparts, and that dmPFC may play a particularly important role in the cognitive generation of emotional states.
              Bookmark
              • Record: found
              • Abstract: found
              • Article: not found

              Semi-Supervised Classification with Graph Convolutional Networks

              We present a scalable approach for semi-supervised learning on graph-structured data that is based on an efficient variant of convolutional neural networks which operate directly on graphs. We motivate the choice of our convolutional architecture via a localized first-order approximation of spectral graph convolutions. Our model scales linearly in the number of graph edges and learns hidden layer representations that encode both local graph structure and features of nodes. In a number of experiments on citation networks and on a knowledge graph dataset we demonstrate that our approach outperforms related methods by a significant margin. Published as a conference paper at ICLR 2017
                Bookmark

                Author and article information

                Contributors
                Journal
                Front Neurorobot
                Front Neurorobot
                Front. Neurorobot.
                Frontiers in Neurorobotics
                Frontiers Media S.A.
                1662-5218
                24 February 2022
                2022
                : 16
                : 834952
                Affiliations
                [1] 1Henan Key Laboratory of Imaging and Intelligent Processing, PLA Strategic Support Force Information Engineering University , Zhengzhou, China
                [2] 2Key Laboratory for NeuroInformation of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China , Chengdu, China
                Author notes

                Edited by: Yuan Zong, Southeast University, China

                Reviewed by: Sheng Ge, Southeast University, China; Yu Zhang, Lehigh University, United States

                *Correspondence: Ying Zeng yingzeng@ 123456uestc.edu.cn
                Article
                10.3389/fnbot.2022.834952
                8907537
                35280845
                e0642188-20ff-40a7-b0c4-86bd50e3ead1
                Copyright © 2022 Bao, Yang, Tong, Shu, Zhang, Wang, Yan and Zeng.

                This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

                History
                : 14 December 2021
                : 24 January 2022
                Page count
                Figures: 5, Tables: 5, Equations: 16, References: 46, Pages: 12, Words: 7931
                Categories
                Neuroscience
                Methods

                Robotics
                electroencephalography (eeg),emotion recognition,graph convolutional neural networks (gcnn),convolutional neural networks (cnn),style-based recalibration module (srm)

                Comments

                Comment on this article