Exploring EEG Features in Cross-Subject Emotion Recognition

The increase in spatiotemporal resolution of neuroimaging devices is accompanied by a trend towards more powerful multivariate analysis methods. Often it is desired to interpret the outcome of these methods with respect to the cognitive processes under study. Here we discuss which methods allow for such interpretations, and provide guidelines for choosing an appropriate analysis for a given experimental goal: For a surgeon who needs to decide where to remove brain tissue it is most important to determine the origin of cognitive functions and associated neural processes. In contrast, when communicating with paralyzed or comatose patients via brain-computer interfaces, it is most important to accurately extract the neural processes specific to a certain mental state. These equally important but complementary objectives require different analysis methods. Determining the origin of neural processes in time or space from the parameters of a data-driven model requires what we call a forward model of the data; such a model explains how the measured data was generated from the neural sources. Examples are general linear models (GLMs). Methods for the extraction of neural information from data can be considered as backward models, as they attempt to reverse the data generating process. Examples are multivariate classifiers. Here we demonstrate that the parameters of forward models are neurophysiologically interpretable in the sense that significant nonzero weights are only observed at channels the activity of which is related to the brain process under study. In contrast, the interpretation of backward model parameters can lead to wrong conclusions regarding the spatial or temporal origin of the neural signals of interest, since significant nonzero weights may also be observed at channels the activity of which is statistically independent of the brain process under study. As a remedy for the linear case, we propose a procedure for transforming backward models into forward models. This procedure enables the neurophysiological interpretation of the parameters of linear backward models. We hope that this work raises awareness for an often encountered problem and provides a theoretical basis for conducting better interpretable multivariate neuroimaging analyses. Copyright © 2013 The Authors. Published by Elsevier Inc. All rights reserved.

Many complex and interesting phenomena in nature are due to nonlinear phenomena. The theory of nonlinear dynamical systems, also called 'chaos theory', has now progressed to a stage, where it becomes possible to study self-organization and pattern formation in the complex neuronal networks of the brain. One approach to nonlinear time series analysis consists of reconstructing, from time series of EEG or MEG, an attractor of the underlying dynamical system, and characterizing it in terms of its dimension (an estimate of the degrees of freedom of the system), or its Lyapunov exponents and entropy (reflecting unpredictability of the dynamics due to the sensitive dependence on initial conditions). More recently developed nonlinear measures characterize other features of local brain dynamics (forecasting, time asymmetry, determinism) or the nonlinear synchronization between recordings from different brain regions. Nonlinear time series has been applied to EEG and MEG of healthy subjects during no-task resting states, perceptual processing, performance of cognitive tasks and different sleep stages. Many pathologic states have been examined as well, ranging from toxic states, seizures, and psychiatric disorders to Alzheimer's, Parkinson's and Cre1utzfeldt-Jakob's disease. Interpretation of these results in terms of 'functional sources' and 'functional networks' allows the identification of three basic patterns of brain dynamics: (i) normal, ongoing dynamics during a no-task, resting state in healthy subjects; this state is characterized by a high dimensional complexity and a relatively low and fluctuating level of synchronization of the neuronal networks; (ii) hypersynchronous, highly nonlinear dynamics of epileptic seizures; (iii) dynamics of degenerative encephalopathies with an abnormally low level of between area synchronization. Only intermediate levels of rapidly fluctuating synchronization, possibly due to critical dynamics near a phase transition, are associated with normal information processing, whereas both hyper-as well as hyposynchronous states result in impaired information processing and disturbed consciousness.