AbstractBrain computer interfaces (BCI) are used for communication and rehabilitation. One of the main categories of BCI techniques is motor imagery based BCI (MI-BCI). A large number of studies have focused on machine learning approaches to optimize MI-BCI performance. However, enhancement of MI-BCI through provision of optimized feedback modalities has not received equal attention. Motor imagery and motor execution activate almost the same area of the brain. During motor skills performance, a combination of proprioceptive and direct visual feedback (PDVF) is provided. Thus, we hypothesized that MI-BCI that receives PDVF outperforms the traditional MI-BCI, which only uses indirect visual feedback (IVF). We studied 8 healthy subjects performing MI through (i) IVF and (ii) PDVF. We used 8 channel electroencephalogram (EEG) signals and extracted features using an autoregressive model and classified MIs using linear regression. On average, PDVF increased the accuracy of MI performance by 11%, and improved information transfer rate (ITR) by more than two times. In conclusion, using PDVF appears to improve MI-BCI performance according to the studied metrics, making this approach potentially more reliable. KeywordsEEG; motor learning; brain-computer interfaces; motor imagery; information transfer rate, accuracy I. INTRODUCTION Brain-computer interface (BCI) technology has established the foundation for the human brain to communicate with machines directly. Motor imagery (MI) based BCI (MI-BCI) that relies on the rhythm changes occur within the sensorimotor area of the brain during MI [1], is one of the main BCI paradigms. In non-invasive MI-BCI, the brain activity during MI is recorded using EEG [2], functional magnetic resonance imaging [3] (fMRI), or near infrared spectroscopy (NIRS) [4]. Among the aforementioned techniques, EEG is the most practical and affordable technique and thus, the most commonly exploited modality in non-invasive MI-BCI applications. One of the challenges of MI-BCI is its rather low accuracy and information transfer rate (ITR). This drawback limits the dissemination of MI-BCIs for widespread application. Provision of optimum feedback is believed to improve MI- BCI performance metrics [5]. Proprioceptive feedback, visual feedback, or different combinations thereof are among the most common feedback modalities in MI-BCIs [6]. While S. Darvishi, M. Baumert, and D. Abbott are with the Centre for Biomedical Engineering, School of Electrical and Electronic Engineering, The University of Adelaide, SA 5000 (phone:+618-8313-4115; e-mail: sam.darvishi@adelaide.edu.au, mathias.baumert@adelaide.edu.au, derek.abbott@adelaide.edu.au). M.C. Ridding is with the Robinson Institute, School of Pediatrics and Reproductive Health, The University of Adelaide, SA 5005 (michael.ridding@adelaide.edu.au). visual feedback is mostly supplied via cursor position update on a monitor [7], proprioceptive feedback has been provided using either orthoses [8] or robots [9]. Nijboer et al. [10], investigated suitability of auditory feedback for MI-BCI, and found its performance comparable with indirect visual feedback (IVF). Ramos-Murguialday et al. [11], applied concurrent proprioceptive and direct visual feedback (PDVF) as a feedback modality in MI-BCI restorative applications. PDVF showed increased accuracy of subject response to MI compared to either no feedback or sham feedback. However, they did not compare PDVF with other feedback modalities. Motor execution and motor imagery of a particular task, activate almost the same area of the brain [12]. Thus, in search for optimization of feedback modality for MI-BCI we surveyed different feedback types in motor learning. Enough repetition of a movement, followed by feedback, results in motor learning in healthy subjects. Intrinsic feedback is realized through proprioceptive and/or visual sensory inputs as a result of the performed motor task. Extrinsic (augmented) feedback, however, is provided artificially by an external agent to enhance the motor learning outcomes; an example of this are athletes who learn new moves via auditory feedback from the coach [13]. When augmented feedback is added to intrinsic feedback, it improves the retention and motor learning outcomes by provision of knowledge of performance and/or knowledge of result [14]. In contrast to motor learning, there is no muscle activation during motor imagery and, therefore, no source of feedback. As a consequence, an external actuator is required to supply extrinsic feedback in MI-BCI setups. Provision of IVF through updating the cursor position on a monitor is currently the most ubiquitous feedback modality in BCI applications [11]. This type of feedback provision might be quite effective for some BCI applications, such as in the P300-based Speller [15]. However, considering the outcomes of motor learning studies on feedback modalities [16], IVF may not be as effective in MI-BCI because it lacks intrinsic (direct) feedback to close the sensorimotor loop. By contrast, PDVF, in addition to the augmented feedback of IVF, provides intrinsic visual and proprioceptive feedback. While, PDVF provides feedback that is closest to motor learning, supplying IVF via updating cursor position on a monitor remains the most prevalent feedback modality in MI- BCI setups. Recently, Lotte et al [17], suggested that current BCI training approaches that use IVF were suboptimal and need to be improved. Thus, to investigate alternative feedback modalities for MI-BCIs we compared two similar BCI designs that used either IVF or PDVF in eight BCI-naive subjects. According to our results, PDVF seems to be superior to the traditional IVF that promotes the application of PDVF to make MI-BCIs more efficient and accurate. Does Feedback Modality Affect Performance of Brain Computer Interfaces? Sam Darvishi, Member IEEE, Michael C. Ridding, Derek Abbott, Fellow IEEE, Mathias Baumert, Senior Member IEEE. 7th Annual International IEEE EMBS Conference on Neural Engineering Montpellier, France, 22 - 24 April, 2015 978-1-4673-6389-1/15/$31.00 ©2015 IEEE 232