This paper presents a functional near infrared (NIR) spectroscopy-based paradigm that can be used to decode answers to four-choice questions. Ten healthy subjects were asked to perform one of the four different brain activities, that is, right-hand motor imagery (RMI), left-hand motor imagery (LMI), mental arithmetic (MA) and mental counting (MC), to answer the given four-choice questions. In selecting the A, B, C or D choices, the subjects were asked to perform RMI, LMI, MA or MC, respectively. Signals from the primary motor and prefrontal cortices were acquired simultaneously using a continuous-wave functional NIR spectroscopy system. The four activities were classified using multiclass linear discriminant analysis to decode the answers to an average accuracy of 73.3% across the 10 subjects. The results demonstrate the potential of functional NIR spectroscopy to decode answers to four-choice questions using four different intentionally generated brain activities as control signals.
SorgerB.DahmenB.ReithlerJ.GosseriesO.MaudouxA.LaureysS. and GoebelR., “Another kind of ‘BOLD response’: Answering multiple-choice questions via online decoded single-trial brain signals”, Prog. Brain Res.177, 275 (2009). doi: http://dx.doi.org/10.1016/S0079-6123(09)17719-1
2.
WolpawJ.R.BirbaumerN.McFarlandD.J.PfurtschellerG. and VaughanT.M., “Brain–computer interfaces for communication and control”, Clin. Neurophysiol.113, 767 (2002). doi: http://dx.doi.org/10.1016/S1388-2457(02)00057-3
3.
PhilipB.A.RaoN. and DonoghueJ.P., “Simultaneous reconstruction of continuous hand movements from primary motor and posterior parietal cortex”, Exp. Brain Res.225, 361 (2013). doi: http://dx.doi.org/10.1007/s00221-012-3377-0
4.
SalvarisM. and SepulvedaF., “Classification effects of real and imaginary movement selective attention tasks on a P300-based brain–computer interface”, J. Neural Eng.7, 056004 (2010). doi: http://dx.doi.org/10.1088/1741-2560/7/5/056004
5.
ChoiK., “Electroencephalography (EEG)-based neurofeedback training for brain–computer interface (BCI)”, Exp. Brain Res.231, 351 (2013). doi: http://dx.doi.org/10.1007/s00221-013-3699-6
6.
EnzingerC.RopeleS.FazekasF.LoitfelderM.GoraniF.SeifertT.ReiterG.NeuperC.PfurtschellerG. and Muller-PutzG., “Brain motor system function in a patient with complete spinal cord injury following extensive brain–computer interface training”, Exp. Brain Res.190, 215 (2008). doi: http://dx.doi.org/10.1007/s00221-008-1465-y
7.
CoyleS.M.WardTE T.E.MarkhamC.M. and McDarbyG. (2004), “On the suitability of near-infrared (NIR) systems for next generation brain–computer interfaces”, Physiol. Meas.25, 815 (2004). doi: http://dx.doi.org/10.1088/0967-3334/25/4/003
8.
CoyleS.M.WardT.E. and MarkhamC.M., “Brain– computer interface using a simplified functional near-infrared spectroscopy system”, J. Neural Eng.4, 219 (2007). doi: http://dx.doi.org/10.1088/1741-2560/4/3/007
9.
SitaramR.ZhangH.GuanC.ThulasidasM.HoshiY.IshikawaA.ShimizuK. and BirbaumerN., “Temporal classification of multichannel near-infrared spectroscopy signals of motor imagery for developing a brain– computer interface”, NeuroImage34, 1416 (2007). doi: http://dx.doi.org/10.1016/j.neuroimage.2006.11.005
10.
NaitoM.MichiokaY.OzawaK.ItoY.KiguchiM. and KanazawT., “A communication means for totally locked-in ALS patients based on changes in cerebral blood volume measured with near-infrared light”, IEICE Trans. Inform. Syst.90, 1028 (2007). doi: http://dx.doi.org/10.1093/ietisy/e90-d.7.1028
NaseerN. and HongK.-S., “Classification of functional near-infrared spectroscopy signals corresponding to the right- and left-wrist motor imagery for development of a brain–computer interface”, Neurosci. Lett.553, 84 (2013). doi: http://dx.doi.org/10.1016/j.neulet.2013.08.021
13.
NaseerN.HongM.J. and HongK.-S., “Online binary decision decoding using functional near-infrared spectroscopy for the development of brain computer interface”, Exp. Brain Res.232, 555 (2014). doi: http://dx.doi.org/10.1007/s00221-013-3764-1
14.
JobsisF.F., “Noninvasive, infrared monitoring of cerebral and myocardial oxygen sufficiency and circulatory parameters”, Science198, 1264 (1977). doi: http://dx.doi.org/10.1126/science.929199
15.
HuX.-S.HongK.-S.GeS.S. and JeongM.-Y., “Kalman estimator- and general linear model-based on-line brain activation mapping by near-infrared spectroscopy”, Biomed. Eng. Online9, 82 (2010). doi: http://dx.doi.org/10.1186/1475-925X-9-82
16.
HuX.-S.HongK.-S. and GeS.S., “Recognition of stimulus-evoked neuronal optical response by identifying chaos levels of near-infrared spectroscopy time series”, Neurosci. Lett.504, 115 (2011). doi: http://dx.doi.org/10.1016/j.neulet.2011.09.011
17.
AqilM.HongK.-S.JeongM.-Y. and GeS.S., “Cortical brain imaging by adaptive filtering of NIRS signals”, Neurosci. Lett.514, 35 (2012). doi: http://dx.doi.org/10.1016/j.neulet.2012.02.048
18.
AqilM.HongK.-S.JeongM.-Y. and GeS.S., “Detection of event-related hemodynamic response to neuroactivation by dynamic modeling of brain activity”, NeuroImage63, 553 (2012). doi: http://dx.doi.org/10.1016/j.neuroimage.2012.07.006
19.
CutiniS.MoroS.B. and BiscontiS., “Functional near infrared optical imaging in cognitive neuroscience: An introductory review”, J. Near Infrared Spectrosc.20, 75 (2012). doi: http://dx.doi.org/10.1255/jnirs.969
20.
ErnstL.H.SchneiderS.EhlisA.C.FallgatterA.J., “Functional near infrared spectroscopy in psychiatry: A critical review”, J. Near Infrared Spectrosc.20, 93 (2012). doi: http://dx.doi.org/10.1255/jnirs.970
21.
FerrariM.NorrisK.H. and SowaM.G., “Medical near infrared spectroscopy 35 years after the discovery”, J. Near Infrared Spectrosc.20, vii (2012).
22.
FerrariM. and QuaresimaV., “Near infrared brain and muscle oximetry: From the discovery to current applications”, J. Near Infrared Spectrosc.20, 1 (2012). doi: http://dx.doi.org/10.1255/jnirs.973
23.
KamranM.A. and HongK.-S., “Linear parameter varying model and adaptive filtering technique for detecting neuronal activities: An fNIRS study”, J. Neural Eng.10, 056002 (2013). doi: http://dx.doi.org/10.1088/1741-2560/10/5/056002
24.
WijeakumarS.ShahaniU.SimpsonW.A. and McCullochD.L., “Haemodynamic responses to radial motion in the visual cortex”, J. Near Infrared Spectrosc.21, 231 (2013). doi: http://dx.doi.org/10.1255/jnirs.1066
25.
BhuttaR.HongK.-S.KimB.-M.HongM.J.KimY.-H. and LeeS.-H., “Note: Three wavelength near-infrared spectroscopy system for compensating the light absorbance by water”, Rev. Sci. Instrum.85, 026111 (2014). doi: http://dx.doi.org/10.1063/1.4865124
26.
HongK.-S. and NguyenH.-D., “State-space models of impulse hemodynamic responses over motor, somatosensory and visual cortices”, Biomed. Opt. Express5, 1778 (2014). doi: http://dx.doi.org/10.1364/BOE.5.001778
27.
XuB.FuY.ShiG.YinX.WangZ. and LiH., “Improving classification by feature discretization and optimization for fNIRS-based BCI”, J. Biomim. Biomater. Tissue Eng.19, 1000119 (2014). doi: http://dx.doi.org//10.4172/1662-100X.1000119
28.
BauernfeindG.LeebR.WriessneggerS.C. and PfurtschellerG., “Development, set-up and first results for a one-channel near-infrared spectroscopy system”, Biomed. Tech.53, 36 (2008). doi: http://dx.doi.org/10.1515/BMT.2008.005
29.
PowerS.D.FalkT.H. and ChauT., “Classification of prefrontal activity due to mental arithmetic and music imagery using hidden Markov models and frequency domain near-infrared spectroscopy”, J. Neural Eng.7, 026002 (2010). doi: http://dx.doi.org/1088/1741-2560/7/2/026002
30.
PowerS.D.KhushkiA. and ChauT., “Towards a system-paced near-infrared spectroscopy brain–computer interface: Differentiating prefrontal activity due to mental arithmetic and mental singing from the no-control state”, J. Neural Eng.8, 066004 (2011). doi: http://dx.doi.org/10.1088/1741-2560/8/6/066004
31.
PowerS.D.KhushkiA. and ChauT., “Automatic single trial discrimination of mental arithmetic, mental singing and the no-control state from the prefrontal activity: Towards a three-state NIRS-BCI”, BMC Res. Notes5, 141 (2012). doi: http://dx.doi.org/10.1186/1756-0500-5-141
YueJ.ZhouZ.JiangJ.LiuY. and HuD., “Balancing a simulated inverted pendulum through motor imagery: An EEG-based real-time control paradigm”, Neurosci. Lett.524, 95 (2010). doi: http://dx.doi.org/10.1016/j.neulet.2012.07.031
34.
StanglM.BauernfiendG.KurzmannJ.SchererR. and NeuperC., “A haemodynamic brain–computer interface based on real-time classification of near infrared spectroscopy signals during motor imagery and mental arithmetic”, J. Near Infrared Spectrosc.21, 157 (2012). doi: http://dx.doi.org/10.1255/jnirs1048
35.
CramerS.C.LastraL.LacourseM.G. and CohenM.J., “Brain motor system function after chronic, complete spinal cord injury”, Brain128, 294 (2005). doi: http://dx.doi.org/10.1093/brain/awh648
36.
Lopez-LarrazE.AntelisJ.M.MontesanoL.Gil-AgudoA. and MinguezJ., “Continuous decoding of motor attempt and motor imagery from EEG activity in spinal cord injury patients”, Conference Proceedings, IEEE Engineering in Medicine and Biology Society, pp. 1789–1801 (2012).
37.
ChanJ.PowerS. and ChauT., “Investigating the need for modelling temporal dependencies in a brain–computer interface with real-time feedback based on near infrared spectra”, J. Near Infrared Spectrosc.20, 107 (2012). doi: http://dx.doi.org/10.1255/jnirs.971
LuuS. and ChauT., “Decoding subjective preferences from single-trial near-infrared spectroscopy signals”, J. Neural Eng.6, 016003 (2009). doi: http://dx.doi.org/10.1088/1741-2560/6/1/016003
40.
HillN.J.RicciE.HaiderS.McCaneL.M.HeckmanS.WolpawJ.R. and VaughanT.M., “A practical, intuitive brain–computer interface for communicating ‘yes’ or ‘no’ by listening”, J. Neural Eng.11, 035003 (2014). doi: http://dx.doi.org/10.1088/1741-2560/11/3/035003
41.
LimJ.-H.HwangH.-J.HanS.-H.JungK.-Y. and ImC.-H., “Classification of binary intentions for individuals with impaired oculomotor function: ‘eyes-closed’ SSVEP-based brain–computer interface (BCI)”, J. Neural Eng.10, 026021 (2013). doi: http://dx.doi.org/10.1088/1741-2560/10/2/026021
42.
HoshiY., “Functional near-infrared spectroscopy: Current status and future prospects”, J. Biomed. Opt.12, 062106 (2007). doi: http://dx.doi.org/10.1117/1.2804911
43.
DelpyD.T.CopeM.van der ZeeP.ArridgeS.WrayS. and WyatJ., “Estimation of optical path length through tissue from direct time of flight measurement”, Phys. Med. Biol.33, 1433 (1988). doi: http://dx.doi.org/10.1088/0031-9155/33/12/008
44.
HomanR.W.HermanJ. and PurdyP., “Cerebral location of international 10–20 system electrode placement”, Electroen. Clin. Neuro.66, 376 (1987). doi: http://dx.doi.org/10.1016/0013-4694(87)90206-9
45.
McCormickP.W.StewartM.LewisG.DujovnyM and AusmanJ.I., “Intracerebral penetration of infrared light”, J. Neurosurg.76, 315 (1992). doi: http://dx.doi.org/10.3171/jns.1992.76.2.0315
46.
GrattonG.BrumbackC.R.GordonB.A.PearsonM.A.LowK.A. and FabianiM., “Effects of measurement method, wavelength and source-detector distance on the fast optical signal”, NeuroImage32, 1576 (2006). doi: http://dx.doi.org/10.1016/j.neuroimage.2006.05.030
47.
FrederickB.D.NickersonL.D. and TongY., “Physiological denoising of BOLD fMRI data using regressor interpolation at progressive time delays (RIPTiDe) processing of concurrent fMRI and near-infrared spectroscopy (NIRS)”, NeuroImage60, 1913 (2012). doi: http://dx.doi.org/10.1016/j.neuroimage.2012.01.140
48.
BeisteinerR.HollingerP.LindingerG.LangW. and BerthozA., “Mental representations of movements: Brain potentials associated with imagination of hand movements”, Electroencephalogr. Clin. Neurophysiol.96, 183 (1995). doi: http://dx.doi.org/10.1016/0168-5597(94)00226-5
49.
PorroC.A.FrancescatoM.P.CettoloV.DiamondM.E.BaraldiP.ZuianiC.BazzocchiM and di PramperoP.E., “Primary motor and sensory cortex activation during motor performance and motor imagery: A functional magnetic resonance imaging study”, J. Neurosci.16, 7688 (1996).
SantosaH.HongM.J.KimS.-P. and HongK.-S., “Noise reduction in functional near-infrared spectroscopy signals by independent component analysis”, Rev. Sci. Instrum.84, 073106 (2013). doi: http://dx.doi.org/10.1063/1.4812785
52.
KamranM.A. and HongK.-S., “Reduction of physiological effects in fNIRS waveforms for efficient brain-state decoding,”Neurosci. Lett.580, 130 (2014). doi: http://dx.doi.org/10.1016/j.neulet.2014.07.058
53.
FazliS.MehnertJ.SteinbrinkJ.CurioG.VillringerA.MullerK.R. and BlankertzB., “Enhanced performance by a hybrid NIRS-EEG brain computer interface”, NeuroImage59, 519 (2012). doi: http://dx.doi.org/10.1016/j.neuroimage.2011.07.084
54.
KhanM.J.HongM.J. and HongK.-S., “Decoding of four movement directions using hybrid NIRS-EEG brain– computer interface”, Front. Hum. Neurosci.8, 00244 (2014). doi: http://dx.doi.org/10.3389/fnhum.2014.00244
LotteF.CongedoM.LecuyerA.LamarcheF. and ArnaldiB., “A review of classification algorithms for EEG-based brain–computer interfaces”, J. Neural Eng.4 (2007). doi: http://dx.doi.org/10.1088/1741-2560/4/2/R01
58.
LiT.ZhuS. and OgiharaM., “Using discriminant analysis for multi-class classification: An experimental investigation”, Knowl. Inf. Syst.10, 453 (2006). doi: http://dx.doi.org/10.1007/s10115-006-0013-y
59.
YarkoniT. and BraverT.S., “Cognitive neuroscience approaches to individual differences in working memory and executive control: Conceptual and methodological issues”, in Handbook of Individual Differences in Cognition: Attention, Memory and Executive Control, Ed by GruszkaA.MatthewsG. and SzymuyraB.Springer, New York, p. 87 (2010).
60.
HuX.-S.HongK.-S. and GeS.S., “Reduction of trial-to-trial variations in functional near-infrared spectroscopy signals by accounting for resting-state functional connectivity”, J. Biomed. Opt.18, 017003 (2013) doi: http://dx.doi.org/10.1117/1.JBO.18.1.017003
61.
HolperL.KobashiN.KiperD.ScholkmannF.WolfM. and EngK., “Trial-to-trial variability differentiates motor imagery during observation between low versus high responders: A functional near-infrared spectroscopy study”, Behav. Brain Res.229, 29 (2012). doi: http://dx.doi.org/10.1016/j.bbr.2011.12.038
ShinJ. and JeongJ., “Multiclass classification of hemodynamic responses for performance improvement of functional near-infrared spectroscopy-based brain– computer interface”, J. Biomed. Opt.19, 067009 (2014). doi: http://dx.doi.org/10.1117/1.JBO.19.6.067009
64.
MiezinF.M.MaccottaL.OllingerM.PetersenS.E. and BucknerR.L., “Characterizing the hemodynamic response: Effects of presentation rate, sampling procedure and the possibility of ordering brain activity based on relative timing”, NeuroImage11, 735 (2000). doi: http://dx.doi.org/10.1006/nimg.2000.0568
65.
JasdzewskiG.StrangmanG.WarnerJ.KwongK.K.PoldrackR.A. and BoasD.A., “Differences in the hemodynmics reponse to event-related motor and visual paradigms as measured by near-infrared spectroscopy”, NeuroImage20, 279 (2003). doi: http://dx.doi.org/10.1016/S1053-8119(03)00311-2
66.
SzaboA. and GauvinL., “Reactivity to written mental arithmetic: Effects of exercise lay-off and habituation”, Physiol. Behav.51, 501 (1992). doi: http://dx.doi.org/10.1016/0031-9384(92)90171-W
67.
Nunez-PenaM.I. and Suarez-PellicioniM., “Processing false solutions in additions: Differences between high- and lower-skilled arithmetic problem-solvers”, Exp. Brain Res.218, 655 (2012). doi: http://dx.doi.org/10.1007/s00221-012-3058-z
68.
FazliS.DanoczyM.SchelldorferJ. and MullerK.R., “L1-penalized linear mixed-effects models for BCI”, in Artificial Neural Networks and Machine Learning—ICANN 2011, Ed by HonkelaT.DuchW.GirolamiM. and KaskiS.Springer, Berlin, p. 26 (2011).
69.
FazliS.PopescuF.DanoczyM.BlankertzB.MullerK.R. and GrozeaC., “Subject-independent mental state classification in single trials”, Neural Networks22, 1305 (2009). doi: http://dx.doi.org/10.1016/j.neunet.2009.06.003
70.
BiallasM.TrajkovicI.HaensseD.MarcarV. and WolfM., “Reproducibility and sensitivity of detecting brain activity by simultaneous electroencephalography and near-infrared spectroscopy”, Exp. Brain Res.222, 255 (2013). doi: http://dx.doi.org/10.1007/s00221-012-3213-6
