The auricular muscle (AM) is a promising yet understudied candidate for human–machine interfaces (HMIs) with the potential to improve motor functions and expand user capabilities. This study investigates the potential of AM-based control for motor augmentation. We conducted an in-depth neural and behavioral assessment to evaluate the feasibility and effectiveness of AM-based control. Over ten sessions, eight participants engaged in biofeedback and cursor control tasks designed to refine AM contractions and enhance independent muscle control. Our structured training protocol, which divided tasks into simpler subcomponents, facilitated de novo motor learning by combining real-time biofeedback with progressive control tasks. Participants achieved success rates of 86.67 ± 10.00% in coordination tasks and developed effective cursor control strategies while managing concurrent cognitive demands, reflecting their ability to handle increased cognitive loads without compromising performance. Corticomuscular coherence (CMC) analyses indicated a progressive increase in connectivity between the primary motor cortex and the AM, accompanied by a reduction in motor preparation correlates as evidenced by the beta rhythm’s event-related desynchronization (ERD). These findings on CMC and beta ERD support a functional adaptation of the AM for HMI use, demonstrating the potential of AM-based HMIs to augment motor capabilities and provide a new approach to human–machine interfacing.
AbdiEBurdetEBouriM, et al. (2015) Control of a supernumerary robotic hand by foot: an experimental study in virtual reality. PLoS One10(7): e0134501.
2.
AlegreMGurtubayIGLabargaA, et al. (2003) Alpha and beta oscillatory changes during stimulus-induced movement paradigms: effect of stimulus predictability. NeuroReport14: 381–385.
3.
BaroneJRossiterHE (2021) Understanding the role of sensorimotor beta oscillations. Frontiers in Systems Neuroscience15: 655886.
4.
BorzelliDBergerDJPaiDK, et al. (2013) Effort minimization and synergistic muscle recruitment for three-dimensional force generation. Frontiers in Computational Neuroscience7: 186.
5.
von Carlowitz-GhoriKBayraktarogluZWaterstraatG, et al. (2015) Voluntary control of corticomuscular coherence through neurofeedback: a proof-of-principle study in healthy subjects. Neuroscience290: 243–254.
6.
ChanthaphunSHeckSLWinsteinCJ, et al. (2019) Development of a training paradigm for voluntary control of the peri-auricular muscles: a feasibility study. Journal of NeuroEngineering and Rehabilitation16: 75.
7.
ColamarinoEde SetaVMasciulloM, et al. (2021) Corticomuscular and intermuscular coupling in simple hand movements to enable a hybrid brain–computer interface. International Journal of Neural Systems31(11): 2150052.
8.
CrevecoeurFThonnardJ-LLefèvreP (2020) A very fast time scale of human motor adaptation: within movement adjustments of internal representations during reaching. Eneuro7(1): ENEURO.0149-19.2019.
9.
DayanECohenLG (2011) Neuroplasticity subserving motor skill learning. Neuron72(3): 443–454.
10.
DominijanniGShokurSSalviettiG, et al. (2021) The neural resource allocation problem when enhancing human bodies with extra robotic limbs. Nature Machine Intelligence3(10): 850–860.
11.
DominijanniGPinheiroDLPollinaL, et al. (2023) Human motor augmentation with an extra robotic arm without functional interference. Science Robotics8(85): eadh1438.
12.
EspenhahnSRossiterHEvan WijkBCM, et al. (2020) Sensorimotor cortex beta oscillations reflect motor skill learning ability after stroke. Brain Communications2(2): fcaa161.
13.
EspositoDCentracchioJAndreozziE, et al. (2021) Biosignal-based human–machine interfaces for assistance and rehabilitation: a survey. Sensors (Basel, Switzerland)21(20): 6863.
14.
GallegoJAMakinTRMcDougleSD (2022) Going beyond primary motor cortex to improve brain–computer interfaces. Trends in Neurosciences45(3): 176–183.
15.
GreenwellDVanderkolffSFeighJ (2023) ‘Understanding de Novo Learning for Brain-Machine Interfaces’. Journal of Neurophysiology.
16.
HaithAMYangCSPakpoorJ, et al. (2022) De Novo Motor Learning of a Bimanual Control Task over Multiple Days of Practice. Journal of Neurophysiology128(4): 982–993.
17.
Heinrichs-GrahamEArpinDJWilsonTW (2016) Cue-related temporal factors modulate movement-related beta oscillatory activity in the human motor circuit. Journal of Cognitive Neuroscience28(7): 1039–1051.
18.
Herrojo RuizMMaessBAltenmüllerE, et al. (2017) Cingulate and cerebellar beta oscillations are engaged in the acquisition of auditory-motor sequences. Human Brain Mapping38(10): 5161–5179.
19.
HintonDCThielASoucyJ-P, et al. (2019) Adjusting gait Step-by-Step: brain activation during split-belt treadmill walking. NeuroImage202: 116095.
20.
JiangNFallaDd’AvellaA, et al. (2010) Myoelectric control in neurorehabilitation. Critical Reviews in Biomedical Engineering38(4): 381–391.
21.
KielibaPClodeDMaimon-MorRO, et al. (2021) Robotic hand augmentation drives changes in neural body representation. Science Robotics6(54): eabd7935.
22.
KrakauerJWHadjiosifAMXuJ, et al. (2019) Motor learning. Comprehensive Physiology9(2): 613–663.
23.
Leal PinheiroDDominijanniGMaenzaFP, et al. (n.d.) Exploring skill generalization with an extra robotic arm for motor augmentation. Advanced Intelligent Systemsn/a(n/a): 2500086.
24.
LebarNDannaJMoréS, et al. (2017) On the neural basis of sensory weighting: alpha, beta and gamma modulations during complex movements. NeuroImage150: 200–212.
25.
LiuJShengYLiuH (2019) Corticomuscular coherence and its applications: a review. Frontiers in Human Neuroscience13: 100.
26.
LiuganMZhangMCakmakYO (2018) Neuroprosthetics for auricular muscles: neural networks and clinical aspects. Frontiers in Neurology8: 752.
27.
MeinckeJHewittMReischlM, et al. (2018) Cortical representation of auricular muscles in humans: a robot-controlled TMS mapping and fMRI study. PLoS One13(7): e0201277.
28.
MerazNSShikidaHHasegawaY (2017) Auricularis muscles based control interface for robotic extra thumb. 2017 International Symposium on Micro-nanomechatronics and Human Science (MHS), ‘2017 International Symposium on Micro-nanomechatronics and Human Science (MHS), held December 2017, 1–3.
29.
MimaTHallettM (1999) Corticomuscular coherence: a review. Journal of Clinical Neurophysiology: Official Publication of the American Electroencephalographic Society16(6): 501–511.
30.
MoreiraJVda SRodriguesKPinheiroDJLL, et al. (2023) Electromyography biofeedback system with visual and vibratory feedbacks designed for lower limb rehabilitation. Journal of Enabling Technologies, [online] ahead-of-print (ahead-of-print). Available from. https://doi.org/10.1108/JET-05-2022-0039
31.
O’MearaSMShyrMCLyonsKR, et al. (2019) Comparing two different cursor control methods which use single-site surface electromyography. 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER), ‘2019 9th International IEEE/EMBS Conference on Neural Engineering (NER)’. Held March 2019, 1163–1166.
32.
PapaleAEHooksBM (2018) Circuit changes in motor cortex during motor skill learning. Neuroscience368: 283–297.
33.
PariettiFAsadaHH (2017) Independent, voluntary control of extra robotic limbs. 2017 IEEE International Conference on Robotics and Automation (ICRA), ‘2017 IEEE International Conference on Robotics and Automation (ICRA)’. [online] held May 2017. 5954–5961. Available from. https://ieeexplore.ieee.org/document/7989702
Perez-MaldonadoCWexlerASJoshiSS (2010) Two-dimensional cursor-to-target control from single muscle site sEMG signals. IEEE Transactions on Neural Systems and Rehabilitation Engineering: A Publication of the IEEE Engineering in Medicine and Biology Society18(2): 203–209.
36.
PesonenMBjörnbergCHHämäläinenH, et al. (2006) Brain oscillatory 1–30Hz EEG ERD/ERS responses during the different stages of an auditory memory search task. Neuroscience Letters399(1–2): 45–50.
37.
PeterJFerraioliFMathewD, et al. (2022) Movement-related beta ERD and ERS abnormalities in neuropsychiatric disorders. Frontiers in Neuroscience16: 1045715.
38.
PfurtschellerG (1981) Central beta rhythm during sensorimotor activities in man. Electroencephalography and Clinical Neurophysiology51(3): 253–264.
39.
PfurtschellerGGraimannBHugginsJE, et al. (2003) Spatiotemporal patterns of beta desynchronization and gamma synchronization in corticographic data during self-paced movement. Clinical Neurophysiology: Official Journal of the International Federation of Clinical Neurophysiology114(7): 1226–1236.
40.
PinheiroDJLLFaberJMiceraS, et al. (2023) Human-machine interface for two-dimensional steering control with the auricular muscles. Frontiers in Neurorobotics17: 1154427.
ReyesALaineCMKutchJJ, et al. (2017) Beta band corticomuscular drive reflects muscle coordination strategies. Frontiers in Computational Neuroscience11: 17.
43.
Ritterband‐RosenbaumAHerskindALiX, et al. (2017) A critical period of corticomuscular and EMG–EMG coherence detection in healthy infants aged 9–25 weeks. The Journal of Physiology595(8): 2699–2713.
44.
RodriguesKAMoreiraJVda SPinheiroDJLL, et al. (2022) Physiological self-regulation using biofeedback training: from concept to clinical applicability. In: RibeiroPRde ACotaVRBaroneDAC, et al. (eds) Computational Neuroscience. Held 2022 at Cham. Springer International Publishing, 189–214.
45.
de RugyALoebGECarrollTJ (2012) Muscle coordination is habitual rather than optimal. Journal of Neuroscience: The Official Journal of the Society for Neuroscience32(21): 7384–7391.
46.
SchmalfussLRuppRTugaMR, et al. (2016) Steer by ear: myoelectric auricular control of powered wheelchairs for individuals with spinal cord injury. Restorative Neurology and Neuroscience34(1): 79–95.
47.
SchmalfussLHahneJFarinaD, et al. (2018) A hybrid auricular control system: direct, simultaneous, and proportional myoelectric control of two degrees of freedom in prosthetic hands. Journal of Neural Engineering15(5): 056028.
48.
de SetaVToppiJColamarinoE, et al. (2022) Cortico-muscular coupling to control a hybrid brain-computer interface for upper limb motor rehabilitation: a pseudo-online study on stroke patients. Frontiers in Human Neuroscience16: 1016862.
49.
ShokurSMazzoniASchiavoneG, et al. (2021) A modular strategy for next-generation upper-limb sensory-motor neuroprostheses. Médica Sur2(8): 912–937.
50.
SinghHPKumarP (2021) Developments in the human machine interface technologies and their applications: a review. Journal of Medical Engineering & Technology45(7): 552–573.
51.
SuzukiLYMeehanSK (2020) Attention focus modulates afferent input to motor cortex during skilled action. Human Movement Science74: 102716.
52.
De VriesIEJDaffertshoferAStegemanDF, et al. (2016) Functional connectivity in the neuromuscular system underlying bimanual coordination. Journal of Neurophysiology116(6): 2576–2585.
53.
WilliamsMRKirschRF (2008) Evaluation of head orientation and neck muscle EMG signals as command inputs to a human-computer interface for individuals with high tetraplegia. IEEE Transactions on Neural Systems and Rehabilitation Engineering: A Publication of the IEEE Engineering in Medicine and Biology Society16(5): 485–496.
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
