The aim of this paper was to identify the characteristics of memory patterns with respect to a visual input, perceived by the human operator during a manual control task, which consisted in following a moving target on a display with a cursor.
Background
Manual control tasks involve nondeclarative memory. The memory encodings of different motor skills have been referred to as procedural memories. The procedural memories have a pattern, which this paper sought to identify for the particular case of a one-dimensional tracking task. Specifically, data recorded from human subjects controlling dynamic systems with different fractional order were investigated.
Method
A finite impulse response (FIR) controller was fitted to the data, and pattern analysis of the fitted parameters was performed. Then, the FIR model was further reduced to a lower order controller; from the simplified model, the stability analysis of the human–machine system in closed-loop was conducted.
Results
It is shown that the FIR model can be used to identify and represent patterns in human procedural memories during manual control tasks. The obtained procedural memory pattern presents a time scale of about 650 ms before decay. Furthermore, the fitted controller is stable for systems with fractional order less than or equal to 1.
Conclusion
For systems of different fractional order, the proposed control scheme—based on an FIR model—can effectively characterize the linear properties of manual control in humans.
Application
This research supports a biofidelic approach to human manual control modeling over feedback visual perceptions. Relevant applications of this research are the following: the development of shared-control systems, where a virtual human model assists the human during a control task, and human operator state monitoring.
AbbinkD. A.CarlsonT.MulderM.de WinterJ. C.AminravanF.GiboT. L.BoerE. R. (2018). A topology of shared control systems—Finding common ground in diversity. IEEE Transactions on Human-Machine Systems, 48, 509–525.
2.
AnastasioT. J. (1994). The fractional-order dynamics of brainstem vestibulo-oculomotor neurons. Biological Cybernetics, 72, 69–79.
3.
AndersonJ. R.LebiereC. J. (2014). The atomic components of thought. New York, NY: Psychology Press.
BarfieldA.DazzoJ. (1983). Multivariable control laws for the AFTI/F-16. In 22nd Aerospace Sciences Meeting (p. 237). Retrieved from https://arc.aiaa.org/doi/book/10.2514/MASM84
6.
BeallA. C.LoomisJ. M. (1996). Visual control of steering without course information. Perception, 25, 481–494.
7.
BullierJ. (2001). Integrated model of visual processing. Brain Research Reviews, 36, 96–107.
8.
BurdetE.OsuR.FranklinD. W.MilnerT. E.KawatoM. (2001). The central nervous system stabilizes unstable dynamics by learning optimal impedance. Nature, 414, 446–449.
CardS. K.MoranT. P.NewellA. (1983). The psychology of human-computer interaction. Boca Raton, FL: CRC Press.
11.
ChenJ. Y.ThroppJ. E. (2007). Review of low frame rate effects on human performance. IEEE Transactions on Systems, Man, and Cybernetics —Part A: Systems and Humans, 37, 1063–1076.
12.
CliffordC. W.IbbotsonM. (2002). Fundamental mechanisms of visual motion detection: Models, cells and functions. Progress in Neurobiology, 68, 409–437.
13.
CraikK. J. (1947). Theory of the human operator in control systems. I. The British Journal of Psychology. General Section, 38, 56–61.
14.
CraikK. J. (1948). Theory of the human operator in control systems. II. The British Journal of Psychology. General Section, 38, 142–148.
15.
DongesE. (1978). A two-level model of driver steering behavior. Human Factors: The Journal of the Human Factors and Ergonomics Society, 20, 691–707.
16.
GibsonJ. J. (1950). The perception of the visual world. Boston, MA: Houghton Mifflin.
17.
GregoryR. L. (1997). Eye and brain: The psychology of seeing. Princeton, NJ: Princeton University Press.
18.
GriffithsP. G.GillespieR. B. (2005). Sharing control between humans and automation using haptic interface: Primary and secondary task performance benefits. Human Factors: The Journal of the Human Factors and Ergonomics Society, 47, 574–590.
19.
HannetonS.BerthozA.DroulezJ.SlotineJ.-J. E. (1997). Does the brain use sliding variables for the control of movements?Biological Cybernetics, 77, 381–393.
20.
HollingworthA.RichardA. M.LuckS. J. (2008). Understanding the function of visual short-term memory: Transsaccadic memory, object correspondence, and gaze correction. Journal of Experimental Psychology: General, 137, 163–181.
21.
IngaJ.EitelM.FladM.HohmannS. (2018). Evaluating human behavior in manual and shared control via inverse optimization. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2699–2704). Retrieved from https://publikationen.bibliothek.kit.edu/1000089941
22.
ItoK.ItoM. (1975). Tracking behavior of human operators in preview control systems. Electrical Engineering in Japan, 95, 120–127.
23.
JagacinskiR. J.FlachJ. M. (2003). Control theory for humans: Quantitative approaches to modeling performance. Boca Raton, FL: CRC Press.
24.
JürgensohnT. (2007). Control theory models of the driver. In CacciabueC. (Ed.), Modelling driver behaviour in automotive environments (pp. 277–292). London, England: Springer.
25.
KaseS. E.RitterF. E.BennettJ. M.KleinL. C.SchoellesM. (2017). Fitting a model to behavior reveals what changes cognitively when under stress and with caffeine. Biologically Inspired Cognitive Architectures, 22, 1–9.
26.
KawatoM. (1999). Internal models for motor control and trajectory planning. Current Opinion in Neurobiology, 9, 718–727.
27.
KimJ. S.GreeneM. J.ZlateskiA.LeeK.RichardsonM.TuragaS. C.. . . SeungH. S. (2014). Space-time wiring specificity supports direction selectivity in the retina. Nature, 509, 331–336.
28.
MaginR. L. (2006). Fractional calculus in bioengineering. Danbury, CT: Begell House Redding.
29.
Martínez-GarcíaM.GordonT. (2016). Human control of systems with fractional order dynamics. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2866–2871). Retrieved from https://ieeexplore.ieee.org/document/7844674
30.
Martínez-GarcíaM.GordonT. (2018). A new model of human steering using far-point error perception and multiplicative control. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 1245–1250). New York, NY: IEEE.
31.
Martínez-GarcíaM.GordonT.ShuL. (2017). Extended crossover model for human-control of fractional order plants. IEEE Access, 5, 27622–27635.
32.
Martínez-GarcíaM.ZhangY.GordonT. (2016). Modeling lane keeping by a hybrid open-closed-loop pulse control scheme. IEEE Transactions on Industrial Informatics, 12, 2256–2265.
33.
MatignonD. (1998). Generalized fractional differential and difference equations: Stability properties and modelling issues. In Proceedings of the Mathematical Theory of Networks and Systems Symposium (pp. 503–506). Padova, Italy: Birkha’ser.
34.
McRuerD. T.JexH. R. (1967). A review of quasi-linear pilot models. IEEE Transactions on Human Factors in Electronics, 8, 231–249.
35.
MiallR. C.WeirD.SteinJ. (1993). Intermittency in human manual tracking tasks. Journal of Motor Behavior, 25, 53–63.
36.
NacpilE. J. C.WangZ.ZhengR.KaizukaT.NakanoK. (2019). Design and evaluation of a surface electromyography-controlled steering assistance interface. Sensors, 19(6), 1308.
37.
PauwelussenJ. (2012). Dependencies of driver steering control parameters. Vehicle System Dynamics, 50, 939–959.
38.
PewR. W. (2007). Some history of human performance modeling. In GrayW. (Ed.), Integrated models of cognitive systems (pp. 29–44). Oxford, UK: Oxford University Press.
39.
PodlubnyI. (1998). Fractional differential equations: An introduction to fractional derivatives, fractional differential equations, to methods of their solution and some of their applications. Cambridge, MA: Academic Press.
40.
RitterF. E. (n.d.). Modeling human cognitive behavior for system design. In ScatagliniS.PaulG. (Eds.), DHM and posturography (pp. 517–525). Amsterdam, The Netherlands: Elsevier.
41.
RitterF. E.BaxterG. D.JonesG.YoungR. M. (2000). Supporting cognitive models as users. ACM Transactions on Computer-Human Interaction, 7, 141–173.
42.
RitterF. E.TehranchiF.OuryJ. D. (2019). ACT-R: A cognitive architecture for modeling cognition. Wiley Interdisciplinary Reviews: Cognitive Science, 10(3), e1488.
43.
RoigR. W. (1962). A comparison between human operator and optimum linear controller RMS-error performance. IRE Transactions on Human Factors in Electronics, 3, 18–21.
44.
SalvucciD. D.GrayR. (2004). A two-point visual control model of steering. Perception, 33, 1233–1248.
45.
SchmittF.BiegH.-J.ManstettenD.HermanM.StiefelhagenR. (2016). Exact maximum entropy inverse optimal control for modeling human attention switching and control. In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2807–2813). Retrieved from https://ieeexplore.ieee.org/document/7844664
46.
ShinnersS. M. (1974). Modeling of human operator performance utilizing time series analysis. IEEE Transactions on Systems, Man, and Cybernetics, 4, 446–458.
47.
SquireL. R. (2004). Memory systems of the brain: A brief history and current perspective. Neurobiology of Learning and Memory, 82, 171–177.
48.
TejadoI.ValérioD.PiresP.MartinsJ. (2013). Fractional order human arm dynamics with variability analyses. Mechatronics, 23, 805–812.
49.
TustinA. (1947). The nature of the operator’s response in manual control, and its implications for controller design. Journal of the Institution of Electrical Engineers—Part IIA: Automatic Regulators and Servo Mechanisms, 94, 190–206.
50.
WalterW. G. (1964). Contingent negative variation: An electric sign of sensorimotor association and expectancy in the human brain. Nature, 230, 380–384.
51.
WangZ.ZhengR.KaizukaT.NakanoK. (2018). Influence of haptic guidance on driving behaviour under degraded visual feedback conditions. IET Intelligent Transport Systems, 12, 454–462.
52.
WargoM. J. (1967). Human operator response speed, frequency, and flexibility: A review and analysis. Human Factors: The Journal of the Human Factors and Ergonomics Society, 9, 221–238.
53.
WeiszerM.ChenJ.LocatelliG. (2015). An integrated optimisation approach to airport ground operations to foster sustainability in the aviation sector. Applied Energy, 157, 567–582.
54.
ZgonnikovA.MarkkulaG. (2018). Evidence accumulation account of human operators’ decisions in intermittent control during inverted pendulum balancing. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 716–721). Retrieved from https://psyarxiv.com/5yf9d/
55.
ZhangY.Martínez-GarcíaM.GordonT. (2018). Human response delay estimation and monitoring using gamma distribution analysis. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 807–812). Retrieved from https://ieeexplore.ieee.org/document/8616141
