Abstract
Visual symmetry perception and symmetry preference have been studied extensively. However, less is known about how people spontaneously scan symmetrical stimuli with their eyes. We thus examined spontaneous saccadic eye movements when participants (
Symmetry preference and symmetry perception are important topics in visual aesthetics and visual science. Ramachandran and Hirstein (1999) noted that artists from all cultures have celebrated the aesthetic value of symmetry. This could have evolutionary origins: Many animals are instinctively attracted to health-signalling phenotypic symmetry in potential mates (Grammer et al., 2003). Likewise, humans are attracted to symmetrical faces (Little et al., 2011) and bodies (Bertamini et al., 2013). Abstract symmetry is also aesthetically pleasing (Jacobsen & Höfel, 2002; Makin et al., 2012; Rentschler et al., 1999). In their review of empirical aesthetics, Palmer et al. (2013) surmised that abstract symmetry preference is robust, although there are interesting individual differences (Leder et al., 2019).
The neural basis of symmetry perception has also been studied (for a review, see Bertamini et al., 2018). Symmetry activates a network of extrastriate visual areas (including the Lateral Occipital Complex) but not V1 or V2 (Sasaki et al., 2005). This extrastriate symmetry response generates an event-related potential called the sustained posterior negativity (SPN; Jacobsen & Höfel, 2003; Makin et al., 2016). The SPN is similar when participants are classifying symmetry or evaluating beauty (Höfel & Jacobsen, 2007).
During normal behaviour, the eyes actively explore the world with a series of purposeful fixations and saccades, bringing objects of interest onto the fovea for detailed visual examination (Findlay & Gilchrist, 2001; Itti & Koch, 2001). However, little is known about how people spontaneously scan symmetry with their eyes. After all, electroencephalogram studies usually suppress eye movements with task instructions and by using small stimuli in the foveal region (Jacobsen & Höfel, 2003). Meanwhile, most symmetry preference studies do not measure eye movements. Some work has documented preferential looking towards symmetry in infants (Bornstein et al., 1981); however, this does not tell us how people scan the symmetrical image itself. Mühlenbeck et al. (2016) presented pairs of symmetrical and asymmetrical images for 3 seconds and found that adolescents (from industrial and non-industrial societies) fixated the symmetrical option for around 180 ms longer on average. This replicates preferential looking towards symmetry in different populations but, again, does not tell us about internal scanning of symmetrical images.
It is tempting to think that people must saccade back and forth across the axis to find spatial correspondences. However, there are three lines of evidence against this. First, symmetry can be detected within 50 milliseconds and thus within a single fixation (Carmody et al., 1977). Second, visual symmetry generates a brain response even when participants are forced to fixate (Makin et al., 2016). Third, gaze is reflexively attracted to symmetrical objects in the periphery, so symmetry detection can
In the current study, we examined spontaneous ocular scanning of vertical and horizontal reflection. We used checkerboard patterns comparable to those used in previous work (Mancini et al., 2005; Royer, 1981). We used relatively large 13.5° × 13.5° checkerboards partly because we wanted any exploratory saccades to be easily detectable with the eye tracker and partly because we wanted high-contrast symmetrical substructures to be visible in the periphery so eye movements were not essential for accurate symmetry discrimination.
We compared saccades during objective classification (symmetry/random) and subjective evaluation (ugly to beautiful). This provides insights into whether the stimuli or task are responsible for observed oculomotor behaviour. This is an important question because aesthetic evaluation may have a distinct oculomotor profile. Berlyne (1971) suggested people can engage in either diverse or specific modes of aesthetic exploration. These modes could result in different saccadic eye movements, for instance, when viewing Mondrian paintings (Plumhoff & Schirillo, 2009).
Our experiment follows several others that have used different tasks or stimuli. Meso et al. (2016) compared saccades during free viewing and orientation discrimination tasks. Their stimuli were black and white dot patterns (23.4° diameter with 512 dots). The dots were either randomly arranged or reflected across an axis with vertical, horizontal, or oblique orientation. Mean eye position remained approximately in the centre. However, there were low-amplitude saccades directed along the axes. The saccades were similar during free viewing and orientation discrimination tasks.
As reviewed in Locher and Nodine (1989), some early studies have found that people often fixate on just one side of symmetrical patterns after the first few exploratory saccades. However, these early studies used large shapes with no central symmetrical texture, so this is likely to be a special case. Indeed, Mühlenbeck et al. (2016) found that humans typically fixated the centre of symmetrical patterns after initial exploratory saccades, while orangutans scanned the whole pattern and its surroundings.
Locher et al. (1993) presented 20° × 20° dot patterns for 20-second intervals. These were vertical reflection, horizontal reflection, or random. Participants judged complexity, pleasingness, or searched for small E-shaped targets (which were not actually present). In complexity and pleasingness tasks, participants tended to fixate vertical and horizontal axes. In the impossible search task, fixations were more evenly distributed across the pattern.
The findings of Locher et al. (1993) and Meso et al. (2016) suggest that our participants will direct saccades along the axes in both tasks. However, this is not a foregone conclusion. Meso et al. (2016) did not examine aesthetic evaluation. Meanwhile, our study differs from Locher et al. (1993) in three crucial ways. First, we examined all saccades over just 3 seconds rather than average fixation locations over 20 seconds. This yields much higher resolution oculomotor behaviour. Second, we compared symmetry discrimination with aesthetic evaluation, while Locher et al. (1993) compared complexity discrimination with aesthetic evaluation. Third Locher et al. (1993) used dot patterns where elements were not visible in the periphery, while we used checkerboards where symmetrical substructures were visible in the periphery. Therefore, our experiment is a necessary extension of Locher et al. (1993) and Meso et al. (2016).
One possibility is that top-down task influences change over time. While the initial saccades could be stimulus driven, some later saccades could be specific to aesthetic evaluation. This is found in other work with art stimuli: Reliable aesthetic judgements about paintings can be made in a single fixation; however, a second stage of exploration can ensure if paintings are sufficiently interesting (Locher, 2015). We therefore separated our analysis into three time windows (0–1 seconds, 1–2 seconds, and 2–3 seconds) to explore the time course of oculomotor behaviour.
Method
Participants
Twenty participants were included (aged 18–27 years, mean age = 23.5 years, 5 male, and 1 left-handed). All participants had normal or corrected-to-normal vision. The experiment had local ethics committee approval. The participants were undergraduate and postgraduate students at the University of Manchester.
Apparatus
The experiment was programmed in Python using PsychoPy 1.82 libraries (Peirce, 2007). The experiments are available on
Stimuli
Patterns were a 10 × 10 checkerboard with 40 black and 60 white checks (Figure 1). The checkerboard was approximately 13.5° × 13.5° of visual angle. On each trial, a novel checkerboard was created using the same algorithm. On random trials, both sides were constructed independently. On reflection trials, one half was mirrored.
Trial Structure in Classify and Evaluate Tasks.
Procedure
There were 80 trials in the Classify task and 80 trials in the Evaluate task. Of these, 40 trials were random, 20 were vertical reflection, and 20 were horizontal reflection (Table 1). Each trial began with a fixation cross presented for 1 second (Figure 1). For the following 3 seconds, the pattern was on the screen (as in Meso et al., 2016). In the Classify task, participants used the mouse to classify the patterns as “reflection” or “random” (the left–right positioning of these options was balanced between trials). In the Evaluate task, they used the mouse to rate the patterns on a 0 to 100 analogue scale. The extremes of the scale were labelled as “Ugly” (left) and “Beautiful” (right). Task order was counterbalanced, so half of the participants completed the Classify task first, and the other half completed the Evaluate task first.
Saccade Descriptive Statistics.
The tasks were explained by the experimenter (A. D. J. M.), and the participants were presented with onscreen instructions. In the Classify task, instructions read, “please indicate if the patterns were symmetric or random.” In the Evaluate task, instructions read, “please indicate how much you like the patterns.” There was no practice block because the tasks were very intuitive. The experimenter was in the same lab area operating the eye tracker and could help if participants were uncertain about the tasks. The experimental session lasted approximately 30 minutes.
Saccade Analysis
Saccades where amplitude exceeded 0.5° were identified automatically with
Saccade Rate. (A) Diagram of vertical bands, horizontal bands, and corner zones superimposed on example patterns. (B) There were more saccades in the vertical band when the axis of reflection was vertical (red diamonds). Saccade rate in the vertical band decreased across the three intervals (rows). (C) There were more saccades in the horizontal band when the axis of reflection was horizontal (green diamonds). Saccade rate in the horizontal band decreased across the three intervals. Insets show band bias (e.g., diamond elongation) in the reflection conditions. Error bars = 95% CI. (D) The number of saccades which either started or ended outside these bands, in the corner zones, increased across the three intervals. Mean saccade rates in Classify and Evaluate tasks are shown in blue text (saccades per trial).
Table 1 shows descriptive statistics of the saccades in six conditions: 2 Task (classify, evaluate) × 3 Stimuli (random, vertical, horizontal). It can be seen that eligible saccade rate was consistent across the conditions (at 2.41 to 2.66 Hz).
For repeated measures analysis of variance, the Greenhouse–Geisser correction factor was used when the assumption of sphericity was violated (Mauchly’s test
Results
Behavioural Ratings
In the Classify task, performance was near ceiling (mean correct random = 98%, vertical 94%, horizontal 95%). In the Evaluate task, there was a significant effect of Regularity on mean preference ratings—random = 31.33/100, vertical = 62.21, horizontal = 57.65,
Saccade Rate
Figure 2 shows saccade rate from three time intervals (0–1 seconds, 1–2 seconds, and 2–3 seconds post stimulus onset) and three spatial regions (vertical band, horizontal band, and corner zones). It can be seen that participants tended to orientate saccades along the vertical or horizontal axis of reflection when it was present in the stimuli. However, this oculomotor behaviour became less frequent towards the end of the trial. Conversely, saccades touching the corner zones became more frequent towards the end of the trial. These saccades rate metrics were similar in the Classify and Evaluate tasks.
Figure 2B shows the distribution of saccades that fell within the
Figure 2C shows the distribution of saccades that fell within the
Figure 2D shows the distribution of saccades that fell outside these bands that either started or ended in the
We first analysed saccade rate in the three Zones (vertical band, horizontal band, and corners) and the three Intervals (0–1 seconds, 1–2 seconds, and 2–3 seconds) and two Tasks (Classify and Evaluate), collapsing across factors Regularity (random, vertical, and horizontal) and Saccade Direction (up, down, left, and right). This analysis confirms impressions about the
To examine the effect of axis orientation on saccade direction, we computed a metric called “band bias” from each participant and condition:
The expected effect of axis orientation on band bias was confirmed by a significant Band × Axis interaction,
Saccade Amplitude
Figure 3 illustrates saccade amplitude. The trend for higher amplitude saccades in the Classify task was not significant,
Saccade Amplitude. The conventions are the same as Figure 2 but show mean saccade amplitude (in °) rather than saccade rate. The mean saccade amplitude in Classify and Evaluate tasks are shown in blue text in each panel (in °).
Unsurprisingly, vertical saccade amplitude was greater in the vertical band, and horizontal saccade amplitude was greater in the horizontal band. Interestingly, this band bias was enhanced by axis orientation
Finally, we examined the standard deviation (SD) of saccade amplitudes across trials. Although saccade amplitude is sometimes more variable during aesthetic evaluation (Plumhoff & Schirillo, 2009), there was no evidence for this in our experiment (main effect of Task on SD;
Discussion
Our results replicated Meso et al. (2016) with different stimuli and tasks. Relatively small saccades (mean amplitude approximately 2.4°, or 2 checkerboard elements) were disproportionately directed along the axes of reflection, particularly during the early part of the trials. Later, participants made more high amplitude saccades into the corner zones (mean amplitude ∼3.8°).
This oculomotor behaviour was broadly similar in objective classification and subjective evaluation tasks. This parallels earlier work from Locher et al. (1993), who found people preferentially fixate horizontal and vertical axes, both when judging complexity and pleasingness (although not during an impossible visual search task). Therefore, there was no distinct oculomotor signature of aesthetic evaluation, even though our participants had the typical preference for symmetry (Jacobsen & Höfel, 2002; Makin et al., 2012; Rentschler et al., 1999). Aesthetic evaluation of paintings may sometimes involve specific modes of oculomotor exploration (Locher, 2015; Plumhoff & Schirillo, 2009); however, this was not apparent with our simple checkerboards. In summary, saccades were determined by bottom-up stimulus factors more than top-down task factors. With other Stimuli × Task combinations, there would likely be a more complicated interplay between the two (Locher et al., 1993). We also note that members of other cultures, and particularly other species, may not scan symmetry in the same way (Mühlenbeck et al., 2016).
Let us consider why participants scan the axis of reflection with exploratory eye movements when symmetry can already be discriminated during a single fixation (Carmody et al., 1977). By moving the eyes along the axis, the visual cortex receives several alternative images of the symmetry in quick succession. It is known that rapid presentation of different symmetrical exemplars enhances discrimination performance (Sharman & Gheorghiu, 2017) and enhances SPN amplitude (Bertamini et al., 2019). By moving the eyes along the axis, the same dynamic enhancement effect could be achieved from
While symmetry can be discriminated within 50 milliseconds, performance on psychophysical tasks improves when stimulus duration is increased up to 1,000 milliseconds (Tyler et al., 1995). This improvement with presentation time could be due to the putative dynamic oculomotor enhancement effect. Furthermore, even if fixation is required, covert shifts of attention could achieve a similar enhancement.
The current work also tells us something about the time course of symmetry perception and evaluation. Axis scanning was concentrated in the first second, and saccades were elongated only along the axes in the first second. This suggests all perceptual advantages gained by axis scanning can be obtained within 1 second, so participants are free to examine novel substructures in the corner zones thereafter.
There is some similarity between the observed axis-scanning behaviour and hypothetical symmetry perception mechanisms. For instance, the
There are four limitations with this study. First, participants may have anticipated the response screen during the presentation interval, and this could have differentially biased their eye movements in Classify and Evaluate tasks. However, given that saccades were more influenced by bottom-up stimulus factors than top-down task factors, we do not think this complicates our conclusions. Second, our decision to block rather than interleave the Classify and Evaluate trials could have been consequential. However, blocking is likely to have maximized any existing task effects, and we still found intertask similarity nevertheless. Third, we cannot be sure that conclusions generalize beyond checkerboard stimuli. However, given that comparable axis scanning with dot patterns was found by Locher et al. (1993) and Meso et al. (2016), this is likely a general phenomenon. Future work could measure scanning of rotational symmetry or glass patterns and vary stimulus size systematically. Fourth, there were some unexpected weaker effects reported in Supplemental Material. However, some of these may be false positives. Importantly, the bottom-up effects driven by axis orientation were much more robust than any top-down effects driven by task.
Conclusion
We have shown that people spontaneously make saccades along the axis of reflection. This oculomotor behaviour replicates previous work, and we found that the same behaviour occurs during aesthetic evaluation. It could be that the extrastriate symmetry response is boosted by saccade-driven updates of the retinal image, and this aids both objective and subjective judgements.
Footnotes
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: This project was part funded by an Economic and Social Research Council grant award to Alexis Makin (ES/S014691/1).
