Abstract
How many colors are there? Quoted numbers range from ten million to a dozen. Are colors object properties? Opinions range all the way from
It was upon a Sommers shynie day,
When Titan faire his beames did display,
In a fresh fountaine, farre from all mens vew,
She bath’d her brest, the boyling heat t’allay;
She bath’d with roses red, and violets blew,
And all the sweetest flowres, that in the forrest grew.
Sir Edmund Spenser The Faerie Queene (1590)
Book Three, Canto vi, Stanza 6 (our italics).
Introduction
In the aforementioned verse, the author silently assumes that
Colorimetry was created by Maxwell (1855) and von Helmholtz (1855, 1867). It is amazingly successful in putting a formal structure on the possibilities of discrimination of radiant spectral power distribution by a majority of the (human) population.
Remarkably, the formal structure is almost perfectly linear, indicating that it is due to elementary physical processes rather than complicated (and most likely nonlinear) physiological, or even psychological ones. Indeed, the theory is rooted in the physical process of the absorption of photons by three distinct pigments. No neural transformations or psychological processes are involved at that stage. So any properties decided at the earliest stage do not depend on processes at higher stages of the nervous system.
The formalism 1 involves a linear operator 2 (to be determined empirically) acting on the space of radiant power spectra (Centore, 2017; Koenderink, 2010a). The radiant power spectra are parameterized as vectors in an infinitely dimensional Hausdorff space (Arkhangelskii & Pontryagin, 1990), the continuous parameter being wavelength. 3 When two radiant spectra map on the same element, they are equivalent, meaning that they can be mutually substituted for each other without visible effects (Grassmann, 1853). This puts an equivalence structure, a partition, on the domain of the operator. 4 It is the complete formalism of colorimetry. Although formally trivial, it has remarkable predictive power.
Formally, this implies that being mutually equivalent implies differing by an element of the null-space of the linear operator. This null-space is empirically of codimension three (the generic case, covering over 95% of the population), a fact known as
One defines a
Both Maxwell and Helmholtz perfectly understood this; it was axiomatized by Grassmann (1853) in the mid-19th century.
Going beyond this formalism was first attempted by von Helmholtz (1867, 1891, 1892a, 1892b). As is only to be expected, almost any such an excursion away from colorimetry proper involves nontrivial physiology or phenomenology. Consequently,
Perhaps the best known, basic colorimetric structure is the locus of colors defined by monochromatic beams. It is a convex cone 6 with an open sector and can conveniently be represented by the cut with some well-chosen plane. This intersection is a convex arc with the topological structure of a horseshoe, that is, a circle with a gap. 7 This was empirically discovered by Maxwell (who called it a “hook”), and later Helmholtz. 8 In this article, we mainly use an extended construction, specifically targeted at object colors, which is essentially due to Schrödinger (1920).
For practical purposes, one may use the Commission Internationale de l'Éclairage (
Problems With the Colorimetric Formalism
The formalism sketched earlier is indeed perfectly capable to achieve what it was set up for. It allows one to predict whether two radiant spectra will be equivalent to the generic human observer. That is all it can do.
The formalism has led to various counterintuitive predictions, and the formalism yields no handle on phenomenology (Albertazzi, 2013; Albertazzi et al., 2015; Hering,1905–1911; Kuehni, 2004; Munsell, 1905, 1912; Quiller, 1989). A singular exception is the approach by Wilhelm Ostwald (1917, 1919). In Ostwald’s system, colors and canonical spectral reflectance functions exist on equal footing. This is an excellent idea, unfortunately largely ignored today. We will use a similar technique here, although our choice of canonical spectra differs from that of Ostwald.
A perhaps counterintuitive prediction of basic colorimetry is that it allows one to prove that
An interesting interpretation of one formal theorem is that colors (in the phenomenological sense) are not object properties (in the sense of physics). It is indeed possible to design artificial roses, violets, and two radiant sources such that these (fake) roses are red, and these (fake) violets are blue as seen under one source (of fake daylight), whereas the same roses are blue, and the same violets are red under the other source (of another fake daylight). This pertains, even though a (real) daisy would look the same under either fake source, that is, “white,” as it looks under real daylight. Because it is thus visually obvious (the daisy is proof!) that both artificial sources provide
Notice that this is a purely colorimetric/physical fact. It simply exploits the human
Other problems with basic colorimetry have to do with the nature of
It is even more pressing for the object colors, because phenomenologically the most vivid object colors lie on a topological (full!) circle.
14
Thus, there really
The White and Black Objects
Although not strictly colorimetry, there certainly exists a principled way to define
We skip a thorough discussion of phenomenology here. It should be understood that
An obvious definition of a white object would require it to at least scatter all incident radiation
The requirement is by no means sufficient. It would include perfect mirrors and diffraction gratings. A mirror has no color, and the diffraction grating has all colors. A mirror may take on any color, depending on what is reflected in it. A diffraction grating shows different colors as you view it from different directions.
An additional requirement is that a white object should scatter the same beam to the eye, irrespective of where the eye is with respect to the object. This invariance might be taken as a definition of
Technically, this implies that the white object has to be
Although our “white object” is a purely formal one, it is also necessary to have white reference objects in radiometric laboratory practice. In practice, white chalk or blotting paper come close. Pressed baryte (
The definition of the white object is simply
A black object is even simpler to define than the white object. It is a surface that does not scatter any radiation in any direction. Thus, an aperture that opens into infinite empty space (say the clear night sky between stars, “outer space”) would be perfect. Again, this definition is simply
Thus, the realm of object colors readily admits of a number of concepts—such as black and white—that greatly increase the use of colorimetric methods. It imposes fundamental constraints that the colorimetry of radiant beams lacks.
One might attempt to define an achromatic beam phenomenologically as a beam that makes a white object
Colorimetry in the Presence of a Standard Illuminant
Historically, sunlight or average daylight have been intuitively taken as
Hominins evolved in savannah or tundra environments (Gibbons, 2006). We still have a visual system that is optimized for a hunter-gatherer lifestyle in such environments. Average daylight would be the norm.
A colorimetry that might fit the hominin Umwelt would thus center on daylight and natural objects. The objects, recognized as such by vision, would be at least very approximately Lambertian. Indeed, anything not approximately Lambertian would not be a true visual object. In such cases, one might have a process (instead of an object), or have one
Biologically Constrained Colorimetry
A biologically constrained colorimetry focusses on roughly Lambertian objects seen under some variety of daylight. It will be convenient to select a particular standard illuminant. A convenient instance is

The
The selection of a white standard object is less arbitrary. It will have to be a perfect Lambertian surface of unit albedo. One has no choice.
To make a quick start, consider a simplified, standard setup. A number of colored papers—including the white standard—are laid out flat on a tabletop. They are illuminated with a uniform beam, say daylight from an overcast sky. 19
The biological setting introduces ecological constraints that serve to “tame” the counterintuitive traits of pure colorimetry. For instance, it suggests that spectral articulations at arbitrarily fine scales simply will not occur and that correlations between spectral reflectance spectra and irradiance spectra have ecological probability zero. This renders our proof in the Appendix C that colors are not object properties irrelevant. In fact, colors can be shown to be excellent
For colorimetry to be a useful tool in the life sciences, biological relevance is a key requirement. This implies distinct colorimetries for different species. Here, we construct a biologically appropriate colorimetry for the generic human observer.
Colorimetry in the Presence of a Standard Source
Consider a standard source. The source needs to have spectral radiant power over the full visual range. In our examples, we use
Arbitrary Lambertian sources cannot scatter more radiation than the white reference. Therefore, we consider radiant spectra
Geometrically, the realm of such admissible spectra claims an infinitely dimensional
The volumetric region of colors induced by the standard source is the Schrödinger color solid (Figure 2). Schrödinger (1920) proves that the colors on the boundary of the color solid are characterized by the following:

Various Perspectives on the Color Solid for Average Daylight
The spectrum is
The characteristic function
This enables one to compute this object. Its surface is smooth except for singular-edge singularities and conical-point singularities (Figure 2).
In order to find a pragmatic representation, we attempt to construct the largest inscribed crate
21
to the color solid (Koenderink, 2010a). Here,
The crate is unique, as is found by exhaustive search. The solution is a tripartition of the visual range induced by two cut loci:

The Three
where one may take
22
the approximate spectrum limits as

The Skeleton Structure Induced by the Color Solid in
That these formally defined spectra indeed correspond to
Denoting the parts
The domain of the coefficients {
The remaining vertices may be divided into primary and secondary
All the vertices of the

Three depictions of the color solid. At left, the
On mapping databases of natural colors in color space, one finds that typically over 99% lie in the interior of the
Taking the conventional display color nonlinearity (often referred to as gamma correction; Poynton, 1993)
24
into account, the

A Reflectance Spectrum of a Californian Poppy (

The Color Matching Functions. At left, the
The construction of
Colorimetry of Object Colors
Again, the standard setup, that is the simplest possible setting, considers colored papers, laid out flat on a tabletop and illuminated by a uniform source, such as the northern sky, the classical illumination of artist’s studios (Friel, 2010).
Let the object gamut contain a white object. It serves to
Let the radiance of the beam scattered by the white reference be denoted
This forces the object colors to lie in the unit cube
The white object serves to scale for the overall radiance. That is to say the illuminant
An extrapolation of this is to admit spectral variations and uses illuminants
How useful this is, is a matter of empirical investigation. The intuition is that it should work fine for relatively minor variation about the standard illuminant. This implements the
When the spectrum of the illuminant is changed, the color solid itself changes, and the inscribed crate can no longer be the largest one. It will remain very close to that for relatively minor spectral variations, though. Colors might conceivably move in or out of the
How descriptive this model is can only be judged on the basis of variations that remain in the ecologically valid range. Thus, the issue has to be investigated on the basis of statistical models of the generic environment (Koenderink, 2018b).
There can hardly be any doubt that visual systems evolve according to
Ecological Variations
Colorimetry as such has nothing to say about the structure of color space, except that it is a linear space. Color space is just a projection of the space of spectra.
There are two, categorically distinct, ways to explore the metrical structure of color space. One is
Other ways to explore structure is through
The Realm of Illuminants
For diurnal, terrestrial animals, the illuminants are varieties of daylight. Daylight changes with time of day, meteorological conditions, and ambient scattering (Koschmieder, 1925; Schuster, 1905; Strutt, 1899).
Exceptions that we ignore are such radiant sources as the bioluminescence of glowworms, fire light, and so forth. Glowworm light is a vital issue in the glowworm world, even if it is a mere curiosity in ours. Different animals, different realities.
There are two aspects to this: the Umwelt and the lifestyle. The Umwelt contains all the ways the environment can work on the animal. For humans, this includes radiation in the visual band but excludes radio waves. It also includes all the ways the animal can work on the world. For humans, this includes moving stones but excludes generating strong electric fields without assisting technology.
Animals may live in very different Umwelts. The lifestyle involves the use of Umwelt elements in the course of generic actions (von Uexküll, 2010). For instance, the tiger and the lamb have similar Umwelts but very different lifestyles.
The ecologically valid realm of illuminants is evidently the range of daylight spectra. Hominins might have known fire light as a case of secondary importance. Yet it is the daylight—hunting–gathering time—that would have driven their evolution.
and a few more. Because it is awkward to mix databases, we use just a single database from the Kohonen laboratory (Kohonen et al., 2006; examples in Figure 8). It should cover most ecological variation. This database contains 52 radiant spectra.

Some Instances Taken From the Kohonen Daylights Database (Kohonen et al., 2006).
This database may well be slanted toward extreme cases. Anyway, the major influence of the illuminant is by way of spectral slope (color temperature) and (already much less so) spectral curvature. The more or less random component due to environmental factors (Morimoto et al., 2019) hardly plays a quantitatively important role.
The Realm of Objects
The primordial object for the terrestrial, diurnal animal is a volumetric region (its interior not optically revealed) bounded by an opaque, approximately Lambertian scattering surface. Think of a potato. Local surface elements of such objects scatter the same radiant beam to the eye from wherever the animal might be with respect to the object. The large majority of biologically important objects in nature are of this generic type. These include stones, earth, vegetation, animals, and processed things such as roots, wood, bones, meat, fat, and more. Even huge areas in the visual field such as the sky or large expanses of water fall in a different class. Their colors tend to be of little interest when you are hunting, or gathering, for your daily meal.
Common exceptions from our contemporary Umwelt tend to be man-made; think of polished metals. They came into existence after the evolution of hominin vision was already well on the way to its current state. A mirror
It is difficult—indeed, probably impossible—to define an ecologically valid, statistically balanced, generic range of objects. It should certainly include:
A study of spectral reflectance factors suggests that the spectral articulations found in these classes are statistically very similar.
For a start, we select two databases: one on vegetation (Kohonen et al., 2006; examples in Figure 9) and one on mineral pigments.30,31 The vegetation database has 219 items: leaves, stems, flowers, and dry brown leaves. The mineral pigments database has 723 items of mainly classical painter’s pigments in powdered, dry form. After deleting samples with a significant specular component, 651 items are left. We let these represent the “earth colors” as different from the vegetation colors. Perhaps unfortunately, we are missing animal colors. There appears to be no suitable databases in the public domain. A spot check on spectral reflectances of bone, fat, meat, and skin suggests that it would hardly change the picture much, if at all. We feel that we cover the realm sufficiently.

Some Samples From the Finnish Vegetation Database (Kohonen et al., 2006).
Perhaps regrettably, we have no data on the frequency of occurrence or on the relative relevancy for the hunter-gatherer lifestyle. Our choice is likely to overrepresent singular outliers. But perhaps this is not such a great disadvantage. We are likely to obtain a somewhat pessimistic view of the ecological graininess.
Neither database fills the

The Distributions of the Vegetation Database (Left) and the Mineral Pigments Database (Right). These are the colors under the standard source
Figure 10 yields a good illustration of our earlier remark that in practice almost all object colors lie in the interior of the
The Graininess Induced by Illumination Changes
A very straightforward investigation simply puts all objects under all illuminants. Thus, we obtain 52 colors for each object. To streamline the presentation, we summarize these sets by covariance ellipsoids at the 95% level (Figure 11).

The 95% Confusion Ellipsoids Due To the Variation of the Illuminant for the Items in the Vegetation Database (Left) and the Mineral Pigments Database (Right).
We find that the automatic white balance works really well. This perhaps reminds one of results obtained by hyperspectral imaging (Nascimento et al., 2002). Although the illuminants vary over the full daylights database, the various items stick quite close to the location they have when illuminated by the standard source (Figure 10).
The capricious variations of color appearances, noticeable as deviations from
We define the
For the vegetation database, the range for the equivalent radius is
These numbers are in terms of the edge length of the
For the mineral pigments database, the range for the equivalent radius is
The confusion ellipsoids are evidently not isotropic. There is apparently an overall trend, although there is hardly a smooth field on the local scale. One reason for a trend is probably the fact that the daylight spectra differ mainly in one, at most two dimensions (the spectral slope and curvature, the slope being the dominant factor). The more or less abrupt variations are expected. They are doubtless due to the idiosyncrasies of the object spectra. These differ from the corresponding canonical spectra in manifold ways. One expects that taking the metamers of the object spectra into account would tend to smooth things out.
The Additional Graininess Induced by Metamerism
Both conceptually and technically, metamerism poses a problem. It is quite clear what has to be done in principle though, namely:
Given a color, determine the ecologically valid set of (mutually metameric) spectra that will yield this color under the standard illuminant; Determine the color of each of the metamers as seen under all ecologically valid illuminants; Summarize the resulting distribution, for instance, as a covariance ellipsoid; Repeat this for all colors in the
Problems are that the color is not likely to be in the database and that the database will not yield a set of representative metameric instances. For investigations of this type, the existing databases are hugely insufficient. The only way out is to summarize the databases in terms of generative statistical models (Griffin, 2019; Koenderink, 2010b; Koenderink & van Doorn, 2017; Zhang et al., 2016).
Of course, setting up such statistical models is a worthwhile scientific enterprise by itself. It has to be one of the fundaments required in studies of the evolution of the human visual system.
To be able to proceed, we first need to consider some basic complications one immediately runs into in an attempt to implement this program. These mainly involve methods to deal with the nature of the domains. Such methods should not rely solely on formal methods. They need to be rooted in concepts from basic physics.
Dealing With the Nonlinear Constraints
The computational machinery of formal colorimetry is linear algebra. This cheerfully operates with entities that have no possible physical existence. Such entities (such as the elements from the null-space of the color matching matrix) may well represent very useful virtual objects. However, eventually both the input and the output of computations need to represent
Physics introduces a number of constraints on the objects that formal colorimetry works with. In a more positive vein, the physical constraints yield very important structures. The color solid itself is a prime example of that.
Failure to reckon with physical constraints easily leads to erroneous results. A common instance involves nonphysical predictions being “cured” by clipping. Principal components analysis (PCA) is often made to work that way.
It should be recognized when something is fundamentally flawed. Correct methods should make it impossible to
The Nonnegativity of Radiant Power
Radiant power is necessarily nonnegative. An obvious way to deal with this is to consider the logarithm of radiant power (Koenderink & van Doorn, 2017). This is very natural from the perspective of physics. Most interactions involving radiant power are of a multiplicative nature. Another reason is that the fully noninformative Bayesian prior is hyperbolic, therefore uniform on the log scale (Jaynes, 1968, 1973). The general method to deal with the constraint is to use a variety of homomorphic filtering. One maps the radiant power to the logarithmic (one might call it the
In the physical domain, one may use linear methods, as the structure of
Dealing With the Finite (0,1)–Reflectance Range
The domain
The reflectance is ultimately due to optical processes that depend on physical parameters such as absorption and scattering cross sections. Such physical quantities are defined on the nonnegative reals, suggesting that one should identify the appropriate physical domain. This is complicated, because various processes may account for ecologically relevant reflectance factors.
Perhaps the dominant process is well described in terms of the Kubelka–Munk theory (Joshi et al., 2001; Kubelka, 1948, 1954; Kubelka & Munk, 1931) of radiative transfer in layered, turbid media. This applies to papers, paints, and textiles in our present society (Hubbe et al., 2008; Judd & Wyszecki, 1975; Pauler, 2001; Stenius, 1951a, 1951b, 1953; Van den Akker, 1949). Perhaps more appropriately, it equally applies to earth, vegetation, skin, and bones in the hunter-gatherer’s world.
The reflectance depends upon the ratio of the absorption
The spectral signature depends only upon the scattering and absorption cross sections and thus is a true

The Function
The spectral signature is simply related to the reflectance factor of an optically thick turbid layer. The function
That this is generally a good idea is clear when one compares histograms of pixel values in photographs of vegetation (tundra or savannah-like scenes). Although the raw pixel histograms tend to be complicated, often bimodal, the histograms in the physical domain tend to look much more unimodal and symmetric (Koenderink & van Doorn, 2017). It is apparently the more appropriate domain for statistics. This is another instance of homomorphic filtering. In any case, one tries to map from the ecological to some appropriate physical domain.
One may meet with a variety of physical processes. In any specific case, one identifies the most appropriate homomorphic representation. This calls for a broad familiarity with classical physics (Feynman et al.,1964–1966).
Statistical Models of the Illuminant
For the purpose of colorimetry in the context of the hominin Umwelt, the absolute levels of radiant power are largely irrelevant. It is mainly the spectral distributions that count. So the first thing to do is to somehow normalize the individual items, perhaps by shifting them in the physical domain.
All instances are eventually due to sunlight, filtered by the atmosphere and affected by ambient scattered radiation. These are all multiplicative processes that become additive in the physical domain.
Sunlight derives from the sun’s photosphere and is essentially thermal radiation of a
Time of day and height above the horizon are expected to lead to changes of overall slope and perhaps curvature. These are most properly caught by the low-order PCs. Remaining variations are likely to be due to a variety of random causes. These are most appropriately modeled by some fractal signal. There is perhaps something to say for using Planck’s formula for thermal radiation augmented by a low-order polynomial model for the deterministic part. For many applications, that would avoid overfitting. In our application, the microarticulation had perhaps better be retained. They might accidentally correlate with microarticulations in spectral reflectance factors.
The main decision is the level at which the deterministic (PCA) low order should give way to some random fractal. It appears to be the level after the PCs that essentially represent curvature or perhaps cubical structure. This yields a simple model that may serve to generate novel instances of “daylight spectra” (Figure 13).33,34 We use the ensemble mean, a linear combination of the PCs with coefficients generated by a multinormal distribution (using the distribution of projections of the database instances on the PC-basis to define the covariance matrix), and a fractal fuzz. Finally, we transform to the ecological domain.

Chromaticities of a Number of Random Daylight Instances. This convenient (because symmetrical in
The nature of the “fractal fuzz” is estimated from the slope of the power spectrum of the residual structure, after subtracting the PCA approximation.
Statistical Models of the Objects
In this case, the absolute level
To have a rough check, we compute the histograms of spectral radiant power density over the whole vegetation database as a function of wavelength (Figure 14, left). One finds some structure that might well prove specific for the vegetation database. We also find an overall slope (see also Griffin, 2019) that might well have a generic relevance.

Summarized “Spectral Histograms” of the Vegetation Database (Left) and the Mineral Pigments Database (Right). “Summarizing” implies plotting the median and quartile ranges as a function of wavelength. In addition (not shown here), one tests for approximate normality of the distribution as a function of wavelength. (
At first blush, it perhaps looks like an imprint of the chlorophyll absorption spectrum. One way to check this is a comparison with databases of very different materials, say minerals (Figure 14, right). Here, we find the same slope, so the chlorophyll bands, typical for vegetation, are apparently not the issue. It rather is something generic that should at one point receive an explanation in terms of ecological physics. The items from the minerals database have a higher resolution (380–780 nm at 1 nm intervals); moreover. the database volume is larger than that of the vegetation data. As a result, the spectral histogram is less noisy. One notices a well-defined spectral gradient of the spectral signature with wavelength. Notice the similar trends in these very different databases. We have not seen such summaries as in Figure 14 elsewhere (but see Griffin, 2019). They evidently are a must-have in all cases.
The average wavelength dependence probably derives from the size of the microparticles in the granular media, as chemical properties are apparently irrelevant. Particle sizes are in the ten to a hundred micrometers range; thus, neither Rayleigh nor Mie scattering theories apply. The type of analysis that might apply is discussed in Pilorget et al. (2016).
The behavior near the
Because the flower spectra look rather diverse, a generic model might simply be a random fractal. We find the Fourier power spectrum of the spectral articulation (of course, in the physical domain; see Figure 15). It turns out to fall off as the inverse fourth power of frequency in all databases we tested. Thus, a fractal dimension of two seems indicated. This suggests a simple model of the phenomenological optics (see also Griffin, 2019).

The Power Spectrum of the Spectral Articulations of the Vegetation Database (Left) and the Mineral Pigments Database (Right). The frequency is in cycles per visual range. (We let
The spectrum will be the result of various (perhaps many) mutually independent physical causes. Each process will imprint a local structure on the spectrum at some random location. For the present purposes, the spectral width of the local structures is the relevant property. For a start, one considers just a single width and a random, uniformly distributed location. A simple, generic model of this physics is provided in Appendix B (see Koenderink, 2010b; Koenderink & van Doorn, 2017).
The model allows a formal description of the autocorrelation function of the spectral articulation. The formalism relates it to the power spectrum. From the empirical power spectrum, we estimate that the halfwidth of the autocorrelation function is about the width of the visual range (Koenderink & van Doorn, 2017). This implies that natural spectra are not highly articulated. They vary only gradually with wavelength.
This suggests a very simple algorithm to generate instances.36,37 One generates a fractal and adjusts its variance to that encountered in the database. One adds either the database mean, or just a constant slope. Converting from the physical to the ecological domain then yields the instance. As seen in Figure 16, such instances fail to fill the

In Figure 17, we show examples (for clarity only 16 × 16 = 256 samples each) of instance of daylight and object colors generated by the statistical models.

Instances of Daylight Colors (Left) and Object Colors (Right) Generated by the Statistical Models. The daylight colors have been normalized to have the maximum
Generating Metamers
For this investigation, we need to be able to generate arbitrarily many metamers for any given color. This is substantially complicated by the constraint that the metamers should be ecologically valid. Generically, there exist infinitely many mutually metameric spectral reflectance factors that will generate the given color under the standard illuminant. However, the overwhelming majority fails to be acceptable as an ecological valid reflectance. Thus, one needs to design specific methods for this case.
The databases let one generate ecologically valid metamers as linear combinations of random instances. Given three of such instances, one may combine them to yield the given color. The result will be reasonable if the three instances have colors close to that of the given color. Here starts a problem; for the databases, let one find colors only in a part of the
One (partial) solution is to limit the investigation to colors within the convex hull of the database colors. From a pragmatic perspective, this is not even such a bad idea. Colors far outside the convex hull are likely to be irrelevant anyway.
For more formal investigations, a way out of this problem is to generate metamers as metameric variations of canonical spectra. Because there always exists a canonical instance, this is guaranteed to work for all colors. All one needs to do to generate metameric variations is to add random metameric blacks to canonical spectra. Of course, such metameric blacks should themselves be ecologically valid.
One easily generates such metameric blacks by generating four random instances and combining them linearly so as to obtain a black color modulo the amplitude. 38 Unfortunately, this tends to lead to unreasonably large amplitudes near the spectrum limits (Figure 18). 39 It renders the metameric blacks ineffective due to the physical constraints. Because the reflectance should be in (0, 1), the maximum amplitude of a perturbation is limited by that (Figure 19). A simple cure is to use a Hanning window 40 over each of the four instances. This leads to metameric black spectra that have appreciable amplitude in the region that counts and are statistically much closer to the databases (Figures 18 and 19).

Four Random Black Reflectances Without (Left) and Four With (Right) the Use of a Hanning Window. In practice, such apodization is necessary.

These Are Metameric Spectral Reflectance Factors for the Average Gray Color
We construct random metameric reflectance spectra for a given color by adding ecologically valid black spectra to the canonical spectrum. This allows us to reach any point in the
It is a priori clear that colors on the boundary of the color solid are unique, that is, have no metamers. This is because the corresponding spectra have values of either 0 or 1, thus cannot be freely perturbed. For our choice of canonical spectra, this also applies to the boundary of the
The probability density of the metameric black amplitudes is something we do not have access to. We simply use the maximum values; thus, our estimates of the influence of metamerism are certainly overly pessimistic. The examples (Figure 19) of metameric grays reflect that.
The Overall Graininess Due To Ecological Variation and Constraint
In an extensive investigation, we start with any color coordinates, call it the fiducial color. We find its canonical reflectance and perturb it with a random black. Next, we find a random instance of a daylight spectrum. Then, we compute the color and the color of the white reference, and from these, the new color coordinates. These latter will typically differ from the color coordinates we started with. We repeat this a hundred or a thousand times (say) and determine the covariance ellipsoid of the resulting set of colors that surround the fiducial one.
41
In Figure 20, we show an example, a thousand instances at the center of the

A Thousand Samples at Median Gray (Red Points). The bluish ellipsoid is the 95% boundary. This yields a good notion of the nature of the summary description by way of ellipsoidal volumes (bluish volume).
Repeating this procedure for many colors, we obtain a sampling of the field of covariance ellipsoids over color space (Figure 21). This defines the grain due to metamerism for the given ecological constraints. As expected, the confusion regions are larger than in the case of mere illuminance variation (Figure 11). This is due to the inclusion of metameric reflectances. The range of the maximum radius is

The 95% Confusion Ellipsoids in
The mean ellipsoid volume is
The mean ellipsoid volume of
Discussion
The Graininess of Human Color Vision
Psychophysical grain size data show that humans may resolve in the order of 10
6
to 10
7
colors (Pointer & Attridge, 1998). Such psychophysical data are based on just noticeable differences (
In a recent investigation (Koenderink et al., 2018), we had 50 observers synthesize a total of 3,000 randomly selected colors using a color picker (Koenderink et al., 2016). The task made it impossible to rely on a common boundary, or transition region. The observers had to look back and forth between the fiducial and the target that they had to adjust. It was also impossible to compare either fiducial or target to a common background. In such a setting, the errors become
The precise distribution of the covariance ellipsoids found in our study (Koenderink et al., 2018) is not clearly reflected in the calculations (Figure 21). This is perhaps to be expected, as the calculations take no account of ecological or ethological weights. However, the overall magnitudes are in the right ballpark. The difference of three to four decades in size between these ellipsoids and the
The grain induced by ecological variations limits the number of colors that might be used as distinguishing marks under all circumstances to about 10
3
. This seems amply sufficient for most hunter-gatherer needs. Colors as distinguishing marks are really useful in the
Colors as Object Properties
However, colors remain useful labels of things from the ecological perspective. Thus, the biological answer to the question has to be in the
This will be hardly surprising from most people’s intuition. Color is obviously one distinguishing mark that helps deciding between tomatoes and lemons. Perhaps oddly, a scientific backing of this intuition is lacking thus far. Our study solves this issue from a pragmatic, biological point of view—at the same time putting the intuitions of philosophers in the right. Colors are useful distinguishing marks for a hunter-gather existence in tundra or savannah ecologies.
Note that this does in no way imply that colors may not have other biologically important uses. For instance, they are instrumental in the presemantic segmentation of the optic array. For such uses, it is only relevant to be able to mutually distinguish colors, not to be able to identify, or recognize any of them. However, color used this way is not categorical, thus has no relation to colors as
Of course, colors may occasionally fail as distinguishing marks in artificial environments. Las Vegas casinos are a case in point. This is even more so as radiant sources based on rare earths electronic structures become increasingly cheap and widely available.
The philosophical issue is by no means decided by this. Any “solution” will have to shift the formal definition of what counts as an “object property.” From a biological perspective object, properties are distinguishing marks for “things,” affordances that play a role in the agent’s life world.
No distinguishing mark is expected to be decisive in isolation, except—perhaps—in cases of the ethological releasers. An example is the impact of the red of the male stickleback belly for the female stickleback (Tinbergen, 1963). Typically, biological agents use as many distinguishing marks as are available over their various sense modalities. A few tend to suffice to clinch the matter, as smallish, independent
42
probabilities combine multiplicatively. But even a single distinguishing mark may elicit a (possibly vague) anticipation. In biology, “object properties” can be
How many distinguishing marks does one need anyway? If two berries have the same color, you may always consider the habitus of the branch from which they hang. Distinguishing marks are usually used in connection with one or two (independent!) others. Coincidences of relative rare marks soon amount to practical certainty; for small probabilities of mutually uncorrelated instances, multiply.
The metameric variations of “the” color of an object do not find a possible explanation in the agent’s Umwelt. They are due to
There evidently is something fishy about the general, “perfectly conclusive” proof. The reason is twofold. Both source and reflectance spectra are of
In the final instance, this is why human color vision
Outlook to Further Progress
We have outlined a set of methods and a framework that enable one to study the influence of ecological factors on the utility of colors as distinguishing marks of significant objects in the hunter-gatherer tundra or savannah environment. That is the context in which the hominin visual system developed. The methods are fully general and can immediately be applied to any species, not just mammals.
Such methods allow a perspective that has been sadly underrepresented in the literature of (human) color science. For instance, the fact that human observers are able to discriminate over a million colors is enthusiastically cited, but it gains a novel (in-)significance in view of data such as presented in Figures 11 and 21.
The applicability of these methods depends critically upon the availability of relevant databases. Unfortunately, there is not much to choose from, and novel data are not readily forthcoming. One wishes that hyperspectral imaging techniques will change that. This would also yield a possible handle on the ecological/ethological weights. 43 This is a topic that we unfortunately were not able to address.
If the desired data are not forthcoming soon (which appears likely), the only way to progress appears to be the development of generic models of source and reflectance spectra. This appears a definite possibility in view of such findings as shown in Figures 14 and 15. Such models will have to depend upon very generic properties of the physics of the terrestrial environment.
Footnotes
Acknowledgements
The work was conducted at the Department of Electrical Engineering and Computer Science, where Jan Koenderink spent a term as a visiting scholar of the Miller Institute for Basic Research in Science, University of California Berkeley. We thank Florian Bayer from the Giessen Department of Experimental Psychology for the use of the minerals database.
Declaration of Conflicting Interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The work was supported by the DFG Collaborative Research Center SFB TRR 135 headed by Karl Gegenfurtner (Justus-Liebig Universität Giessen, Germany). Jan Koenderink is supported by the Alexander von Humboldt Foundation.
