Interpretable machine learning with an eye for the physics: Hyperspectral Vis/NIR “video” of drying wood analyzed by hybrid subspace modeling

Abstract

Chemometric multivariate analysis based on low-dimensional linear and bilinear data modelling is presented as a fast and interpretable alternative to more fancy “AI” for practical use of Big Data streams from hyperspectral “video” cameras. The purpose of the present illustration is to find, quantify and understand the various known and unknown factors affecting the process of drying moist wood. It involves an “interpretable machine learning” that analyses more than 350 million absorbance spectra, requiring 418 GB of data storage, without the use of black box operations. The 159-channel high-resolution hyperspectral wood “video” in the 500–1005 nm range was reduced to five known and four unknown variation components of physical and chemical nature, each with its spectral, spatial and temporal parameters quantified. Together, this 9-dimensional linear model explained more than 99.98% of the total input variance.