Structural causal relationship and residual adversarial transfer network in small sample data

Abstract

To address the challenge of predicting converter oxygen consumption under small-sample conditions, this article proposes a model that integrates residual adversarial transfer learning with structural causal inference. The model performs adversarial training using a TabResNet feature extractor and a domain discriminator to extract shared invariant features between data-rich source and sample-scarce target domains. Subsequently, the TabResNet extractor is frozen, and its trained parameters – comprising weights and biases of residual BasicBlocks, LayerNorm normalisation layers and linear transformation layers – extract invariant features from the target domain. These features are input into a TabPFN model based on structural causal relationships, enabling one-shot forward prediction using a limited set of target domain features. Experimental results on 4,695 source domain samples (Q195) and 638 target domain samples (Q235) demonstrate that the proposed model predicts oxygen consumption predominantly within 4400–4600 m ${}^3$ . Compared to baseline models, the approach achieves an RMSE of 40.09 m ${}^3$ and ${\mathrm{R}}^2$ of 0.964, facilitating enhanced process control and endpoint determination in industrial steelmaking practice.