Abstract
Sodium hypochlorite bleaching washing process has been broadly carried out in denim garment industrial production. However, the quantitative relationships between process variables and bleaching performances have not been illustrated explicitly. Hence, it is impractical to determine values of the variables that can achieve the optimal production cost while satisfying the requirements of customers. This paper proposes an optimization methodology by combining ensemble of surrogates (ESs) with particle swarm optimization (PSO) to optimize production cost of chlorine bleaching for denim. The methodology starts from the data collections by conducting a Taguchi L25 (56) orthogonal experiment with the process variables and metrics for evaluating bleaching performances. Based on the data, the quantitative relationships are separately constructed by using RBFNN, SVR, RF and ensemble of them. Then, accuracies of the surrogates are evaluated and it proves that the ESs outperforms the others. Later, the production cost optimization model is proposed and PSO is utilized to solve it, while a case study is given to depict the optimization process and verify the effectiveness of the proposed hybrid ESs-PSO approach. Overall, the ESs-PSO approach shows great capability of optimizing production cost of sodium hypochlorite bleaching washing for denim.
Keywords
Introduction
Denim garment has gained popularity for a long time, its various styles are mainly created by unique washing techniques in the manufacturing process. The so-called washing techniques can realize “worn” or “vintage” looks on denims by destructing dyes or removing surface fibres.1–3 Over the past few decades, different washing techniques have been developed to create varied designs of denim garments, some normally used applications were summarized by Kan. 4 Among various washing techniques, the sodium hypochlorite bleaching washing, also named as chlorine bleaching, has been applied for a long time, and it still plays a dominant part in industrial production because of fine performances. Some related researches4–6 had indicated the chlorine bleaching effect mainly depends on sodium hypochlorite quantity, temperature and treatment time. However, few previous works constructed a quantitative mapping model between input variables and washing effects, which results in that the trial-and-error method is still extensively conducted in the chlorine bleaching process for denim garment production, and may bring about a great waste of resources in some extent. Besides, production cost reduction is always one of the most interesting topics in industry, lacking quantitative mapping model makes it impossible to determine the optimal process parameters achieving the least cost.
In order to figure out the quantitative relationships between the inputs of process variables and outputs of performances, adopting surrogate models, also named as approximation models, is a promising strategy. Surrogate models, which are constructed by some techniques in the field of machine learning, are utilized to replace analytical models basing on physical or chemical laws that are difficult to gained. In the previous studies, Xu et al. 1 adopted Kriging model to illustrate the effect of enzyme washing parameters on denim fabrics. He et al. 7 separately utilized extreme learning machine, support vector regression and random forest to model the ozonation process of treated dyed textiles, and given the conclusion that SVR would be more recommended. Artificial neural networks (ANN) approach is one of the most commonly used machine learning methods. Hung et al.8,9 adopted ANN to predict colour properties of laser-treated fabrics. Tadesse et al. 10 and Yu et al. 11 applied ANN for comfort of fabrics. ANN were also extensively conducted to evaluate fabric properties12–15 and other aspects in yarn and fabric processes.16,17
The above researches do help to unveil quantitative relationships between process variables and performances in varied textile problems, but how to choose the most appropriate surrogate model for an unexplored engineering problem based on incomplete information is a thorny question. In addition, all of the above-mentioned researches adopted a stand-alone surrogate which can perform well based on the specific problem property and existing training samples, but it cannot guarantee the selected surrogate is still available for other data or problems. In order to overcome the existing shortcomings, this paper integrates three commonly used surrogate models, including random forest (RF), radial basis function neural network (RBFNN) and support vector regression (SVR), to construct an ensemble of surrogates (ESs) to fit the relationship between inputs of chlorine bleaching process variables and outputs of performances, which synthetically integrates advantages of the independent surrogates and balances the prediction abilities under different conditions. In addition, based on the proposed ESs, an optimization model for achieving the least cost in the chlorine bleaching production is developed, and the particle swarm optimization (PSO) algorithm is applied to solve the optimization model so as to obtain the optimal parameter combination. The above two novelties are merged to form a hybrid framework, namely ESs-PSO, that can be applied to reduce production cost in denim garment production. Moreover, in order to prove effectiveness of the proposed hybrid framework of ESs-PSO, verification experiments are conducted and demonstrate it do help to cut costs of chlorine bleaching in actual work.
The rest parts of this paper are organized as follows: In section 2, details of the experimental works for collecting data are presented. In section 3, the proposed hybrid framework of ESs-PSO is introduced. In section 4, the prediction ability of the constructed ESs is discussed, and the parameters optimization for production cost are subsequently demonstrated. Lastly, a conclusion is given in section 5.
Experimental works
Materials and fabric preparation
Indigo dyed denim fabrics consisting of 100% cottons were desized for 15 min in the liquor containing desizing agent (1 g/L) and soda ash (1 g/L) under conditions of material to liquor ratio of 1:30 and temperature 50°C. Specifications of the selected fabric samples are described in Table 1.
Specifications of the denim fabrics.
Procedure of chlorine bleaching
The chlorine bleaching was carried out in an industrial sample washing machine (GX-50, Jun Sheng, China). In the process, material to liquor ratio was settled as 1:30, concentrations of anti-back staining agent (1.0 g/L) and NaOH (2.0 g/L) were fixed. Three critical variables, including concentration of sodium hypochlorite (abbreviated as CSH, 10–50 g/L), temperature (abbreviated as TEMP, 20°C–60°C) and treatment time (abbreviated as TT, 10–50 min), were conducted in varied levels to build data set.
After desired chlorine bleaching, the samples were rinsed two times with clean water. Finally, all of washed samples were dehydrated in a hydroextractor machine at 200 rpm for 4 min and dried up in a steam dryer at 75°C for 20 min.
Measurements of chlorine bleaching performance
Performances of the bleached denim fabrics were measured by colour strength, bending stiffness and tensile strength.
Colour strength, which is usually indicated by K/S value derived from Kubelka-Munk theory, 18 was adopted to evaluate effects of discoloration (realizing ‘worn’ look) caused by chlorine bleaching, and determined by an X-rite Colour I-7 spectrophotometer (X-Rite, USA) in this study. Bending stiffness is a commonly used indicator of assessing fabric style, and it was obtained by stiffness tester (YG522, China) on the basis of ASTM standard D 1388–2008. Tensile strength is an essential component to evaluate wear-ability, which was acquired by performing the strip method according to ASTM standard D 5035–1995. Warp and weft directions of denim fabrics are different due to their 3/1 twill structure and different yarns, so the test method was conducted to identify tensile strength of each sample in warp and weft directions separately. In addition, according to the requirements of the ASTM standard D 1776–2008, all the samples were conditioned at 20°C ± 2°C and at 65% ± 2% relative humidity for 24 h in the laboratory before conducting above-mentioned tests.
Experiment design
In this work, in order to balance between errors and efficiencies of building surrogates, Taguchi method 19 was utilized for generating limited sample points with uniformly space-filling properties. Three critical factors (including TEMP, CSH, TT) were partitioned into five levels to fill the design space, and the adopted L25 (56) with profiles of the performances of 25 chlorine bleaching experiments are listed in Table 2. In addition, two more sample points, which located in the corner of the design space, were gained for further filling to make up for insufficient sampling. Besides, five other points were randomly sampled for verifying the accuracy of the surrogates.
Design of experiments and corresponding performances.
Background of the proposed hybrid framework
The proposed hybrid framework of ESs-PSO is used to purse the optimal cost of chlorine bleaching production. In this section, the details of the framework are explained as follow: Section 3.1 describes the background of the ingredients of the ESs, including RBFNN, SVR and RF; Section 3.2 introduces how to integrate the stand-alone surrogates together; Section 3.3 presents an introduction of PSO; Section 3.4 gives the description of how the proposed ESs-PSO works.
Background of the stand-alone surrogates
Radial basis function neural network (RBFNN)
Radial basis function (RBF) surrogate is one kind of feed forward neural network which utilizes radial basis functions as activation functions. Typical RBF network has a three-layers architecture: an input layer, a hidden layer with RBF activation functions and an output layer. Based on the architecture, the output of RBF surrogate is regarded as a linear combination of some RBFs with weight coefficients and depicted by
where x is a vector of variables, m is the number of neurons in the hidden layer decided by users,
∅(·) refers to RBF and is taken to be Gaussian in this study, thus
where
Support vector regression (SVR)
Support vector regression derives from the principles of support vector machine (SVM) based on statistical learning theory. SVM is commonly used for classifications, it constructs an optimal hyperplane to separate data points into two classes by maximizing the margin between them. SVR also builds a hyperplane, but, in contrast, the constructed optimal hyperplane keeps close to as many data points as possible. A frequently used SVR is
The case of linear regression can be depicted as
where
For nonlinear regression, SVR utilize kernel function
where the kernel function
In this study, RBF kernel was adopted for nonlinear regression, and parameters were optimized by the approach 20 using leave-one-out method.
Random forest (RF)
Random forest is commonly used for regressions, classifications and cluster problems, which is a combination of multiple decision tree predictors depending on values of randomly sampled vectors with the identical distribution. In RF, predictions are conducted by a simple unweighted average over a series of independently grown trees {h(x,Θ k )} as equation (13) shown.
where k = 1, 2, . . ., N is the number of trees, x indicates the input vector, Θ represents the mentioned randomly sampled vector. In the construction of RF, firstly, the algorithm randomly draws ntree bootstrap samples from the data with replacement. Then, the same number of regression trees grow from the root node to the leaf nodes by splitting the data into partitions in the light of the Gini index with the least value:
where
Ensemble of surrogates (ESs)
An ensemble of surrogates synthetically combines the separated stand-alone surrogates in order to balance the prediction abilities under different conditions and improve the generalization ability. For constructing an ESs, the weighted combination is the most frequently adopted method and defined as below:
where
The key in constructing the ESs is to determine weight factors, and the basic principle is that the participant with high accuracy has large weight factor and vice versa. Optimal
where m indicates the number of sample points, m = 27 in this study, and
By combining equations (15)–(17), we can construct an optimization model to obtain the
The optimal
Particle swarm optimization (PSO)
Particle swarm optimization, which was first introduced by Kennedy and Eberhart, 21 has gained great popularity as one kind of the population-based evolutionary optimization algorithms, and has many variants applied in various areas. 22 PSO is originally based on a simplified social model, as a representation of the searching food behaviour in a flock of bird. In this model, each bird is referred as a particle representing a potential feasible solution, and utilized its own memory and information acquired from the swarm to forage for the location of the food (referred as the global optimal solution here). The process of searching for the optimal solution is stochastic in the beginning, and the current position (referred as the fitness) of each particle has been repeatedly updated by velocity vectors and the regions were previously discovered by the swarm until the optimum is found. The outline of a basic PSO algorithm is illustrated in Figure 1 and described as follow:

The flowchart of the basic PSO algorithm.
Initialize a group of particles by randomly distributing the design space.
Calculate velocity vectors of particles in the swarm.
The adopted scheme of calculating velocity vector was introduced by Shi and Eberhart 23 :
where
3. Update position of each particle by utilizing updated velocity vector and previous found position.
The scheme for updating position is as follow
4. Return to step 2 and repeat until convergence.
The proposed hybrid ESs-PSO method
In this section, a hybrid framework consisting of ensemble of surrogates and PSO algorithm (ESs-PSO) is proposed to find out optimal chlorine bleaching cost. The ensemble of surrogates, that integrates RSM, RBFNN and SVR by minimizing GMSELOO, is utilized to construct quantitative relationships between the inputs of bleaching parameters and outputs of performances, and the developed relationships are considered as constrains in the chlorine bleaching cost optimization model, while PSO algorithm is applied to facilitate GMSELOO minimization and optimal cost search. The flowchart of chlorine bleaching optimization procedure is demonstrated in Figure 2 and illustrated as follow:

The flowchart of optimization procedure.
Define the chlorine bleaching optimization problem including objective function, constrains, design variables and corresponding ranges;
Conduct experiments at points generated by Taguchi method to acquire corresponding performances;
Construct relationships by three stand-alone surrogates, including quadratic polynomials, radial basis function neural network and support vector regression;
Create ensembles of the constructed surrogates by using PSO algorithm to minimize generalized mean square leave-one-out errors and obtain the weights of each surrogate;
Check whether the accuracy of the constructed ensembles of surrogates is in the range of the errors permitted or not. If yes, the obtained ensembles can be utilized as constrains for the chlorine bleaching cost optimization, otherwise, go back to Step 3 to adjust parameters of stand-alone surrogates;
Utilize PSO algorithm to seek the optimal cost under the constrains. During the optimization, the value of constrains are predicted by the constructed ensembles.
Output the process parameters under the optimal cost and conduct verifications.
Result and analysis
Performance evaluation
In order to evaluate performances of the proposed ESs, mean relative absolute error (MRAE) is adopted for demonstrating the predictive performance of each surrogate.
where N is the number of samples for the verification,
Five sample points were chosen randomly (as shown in Table 2) and corresponding experiments were conducted for validations.
Comparisons were also conducted for proving effectiveness of the ensemble of surrogates, the components of the ESs, including SVR, RF and RBFNN, that are stand-alone surrogates and commonly used in other researches, are selected for comparisons. In addition, another frequently used stand-alone surrogate in the textile related research, response surface methodology24,25 (RSM), specifically quadratic polynomial in here, is also chosen as the contrast. Table 3 presents the performances of the ESs and stand-alone surrogates in terms of the above evaluation measures, while the best performance in each row is shown in bold italic and the second best one is shown in italic. In addition, Figure 3 illustrates the predicted responses of the ESs and its components versus the observed values.
Prediction performances of RBFNN, SVR, RF, RSM and ESs.
The bold italic entries represent the best performance in each row.
The italic entries represent the second best performance in each row.

Predicted data output by the RBFNN, SVR, RF and ESs versus observed experimental data: (a) K/S, (b) bending stiffness, (c) tensile strength in warp direction, and (d) tensile strength in weft direction.
As can be seen in Table 3 and Figure 3, for the contrasts of RBFNN, SVR and RF, which are components of the ESs, the ESs performed best for most profiles of washing effect besides bending stiffness, which indicates that the ESs approach does largely reduce confusions of selecting appropriate surrogate. The main reason why ESs only obtained suboptimal results for bending stiffness was the RF performed much better that other two stand-alone surrogates, which resulted in that the RBFNN and SVR became drags on the ensemble. However, in the rows of bending stiffness in Table 3, we can find the distinction between MRAE of RF and ESs (RF: 0.0199, ESs: 0.0224) are not statistically significant, in other words, although ESs did not achieve the best, it is still a good choice for predicting. For the contrast of RSM, the ESs also performed better in most situations, while the RSM had a quite good performance in tensile strength in weft direction. This phenomenon just indicates that choosing the most appropriate surrogate model for an unexplored engineering problem is a thorny question, because we cannot know which surrogate will perform best based on the specific problem property and existing training samples. A better solution is to create an ensemble of surrogates which will balance the prediction abilities under different conditions. We also taken an experiment that let RSM take part in the ESs for predicting tensile strength in weft direction, the MARE, MaxRAE and RMSE respectively were 0.0557, 0.0706 and 19.3804, which are better than existing ones (MARE:0.0627, MaxRAE: 0.0843, RMSE: 22.5863).
Because of the good performances of the ESs, the quantitative relationships between process variables and different profiles of washing effect are respectively illustrated by ESs and plotted in Figure 4. From the Figure 4, we can easily find that the changes of all bleaching performances in accordance with the variations of any input variation in the defined ranges, although seldom dramatic fluctuation is existing. However, the influences of each variable on performances of bleaching are different. Hence, analysis of variance (ANOVA) was conducted to depict the main effects of the process variables and demonstrated in Figure 5. The magnitude of the bars presents its degree of influence to the bleaching performances, and the followed values are p-values calculated by ANOVA which provide references for determining whether variables have meaningful effects on results.

Ensembles of surrogates for: (a) K/S, (b) bending stiffness, (c) tensile strength in warp direction, and (d) tensile strength in weft direction.

Contribution rates of the process variables to washing performances: (a) K/S, (b) bending stiffness, (c) tensile strength in warp direction, and (d) tensile strength in weft direction.
From Figure 5, we can find that the influences derived from TEMP on all profiles are the most obvious, and this phenomenon is in accordance with the results achieved in the work of Simpson and Riggs. 6 The main reason of this phenomenon may be that relatively high temperature will promote the hydrolysis reaction of NaClO and produce more ClO- which has strong ability of oxidizing. On the contrary, the treatment time has the least contributions in most situation, which is owing to that the bleaching effects of sodium hypochlorite can last for a long time (up to 16 h or even more), and the most significant effect usually appears after 1 h or later. 6 However, in actual production, long treatment time is not permitted because of the low efficiency, thus TT has less contributions compared with the other two variables in the selected ranges.
Production cost optimization
The final objective of the proposed hybrid framework is to achieve the least cost under the production constrains. The proposed optimization model consisting of an object function and several constraints is presented in equation (24). In the model, the object function is constructed to minimize the total cost caused by variables TEMP xTEMP, CSH xCSH and TT xTT, as shown in equation (24).
where the
It is worth mentioning that all of constrains are nonlinear that are visualized by Figure 5, on the other hand, in actual production, all of variables to be optimized only takes integers or infinite decimals. Therefore, the proposed model in equation (24) should be considered as an integer nonlinear programming problem. In this study, PSO algorithm, which is an effective way to solve such kind of problem, is adopted in the proposed hybrid framework (ESs-PSO). In order to validate the feasibility and effectiveness of ESs-PSO for pursuing the optimal cost of denim enzyme washing, a case study is given in the following section.
Case study
In this case, the ranges of xTEMP, xCCE and xPT were respectively defined as 20°C–60°C, 10–50 g/L and 10–50 min that were the same as the experimental work. According to actual situations in a factory, the
The production cost optimization was completed by PSO, which was coded in MATLAB2019a software. The iteration curve of calculating object function is plotted in Figure 6. The calculated minimum

Iteration curve of object function using ESs-PSO approach.
An experiment was carried out to verify validity of the result generated by the ESs-PSO. An unwashed denim sample was bleached as procedures listed in section 2 with xTEMP, xCSH, xTT adopting 60°C, 38 g/L and 30 min, and the unwashed and bleached samples are shown in Figure 7. After bleaching, colour strength (K/S), bending stiffness, tensile strength in warp and weft directions were test, and results were 9.37, 52 mN cm, 1032.61 N, 318.05 N versus the predicted values by the ESs 10.08, 50.99 mN cm, 994.86 N and 304.74 N, respectively. It is obvious that the bending stiffness, tensile strength in warp and weft directions satisfied technical specifications. The error of the colour strength (K/S) was 6.3%, but it was still in the allowable range. The result of the validation experiment demonstrates that the proposed ESs-PSO approach is effective and can be used to facilitate actual sodium hypochlorite bleaching washing production.

The sample from the verification experiment.
Conclusions
In this paper, a hybrid approach combining ensemble of surrogates and particle swarm optimization is proposed to address production cost optimization of sodium hypochlorite bleaching washing production under conditions of required bleaching performances. The following conclusions can be drawn from the above works:
In most situation, the ensemble of surrogates has better performances, in terms of no matter local or overall accuracies, on approximating the quantitative relationships between process variables and bleaching effects. It proves that adopting ESs can not only reduce confusions of selecting appropriate surrogate, but also take advantages of the sand-alone surrogates to achieve better results for this kind of problem.
It is found that temperature (TEMP) has the most significant contributions to the bleaching performances, in terms of colour strength (K/S), bending stiffness, tensile strength in warp and weft directions, in the defined ranges. By contrast, the treatment time has the least contributions in most situation.
A sodium hypochlorite bleaching washing production cost optimization model is constructed and effectively solved by utilizing the proposed hybrid ESs-PSO approach. Meanwhile, a case study was carried out to prove effectiveness of the methodology. In a word, it demonstrates that the production cost optimization of chlorine bleaching by using ESs-PSO is feasible and the method can be can be used to facilitate actual production.
Footnotes
Declaration of conflicting interests
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding
The author(s) received no financial support for the research, authorship, and/or publication of this article.
