The spectrum of the thermoacoustic operator is governed by a nonlinear eigenvalue problem. A few different strategies have been proposed by the thermoacoustic community to tackle it and identify the frequencies and growth rates of thermoacoustic eigenmodes. These strategies typically require the use of iterative algorithms, which need an initial guess and are not necessarily guaranteed to converge to an eigenvalue. A quantitative comparison between the convergence properties of these methods has however never been addressed. By using adjoint-based sensitivity, in this study we derive an explicit formula that can be used to quantify the behaviour of an iterative method in the vicinity of an eigenvalue. In particular, we employ Banach’s fixed-point theorem to demonstrate that there exist thermoacoustic eigenvalues that cannot be identified by some of the iterative methods proposed in the literature, in particular fixed-point iterations, regardless of the accuracy of the initial guess provided. We then introduce a family of iterative methods known as Householder’s methods, of which Newton’s method is a special case. The coefficients needed to use these methods are explicitly derived by means of high-order adjoint-based perturbation theory. We demonstrate how these methods are always guaranteed to converge to the closest eigenvalue, provided that the initial guess is accurate enough. We also show numerically how the basin of attraction of the eigenvalues varies with the order of the employed Householder’s method.
Thermoacoustic instabilities can be assessed by solving the inhomogeneous Helmholtz equation
on a prescribed geometry with appropriate boundary conditions.1 In Eq. (1) indicates the complex-valued amplitude of the Fourier transform of the pressure fluctuations (the eigenfunction) and the speed of sound, with the subscripts and indicating the regions upstream and downstream the flame, respectively. The interaction index , which is non-zero only over an acoustically compact volume, and the time delay model the flame response.2,3 Equation (1) defines a nonlinear eigenvalue problem (NLEVP) in the complex frequency . Once discretized, e.g. by means of finite elements, the NLEVP can be expressed in compact form as
where is an large, sparse matrix depending nonlinearly on . Although there exist efficient algorithms to solve generalized linear eigenvalue problems, for which , solving an eigenvalue problem that is nonlinear in the eigenvalue is intrinsically harder.4–6 A typical approach is to transform the NLEVP into a (series of) associated eigenvalue problems linear in the eigenvalue. For example:
NLEVPs that are polynomial in with order can be recast into linear eigenvalue problems of dimension 3;
Solutions of NLEVPs can be found by iteratively solving linear eigenvalue problems resulting from the expansion of (to any desired order) in the eigenvalue6;
Contour integration methods reduce the NLEVP to a linear eigenvalue problem possessing only the eigenvalues of inside a given contour in the complex plane.7,8
These approaches exploit the fact that efficient and robust methods (e.g. Arnoldi) exist for large scale linear eigenvalue problems.9,10A common feature of iterative methods is that they all require an initial guess for the eigenvaluea, which is updated at every iteration. Eigenvalues of the thermoacoustic operator are fixed points of the mapping defined by the chosen iterative algorithm.
According to Banach’s fixed-point theorem11 p. 152, for an iterative algorithm to be able to identify an eigenvalue, the mapping defined by the algorithm needs to be contracting in the vicinity of the eigenvalue. This means that, provided that the initial guess is sufficiently close to an eigenvalue, at each iteration the algorithm will move the guess closer to the eigenvalue, until a prescribed tolerance is reached. On the other hand, if the mapping is repelling in the vicinity of an eigenvalue, it will not be possible to identify this eigenvalue with the chosen algorithm, since a sufficiently close guess will be pushed further away from the solution. An overlooked eigenvalue can have serious consequences in thermoacoustics, as the reliable and accurate determination of all relevantb eigenvalues is of paramount importance to ensure the safe operability of an engine.
The fixed-point iteration method described in3 is a commonly used algorithm for identifying eigenvalues of the thermoacoustic Helmholtz operator – it is used in12–17 to name a few. However, with the exception of a short discussion in,12 there is no reference in the literature investigating the convergence properties of this method in relation to the spectrum of the thermoacoustic operator. The aim of this work is to quantify the convergence properties of fixed-point iteration methods that are commonly used in thermoacoustics. It will be shown that some thermoacoustic eigenvalues cannot be found using a fixed-point algorithm, regardless of the chosen initial guess. We will then introduce an alternative adjoint-based iterative method that has more robust convergence properties and is thus better suited to tackle the thermoacoustic problem.
This study is organized as follows. First the thermoacoustic problem and the fixed-point iteration presented in3 are introduced. An explicit formula that quantifies the convergence properties of the fixed-point mapping is derived. The same procedure is conducted for a so-called Picard iteration, which is another form of fixed-point iteration. Both methods are applied to a generic thermoacoustic test case to demonstrate that some eigenvalues are repellors with respect to these mappings. We will then introduce a class of adjoint-based solution methods known as Householder, of which Newton’s method is a special case. It will be discussed how all eigenvalues of the thermoacoustic operator are attractors with respect to these solution methods, and how the basins of attraction of each eigenvalue vary depending on the order of the Householder’s method used.
The thermoacoustic nonlinear eigenvalue problem
The weak formulation and discretization of the thermoacoustic Helmholtz equation (1) results in an -dimensional NLEVP that reads
The matrices in (3) arise from discretizing the operators in equation (1), viz. the stiffness operator , the mass operator , and the flame operator . The matrix results from the discretization of the boundary conditions needed to close the problem. They can be expressed in terms of the acoustic impedance on all boundaries
where is a unit vector normal to the boundary.
Equation (3) represents a nonlinear eigenvalue problem. The challenge is to find all its eigenvalues – and their corresponding eigenvectors – in a prescribed portion of the complex plane.
Rijke tube test-case
Throughout this study we will employ the classic Rijke tube configuration18 to demonstrate our results. It consists of a straight duct in which a flame is located. Across the flame the temperature, and hence the speed of sound, rise abruptly. The axial flame location is chosen to be in the middle of the tube. The parameters that determine the acoustic response of the system are chosen to be identical to those used in.3 By non-dimensionalizing all quantities using the tube length as a characteristic length and the speed of sound in the cold section of the duct as a characteristic velocity, the chosen Rijke tube’s parameter are , for and otherwise. The boundary conditions are chosen to be acoustically closed () and opened () at the inlet () and outlet (), respectively. The flame model parameters are chosen to be and .
For the range of frequencies that we will consider all transverse modes are cut-off. The problem can therefore be considered as one-dimensional, and the flame to be a point source in the Helmholtz equation (1), . The eigenvalues of this problem can be calculated semi-analytically by using an acoustic network approach.18 By assuming one-dimensional acoustics, equation (1) can be expressed in terms of the Riemann invariants and . With suitable matching conditions at the flame zone and for the parameters introduced above, the acoustic-network eigenvalue problem reads19
where is the acoustic response in the absence of an active flame
and provides the feedback between heat release rate fluctuations and the acoustics
By imposing det the eigenvalues of the Rijke tube can be obtained by using standard root-finder methods. We shall focus our analysis on the properties of the four thermoacoustic eigenvalues found in the region of the complex plane delimited by
which are reported in Table 1. Two of these eigenvalues can be linked to acoustic modes – whose eigenvalues can be calculated by setting , which implies – while the other two can be linked to intrinsic thermoacoustic (ITA) modes – whose frequencies are given by20,21
Eigenvalues of the Rijke tube network model (5) in the considered portion of the complex plane together with the associated acoustic (no flame) and intrinsic (anechoic boundary conditions) eigenvalues from which they stem.
1
2.396–0.262
2.462+0
–
2
4.692+0.304
–
4.712+0
3
6.283+0
6.283+0
–
4
7.874+0.304
–
7.854+0
In the following, we will discretize by finite elements the thermoacoustic eigenproblem (3) and use various iterative solution techniques to identify its eigenvalues. The semi-analytical wave-based solutions presented in Table 1 will serve as benchmarks. The dimensions of the resulting matrix operator do not allow for the use of determinant-based methods, and alternative iterative strategies are needed.
State-of-the-art iterative solution method
A fixed-point iteration to solve the NLEVP (3) was proposed in.3 This algorithm exploits the fact that the problem is quadratic in , except for the heat release term.c The flame operator can therefore be thought of as a perturbation of the underlying purely acoustic problem, which is obtained with . This motivates the use of an iterative strategy, starting from the (known) purely acoustic solutions.
The key idea is to recast the problem into a linear eigenvalue problem of doubled dimension, and then to iteratively identify a thermoacoustic eigenvalue starting from an initial guess. We shall indicate this linear eigenvalue problem as . It reads
On the left hand side, the nonlinear dependency of the problem on the eigenvalue has been removed by freezing the evaluation of the flame operator , i.e, by evaluating at , the eigenvalue guess. This guess is updated by iteratively replacing with the closest eigenvalue of (10), which can be found by means of, e.g., the Arnoldi iteration method. The eigenvector in (10) has been extended into
This can be seen from the first matrix equation defined by (10), which reads . By using this relation, the second matrix equation of (10) reduces to (3) when . The algorithm terminates successfully if the difference between the results of two successive iterations is less than a prescribed tolerance , or is aborted if a predefined maximum number of iterations is reached.
Nicoud’s algorithm
1: function ITERATE()
2:
3:
4:
5:
6: whileanddo
7:
8:
9:
10: end while
11:
12: return
13: end function
The pseudocode for the fixed-point iterative scheme is outlined in Alg. 1. We have denoted with the Arnoldi method that identifies the eigenpair of the linear eigenvalue problem closest to . An initial guess for the eigenvector , if known, may also be provided to the algorithm, in order to improve the convergence of the Arnoldi method. Also note that the matrix is always positive-definite – as it defines a mass matrix – and hence is . Thus, the eigenvalue problem appearing at each iteration, can be solved efficiently.
Fixed-point iteration schemes in thermoacoustics
A single iteration of the procedure described in Alg. 1 defines a mapping for which fixed-points are sought. This fixed-point map can be explicitly expressed by rewriting the eigenvalue problem (10) as
A condition for the convergence of the mapping to an eigenvalue of the thermoacoustic operator is provided by Banach’s fixed-point theorem, which we briefly recall. Consider a bounded domain that contains the fixed-point . Banach’s fixed-point theorem guarantees that has one (unique) fixed-point in as long as is a contraction everywhere in .
For our purposes, we are only interested at the behaviour of the iterative map at the fixed-point. In particular, to know if an eigenvalue is an attractor of a given iterative method it is sufficient to verify that
This in fact implies that the mapping represents a contraction in the vicinity of . Provided that Eq. (13) is satisfied, the eigenvalue can be found if the initial guess lies sufficiently close to it.
Nicoud3 recognized the importance of the contraction properties of , but stated that “[ …] obtaining general results about the contracting properties of the operator from physical arguments is out of reach of the current understanding of the thermoacoustic instabilities.” Significant progress has been made in this direction by the thermoacoustic community in recent years, and tools are now available to quantify the behaviour of the mapping from the thermoacoustic equations. In particular, the contraction properties of the mapping can be quantified by exploiting adjoint-based sensitivity.22,23 In the following, we use adjoint methods to derive an analytical expression that allows us to compute and thus make explicit use of Banach’s theorem.
Contraction properties of the fixed-point iteration
The adjoint equation associated with the mapping (12) reads:
where denotes the complex conjugate of . Its fixed-points are found when . The second matrix equation defined by (14) shows that , so that the extended adjoint eigenvector satisfies
The first matrix equation in (14) defines the adjoint eigenvalue problem .
From adjoint-based sensitivity analysis, the following formula is known for evaluating the derivative of with respect to 22,23:
By combining the known information on the direct and adjoint eigenvectors – Eqs. (11) and (15), respectively – as well as on the functional shape of – Eqs. (12) and (10) – we have
This yields a closed-form expression for the sensitivity of the mapping as required to apply Banach’s theorem:
The mapping sensitivity (18) is generally expected to be non-zero. This implies that, if the fixed-point iteration converges, , then it possesses a linear convergence rate – see Eq. (21).
An alternative fixed-point iteration scheme
The choice of a fixed-point iteration method is not unique. One of the disadvantages of the solution method proposed in3 is that it casts the original problem in an eigenvalue problem having doubled dimensions, which is computationally more expensive to solve. Alternatively, one can perform an iteration in the term of Eq. (3), while the remaining occurrences of the eigenvalues are fixed to . The square root of the eigenvalues of the resulting (linear) eigenvalue problem are then an approximation of the sought eigenvalues. This choice is convenient since the matrix that appears on the r.h.s. of the resulting generalised eigenvalue problem is positive definite, allowing for the use of robust linear eigenvalue solvers. We shall refer to this solution scheme, described in Alg. 2, as Picard iteration.11 p. 154
Picard iteration
1: function ITERATE()
2:
3:
4: whileanddo
5:
6:
7:
8:
9: end while
10: return
11: end function
The Picard iteration defines the mapping given by
By invoking the associated adjoint eigenvalue problem, and by using the adjoint sensitivity Eq. (16), one can show that the sensitivity of the Picard iteration reads
Notably, the only difference with respect to the sensitivity of the fixed-point iteration proposed by3, Eq. (17), is that the matrix is moved to the numerator. However, for the simple boundary conditions considered in this study, one finds that the matrix has non-zero elements only at the open-end boundary, where both and vanish, so that the contribution of the term vanishes.
This is a general result. When considering non-trivial boundary conditions, the convergence properties of the two proposed fixed-point solution methods are going to differ, and one cannot draw general conclusions on which method will be able to identify more eigenvalues a priori. On the other hand, for trivial (open and/or closed) boundary conditions one can show that . Therefore, when considering geometries with simple open or closed boundary conditions, the Picard iteration method should be preferred as a fixed-point iteration scheme since (i) it is computationally cheaper and (ii) has the same contraction properties at the eigenvalues.
Convergence properties of fixed-point iterative methods
Table 2 highlights the contraction properties of the discussed fixed-point algorithm for the four eigenvalues of interest that the problem has when discretized using an equidistant linear finite elements mesh with 127 degrees of freedom. These eigenvalues have been calculated using a higher-order iterative method, described in the next section. This is because, as we will now show, fixed-point methods fail in identifying some eigenvalues. The modeshapes associated with the four eigenvalues are shown in Figure 1.
Modeshapes of the four eigenvalues in the considered portion of the complex plane. The colors orange, purple, blue and green indicate, respectively, the thermoacoustic modes number 1, 2, 3 and 4, as listed in Table 2. Modes 1 and 3 are of acoustic origin, 2 and 4 of ITA origin (see Table 1).
Eigenvalues identified by means of finite elements and values of the contracting operator . Only the eigenvalues for which can be identified, provided that an accurate initial guess is known.
1
2.3960.260
0.519
0.519
2
4.696+0.297
17.025
17.025
3
6.3000.000
0.022
0.022
4
7.880+0.316
12.204
12.204
The sensitivities that the mapping takes at these solutions in Table 2 are then evaluated according to Eq. (18). By comparison with Table 1 one finds that is less than one for thermoacoustic modes of acoustic origin, whereas it is greater than one for modes of ITA origin. This implies that modes of ITA origin cannot be identified with this iterative scheme. Indeed, even if a good initial estimate is known for those, since the iterative algorithm will repel the initial guess from the actual solution. This fact might be partly responsible for the late discovery of modes of ITA origin in thermoacoustics, in particular for annular combustion chambers,21,24 for which larger nonlinear eigenvalue problems need to be solved.
Although a formal proof is not available, the difficulties that the fixed-point iterations have in converging towards some ITA modes can be intuitively explained by the following argument. The matrix in the numerator of (18) is proportional to the flame delay, . Modes of ITA origin tend to have largely negative growth rates, , implying that . Additionally, the eigenvectors of modes of ITA origin (and their adjoint) have a strong magnitude at the flame – see Figure 1 – exactly the zone in which the flame response is large, due to a strong gradient in the pressure modeshapes at the reference position. In combination, these two effects yield a large value of the term , appearing in the numerator of (18). Thus, can be expected for ITA modes. This statement is not expected to hold generally, but only serves to explain the different convergence behaviours of modes of intrinsic and acoustic origin for this specific case. Indeed, per Eq. (18), a different choice of boundary conditions – via complex-valued impedances in or more terms associated with different boundaries – can decrease the value of below unity. When this is the case, then also intrinsic modes could be computed with a fixed-point iteration.
To demonstrate that the fixed-point iterations cannot identify modes for which , we perform a large number of brute-force calculations in the complex plane. We initialize the fixed-point algorithm with initial guesses in the region defined in (8) sampled on a uniform grid. The eigenvectors for the Krylov-subspace methods were initialized with the . We stop the algorithm when a tolerance is reached – an eigenvalue has converged – or when a maximum number of 16 iterations is exceeded – the algorithm does not converge with this initial condition to the desired tolerance. The results are shown in Fig. 2. The axes indicate the value taken by the initial guess, and the color scheme indicates to which eigenvalue the initial guess has converged and how many steps it took. The actual solutions are highlighted with white markers.
Convergence and basins of attractions for (top) the fixed-point iteration described in3 , Alg. 1, and (bottom) the Picard iteration described in this study, Alg. 2. The areas in orange and blue indicate, respectively, the basins of attraction of the thermoacoustic modes #1 and #3, as listed in Table 2. The basin of attraction of mode #1 is hatched with black because, although the algorithm is slowly converging, the convergence rate is very low, and it takes more than 16 iterations to identify the eigenvalue to the prescribed accuracy of . Both methods are unable to identify modes number 2 and 4, of ITA origin. The lighter the color, the less steps are needed for convergence. Gray-black hatched surfaces indicate (slow) convergence towards an eigenvalue outside of the considered domain. Yellow indicates convergence to a (spurious) eigenvalue with .
Brute-force numerical calculations confirm that the modes of ITA origin, #2 and #4 in Table 1, cannot be found by using fixed-point iterative methods, even for guesses that start very close to the actual solutions. The modes of acoustic origin, instead, can be identified. The portions of the complex plane that, when used as an initial guess, converge to modes #1 and #3, are highlighted in orange and blue, respectively. Notably, convergence of mode #1 always requires a number of iterations much larger than those needed for mode #3 to converge. This is in line with the fact that the sensitivity of mode #1, although less than 1, is an order of magnitude larger than that of mode #3. More quantitatively, when , in the vicinity of a solution the number of steps needed to improve the accuracy by an order of magnitude can be estimated by . From the values reported in Table 2, this yields for mode #1 and for mode #3, i.e., the former requires approximately 4 times more iterations than the latter to converge to a predefined tolerance. Within the required 16 iterations limit, the eigenvalue #1 can be identified with a tolerance of . A larger number of iterations is needed to converge to the prescribed tolerance , emphasized by the presence of black stripes in Figure 2. Lastly, in yellow we have highlighted the portion of the complex plane that converges to the eigenvalue. This is always a solution of the thermoacoustic weak form (3), but it represents a spurious solution that does not satisfy the boundary conditions, except when all boundaries are acoustically closed. This spurious solution arises from manipulation of the impedance boundary condition equations when deriving the weak form (3). The fixed-point algorithm proposed by3 and summarised in Alg. 1 strongly promotes convergence towards this spurious eigenvalue because it separates the action of the boundary matrix, , from that of the stiffness and flame matrices, and , as can be seen in Eq. (10).
Together with the higher dimensions of the linearized eigenvalue problem, the promotion of the convergence towards a spurious eigenvalue is another disadvantage of the method of3 in contrast to the Picard iteration (19). Nonetheless, the slow convergence of some modes and the non-convergence of other modes for both fixed-point iterations are inherently linked to their linear convergence rate. To overcome this limitations, we will now consider methods with a super-linear convergence rate.
Newton-like iteration methods
A sequence generated from an iterative algorithm is said to have a rate of convergence if there exists a bound such that
When the contraction condition (13) is satisfied, the iterative fixed-point algorithms described so far converge towards the closest eigenvalue at a linear rate, . However, when one has , the rate of convergence becomes super-linear, with . Importantly, always satisfies Banach’s condition (13), implying that super-linear converging algorithms are guaranteed to converge to all eigenvalues. Super-linear convergence is a feature of Newton’s method, which is therefore more robust than fixed-point methods (0th order), since it uses gradient information (1st order). Gradient information may be included also in a fixed-point iteration by introducing a relaxation parameter25 Appenidx C.4. This procedure is however based on finite difference approximations and requires solving two eigenvalue problems at each iteration. A direct application of Newton’s method is preferable.
Since the eigenvalues of (3) are found when the determinant of vanishes, a direct application of Newton’s method to det leads to
Evaluating the determinant is however a demanding and error-prone operation. A determinant-free Newton scheme was suggested in,26 which exploits Jacobi’s formula
Although this scheme is more robust than a direct evaluation of the determinant, the evaluation of the inverse of the matrix operator becomes prohibitively expensive when has hundreds of thousand of degrees of freedom, as is typical in real-world thermoacoustic calculations.
To bypass these issues, in the following section we will discuss how adjoint-based methods allow us to use Newton’s method directly on the NLEVP equations. This will not require the evaluation of determinants nor matrix inverses, and provides more accurate information on the mapping sensitivity than finite difference approximations.
Adjoint-based Newton iteration
By introducing an auxiliary variable , the NLEVP (2) can be written as
Equation (24) can be thought of as a generalized eigenvalue problem with eigenvalue depending on a parameter . From this viewpoint is an implicitly defined function of , i.e. . If the parameter is chosen such that the eigenvalue problem (24) has an eigenvalue , then (and the corresponding eigenvector ) is a solution of the NLEVP (2). Since the implicitly restarted Arnoldi algorithm is used to solve the sparse eigenvalue problem (24), linear in , choosing the matrix to be semi-positive definite has significant advantages. Possible choices are , the identity matrix, or , the mass matrix. In our analysis the latter will be used, since it naturally arises when discretizing the continuous thermoacoustic operator by means of finite elements. The following discussion on the convergence of the method is however independent from the specific form chosen for .
To find values of for which (24) has a zero eigenvalue in , we seek the roots of the implicit relation . Newton’s iteration on this relation reads
which requires the sensitivity of the eigenvalue with respect to the parameter, . This sensitivity can be obtained by means of adjoint methods. Starting from Eq. (24) it can be shown that the sensitivity of a linear eigenvalue problem is22,23,27
By using this expression, one can iteratively update the parameter in (25) until an eigenvalue is found.
Newton adjoint-based method
1: function ITERATE()
2:
3:
4: whileanddo
5:
6:
7:
8:
9:
10: end while
11: ⊳ This line basically computes the residual for possible later use
12: return
13: end function
The algorithm for the adjoint-based Newton iteration is given in Alg. 3. Note that this method requires solving both the direct and the adjoint problem, which requires a numerical implementation of the adjoint matrix . This may cause difficulties in codes which are implemented in a matrix-free fashion, or in which the direct and adjoint discrete equations are derived independently from the continuous equations, and have different discretizations.33 In our implementationd , the elements of the sparse matrix are explicitly stored. Furthermore, since we employ a Bubnov-Galerkin finite elements discretization, the discretization of the continuous adjoint equation is equivalent to the adjoint of the discretized direct equation, and one can show that .34 As always for mappings obtained from Newton’s method, the mapping defined by (25) has super-linear convergence, i.e. . This guarantees that all thermoacosutic eigenvalues are attractors for this iteration method, and, provided sufficiently good guesses are provided, they can always be identified. This is formally shown in the Appendix.
Householder’s methods
Newton’s method can be generalized by considering higher-order expansions of the relation . The resulting class of iterative root-finding methods are known as Householder’s methods.30 At an arbitrary order the iterative Householder step reads
At first order (), Eq. (27) corresponds to the Newton iteration (25). At second order () one obtains
which is also known as Halley’s method.29 In order to apply higher-order Householder’s methods, the evaluation of high-order eigenvalue sensitivities is required. Once again, adjoint-based theory can be exploited in this regard. By using perturbation theory, explicit formulas for the calculation of arbitrarily high-order sensitivity have been derived in,36 to which we refer the interested reader. For the purpose of this study, we shall assume that a function pert that computes arbitrarily high-order sensitivities is available. With this at hand, the pseudocode for the Householder iterative method is given in Alg. 4, in which the function house computes the Householder update to at the desired order, according to Eq. (27).
Householder’s method
1: function ITERATE()
2:
3:
4: whileanddo
5:
6:
7:
8:
9:
10: end while
11:
12: return
13: end function
Convergence properties of Householder’s methods
By construction, all Houselder’s methods have at the fixed points, implying that all eigenvalues are attractors and have a non-empty basin of attraction. When considering simple roots, the th order Householder’s method has a convergence rate of , meaning that a lower number of iterations in generally required to identify a solution. Yet, these methods are generally not applied to scalar equations because the increase in function evaluations per iteration outweighs the improved convergence rate when the order is increased. This limitation however does not straightforwardly apply to large eigenvalue problems. This is because one needs to weight the computational effort needed for the solution of a linear eigenvalue problem at each step – ruled by the dimension of the problem only – against the one needed to perform all the matrix-vector products needed – which depends on the problem size, but also significantly increases at each perturbation order.36 Thus, for adjoint-based perturbation theory applied on large matrices, computational optimality is ruled by a non-trivial trade-off between the number of iterations needed to converge and the cost of the perturbation method at the chosen order. Numerical experiments have shown (details not reported here) that the Householder’s method of order 3 has, on average, optimal performances (minimum time and memory used) for eigenvalue problems that have a few thousands degrees of freedom.
Degenerate eigenvalues
Special care needs to be taken if the eigenvalue searched for is a multiple root of the characteristic function of , i.e., if the eigenvalue is degenerate. For degenerate semi-simple eigenvalues perturbation theory can still be used to compute the necessary derivatives.32,38 To retain the high convergence rate of Householder’s methods, the scheme must be applied to the th root of , where that is the algebraic multiplicity of the eigenvalue. The th order expansion reads
This however requires a priori knowledge on the multiplicity of an eigenvalue. In thermoacoustic applications, degeneracies with multiplicity 2 are typically induced by symmetries of the system37 and can be often predicted with intuition and/or the use of symmetry breaking criteria.35 In most cases, multiplicities can be removed from the problem by a proper symmetry reduction scheme, such as reduction to Bloch-periodic unit cells.17 Lastly, in case of defective eigenvalues, the adjoint-based schemes presented here cannot be applied, because defective eigenvalues are not analytic in their parameters. However, defective eigenvalues can only appear as isolated points in the parametrized spectrum of 31 and are, thus, not considered generic.
Convergence examples
Figure 3 shows the eigenvalue convergence maps when using Householder’s methods from first order (top) to fifth order (bottom). The tolerance for convergence is set to for all cases. The convergence properties have significantly improved compared to those of the fixed-point methods shown in Figure 2. Indeed, for all considered orders of the Houselder’s method, all the four thermoacoustic eigenvalues in the considered portion of the complex plane can be found. In fact, as predicted by Banach’s theorem for this mapping each mode possesses a non-empty basin of attraction in its vicinity – recall that . Furthermore, the higher the order of the considered Householder iteration, the fewer iteration steps are generally needed to converge to the desired accuracy, as can be seen from the fact that the higher is the perturbation order, the brighter is its figure. This does not necessarily mean a faster convergence time, but it demonstrates the increase in convergence rate, Eq. (21), with an increase in the order of the method . Another notable feature of the Householder’s methods is that the size of the basins of attraction of the ITA modes (purple and green) grows when the order of the method is increased. This implies that, when using a (say) fourth order Householder scheme (fourth row in Figure 3), a coarse grid of initial guesses is sufficient to identify all the eigenvalues of interest. On the other hand for the Newton method (top row in Figure 3), although the basins of attraction of modes of ITA origin are non-empty, they have a small size. A finer mesh of initial guesses is therefore required if the eigenvalues are randomly searched. Higher-order Householder’s scheme suffer, however, from the existence of larger portions of the complex plane within which the method does not converge to any eigenvalues (in black).
Convergence and basins of attractions for the Householder’s methods from first order (top, also known as Newton’s method) to fifth order (bottom). The areas in orange, purple, blue and green indicate, respectively, convergence to the thermoacoustic modes number 1, 2, 3 and 4, as listed in Table 2. Modes 1 and 3 are of acoustic origin, 2 and 4 of ITA origin. The lighter the color, the less steps are needed for convergence. Gray indicates convergence to an eigenvalue outside of the considered domain. Black indicates that the algorithm does not converge with these initial conditions.
All these considerations suggest that a third order Householder scheme is on average the optimal choice, as it provides both faster computational times and possess good convergence properties.
To conclude, we remark that the convergence maps show fractal patterns at the boundaries between different basins of attraction. The fractal nature of the boundaries of attraction (sometimes referred to as Julia sets) is a known feature of Newton-like iteration maps already when applied to scalar equations.28 However, we note how some of the boundaries in Figure 3 are non-fractal. This can be attributed to the fact that we apply Newton/Householder’s methods to eigenvalue problems. Our adjoint-based algorithms require the identification of the smallest eigenvalue of a linear eigenvalues problem to the initial guess (see Alg. 3 and 4). This choice becomes ambiguous when the closest eigenvalue of the linear eigenvalue problem (24) becomes degenerate. This is what happens at non-fractal boundaries, and the clear-cut between convergence to two different eigenvalues when using very close guesses is explained by the fact that our solution method suddenly tracks a different eigenvalue branch of the linear eigenvalue problem.
Conclusions
In this study, we have investigated the convergence properties of the most common methods used to identify eigenvalues in thermoacoustic systems by means of iterative methods. By exploiting adjoint-based sensitivity, we have derived explicit equations that can be used to assess the contraction properties of various algorithms in the vicinity of eigenvalues. Thanks to Banach’s fixed-point theorem, this information is sufficient to know if a given algorithm can or cannot converge to an eigenvalue.
For fixed-point iterations, which are commonly employed in thermoacoustics, we found that not all eigenvalues are attractors. In particular, numerical calculations on a Rijke tube system showed that thermoacoustic modes of ITA origin are repellors. This implies that these eigenvalues can never be identified by fixed-point algorithms, regardless on the accuracy of the initial guess. This may be linked to the late discovery of ITA modes by the thermoacoustic community.
We then discussed how Newton-like iterative methods should always be preferred to fixed-point iterations. This is because they are always guaranteed to converge to all eigenvalues, provided that sufficiently good initial guesses are provided. The most straightforward use of Newton’s method to eigenvalue problems, however, is inefficient, as it requires the evaluation of matrix determinants or inverses, which becomes prohibitively expensive for large matrices. To overcome this issue, we have introduced a set of adjoint-based methods, known as Householder’s methods, which make use of high-order perturbation expansions. We have discussed both the computational efficiency of the algorithms and the dimensions of the basins of attractions of the eigenvalues for these methods up to 5th order. By combining formal results and numerical evidence, we conclude that a third order Householder’s method is, among the methods discussed in this study, the optimal choice for identifying eigenvalues of thermoacoustic systems.
Our results highlight the importance on the choice of the solution methods for thermoacoustic eigenvalue problems. In particular, fixed-point iterations should be always avoided since they do not guarantee the identification of all the eigenvalues, and failure in identifying potentially unstable thermoacoustic modes at the design stage can have very expensive side-effects.
Footnotes
Acknowledgements
The authors would like to thank Jonas P. Moeck and Luka Grubišić for helpful discussions on NLEVPs. A.O. acknowledges the support of the German Research Foundation (DFG), project nr. 422037803.
ORCID iD
Philip E. Buschmann
Notes
Appendix: Super-linear convergence of Newton method
By evaluating the sensitivity of the mapping defined in Eq. (25) we can quantify the convergence properties of this method. We have
where in the second step we have used the fact that, for any thermoacoustic solution, . This proves that the Banach condition (13) is satisfied for all thermoacoustic eigenvalues. Thus, provided a sufficiently good guess, this method converges towards the closest eigenvalue at a super-linear rate, and is able to identify all eigenvalues in the spectrum of the thermoacoustic operator.
References
1.
DowlingAPStowSR. Acoustic Analysis of Gas Turbine Combustors. J Propuls Power2003; 19(5): 751–764.
2.
CroccoL. Aspects of Combustion Stability in Liquid Propellant Rocket Motors. AIAA J1951; 8: 163–178.
3.
NicoudFBenoitLSensiauCPoinsotT. Acoustic Modes in Combustors with Complex Impedances and Multidimensional Active Flames. AIAA J2007; 45(2): 426–441. DOI: 10.2514/1.24933.
4.
MehrmannVVossH. Nonlinear Eigenvalue Problems: a Challenge for Modern Eigenvalue Methods. GAMM-Mitteilungen2004; 27(2): 121–152. DOI: 10.1002/gamm.201490007.
5.
EffenbergerC. Robust solution methods for nonlinear eigenvalue problems. PhD Thesis, École polytechnique fédérale de Lausanne, 2013.
BeynWJ. An Integral Method for Solving Nonlinear Eigenvalue Problems. Linear Algebra Appl2012; 436: 3839–3863. DOI: 10.1016/j.laa.2011.03.030.
8.
BuschmannPEMensahGANicoudFMoeckJP. Solution of Thermoacoustic Eigenvalue Problems with a Noniterative Method. J Eng Gas Turbine Power2020; 142: 031022. (11 pages).
9.
LehoucqRBSorensenDCYangC. ARPACK Users’ Guide: Solution of Large-scale Eigenvalue Problems with Implicitly Restarted Arnoldi Methods. Philadelphia, USA: SIAM, 1998.
10.
SaadY. Numerical Methods for Large Eigenvalue Problems: Revised Edition. Philadelphia, USA: SIAM, 2011.
11.
CiarletPG. Linear and Nonlinear Functional Analysis with Applications. 130. New York, USA: Siam, 2013.
12.
SensiauCNicoudFvan GijzenMvan LeeuwenJW. A Comparison of Solvers for Quadratic Eigenvalue Problems From Combustion. Int J Numer Methods Fluids2008; 56(8): 1481–1487. DOI: 10.1002/fld.1691.
13.
SensiauCNicoudFPoinsotT. A Tool to Study Azimuthal Standing and Spinning Modes in Annular Combustors. Int J Aeroacoust2009; 8: 57–67. DOI: 10.1260/147547209786235037.
14.
WolfPStaffelbachGGicquelLYMüllerJDPoinsotT. Acoustic and Large Eddy Simulation Studies of Azimuthal Modes in Annular Combustion Chambers. Combust Flame2012; 159(11): 3398–3413. DOI: 10.1016/j.combustflame.2012.06.016.
15.
SilvaCFNicoudFSchullerTDuroxDCandelS. Combining a Helmholtz Solver with the Flame Describing Function to Assess Combustion Instability in a Premixed Swirled Combustor. Combust Flame2013; 160(9): 1743–1754. DOI: 10.1016/j.combustflame.2013.03.020.
16.
CampaGCamporealeSM. Prediction of the Thermoacoustic Combustion Instabilities in Practical Annular Combustors. J Eng Gas Turbine Power2014; 136(9): 091504. (10 pages).
17.
MensahGACampaGMoeckJP. Efficient Computation of Thermoacoustic Modes in Industrial Annular Combustion Chambers Based on Bloch-wave Theory. J Eng Gas Turbine Power2016; 138(8): 081502. (7 pages). DOI: 10.1115/1.4032335.
18.
McManusKRPoinsotTCandelS. A Review of Active Control of Combustion Instabilities. Prog Energy Combust Sci1993; 19(1): 1–29.
19.
OrchiniAIllingworthSJJuniperMP. Frequency Domain and Time Domain Analysis of Thermoacoustic Oscillations with Wave-based Acoustics. J Fluid Mech2015; 775(submitted): 387–414.
OrchiniASilvaCMensahGMoeckJ. Thermoacoustic Modes of Intrinsic and Acoustic Origin and Their Interplay with Exceptional Points. Combust Flame2020; 211. DOI: 10.1016/j.combustflame.2019.09.018.
22.
MagriLBauerheimMJuniperMP. Stability Analysis of Thermo-acoustic Nonlinear Eigenproblems in Annular Combustors. Part I. Sensitivity. J Comput Phys2016; 325. DOI: 10.1016/j.jcp.2016.07.032.
23.
OrchiniAJuniperMP. Linear Stability and Adjoint Sensitivity Analysis of Thermoacoustic Networks with Premixed Flames. Combust Flame2016; 165: 97–108. DOI: 10.1016/j.combustflame.2015.10.011.
24.
BuschmannPEMensahGAMoeckJP. Intrinsic Thermoacoustic Modes in An Annular Combustion Chamber. Combust Flame2020; 214: 251–262.
25.
NiF. Accounting for complex flow-acoustic interactions in a 3D thermo-acoustic Helmholtz solver. PhD Thesis, Université de Toulouse, 2017.
26.
JuniperMP. Sensitivity Analysis of Thermoacoustic Instability with Adjoint Helmholtz Solvers. Physical Review Fluids2018; 3: 110509. (43 pages). DOI: 10.1103/PhysRevFluids.3.110509.
27.
GreenbaumALiRCOvertonML. First-order Perturbation Theory for Eigenvalues and Eigenvectors. SIAM Rev2020; 62(2): 463–482.
28.
DevaneyRLBrannerBKeenLDouadyABlanchardPHubbardJHSchleicherD. Complex Dynamical Systems: The Mathematics Behind the Mandelbrot and Julia Sets. Providence, USA: American Mathematical Society, 1994. DOI: 10.1090/psapm/049.
29.
HalleyE. Methodus Nova Accurata Et Facilis Inveniendi Radices Aequationum Quarumcumque Generaliter, Sine Praevia Reductione. Philosophical Transactions1694; 18: 136–148. DOI: 10.1098/rstl.1694.0029.
30.
HouseholderAS. The Numerical Treatment of a Single Nonlinear Equation. New York: McGraw-Hill, 1970.
31.
KatoT. Perturbation Theory for Linear Operators, Grundlehren Der Mathematischen Wissenchaften, 132. Berlin, Germany: Springer-Verlag, 1980.
32.
LancasterPMarkusASZhouF. Perturbation Theory for Analytic Matrix Functions: The Semisimple Case. SIAM J Matrix Anal Appl2003; 25(3): 606–626. DOI: 10.1137/S0895479803423792.
33.
MagriLJuniperMP. Sensitivity Analysis of a Time-delayed Thermo-acoustic System Via An Adjoint-based Approach. J Fluid Mech2013; 719: 183–202. DOI: doi:10.1017/jfm.2012.639.
34.
MensahGA. Efficient Computation of Thermoacoustic Modes. PhD Thesis, TU Berlin, 2018.
35.
MensahGAMagriLOrchiniAMoeckJP. Effects of Asymmetry on Thermoacoustic Modes in Annular Combustors: A Higher- Order Perturbation Study. J Eng Gas Turbine Power2019; 141: 041030. (8 pages). DOI: 10.1115/1.4041007.
36.
MensahGAOrchiniAMoeckJP. Perturbation Theory of Nonlinear, Non-self-adjoint Eigenvalue Problems: Simple Eigenvalues. J Sound Vib2020; 473: 115200. DOI: 10.1016/j.jsv.2020.115200.
37.
MoeckJP. Analysis, modeling, and control of thermoacoustic instabilities. PhD Thesis, TU Berlin, 2010).
38.
OrchiniAMensahGAMoeckJP. Perturbation Theory of Nonlinear, Non-self-adjoint Eigenvalue Problems: Semisimple Eigenvalues. J Sound Vib2021; 507: 116150. DOI: 10.1016/j.jsv.2021.116150.