The second and the third sentences of the abstract are changed and the shorter abstract is given as follows. To recover the nonstationary signal in complicated noise environment without distortion, a novel general design of fractional filter is proposed and applied to eliminate the Wigner cross-term. A time-frequency binary image is obtained from the time-frequency distribution of the observed signal and the optimal separating lines are determined by the support vector machine (SVM) classifier where the image boundary extraction algorithms are used to construct the training set of SVM. After that, the parameters and transfer function of filter can be determined by the parameters of the separating lines directly in the case of linear separability or line segments after the piecewise linear fitting of the separating curves in the case of nonlinear separability. Without any prior knowledge of signal and noise, this method can meet the reliability and universality simultaneously for filter design and realize the global optimization of filter parameters by machine learning even in the case of strong coupling between signal and noise. Furthermore, it could completely eliminate the cross-term in Wigner-Ville distribution (WVD) and the time-frequency distribution we get in the end has high resolution and good readability even when autoterms and cross-terms overlap. Simulation results verified the efficiency of this method.
1. Introduction
With the flourishing development of time-frequency () analysis theory, nonstationary signal analysis and process technology have stepped into a new stage [1–3]. In particular, the emergence of fractional Fourier transform (FrFT) and the unified understanding of the domain provide a novel idea for filter design [4, 5].
In 1980, Namias first introduced the concept of fractional-order Fourier transforms from a mathematical point of view in [6]. Then, Almeida discussed the FrFT's relationships with the Wigner-Ville distribution (WVD) and other representations, which make a very simple and natural form and further enhance its interpretation as a rotation operator [7]. Using the above properties, FrFT could be adopted in filter design in order to achieve the optimal detection and parameter estimation of nonstationary signals and filtering of some forms of interferences and noises [8–10]. Some fractional Fourier domain optimal filtering algorithms based on the minimum mean-square error were presented in [11, 12], and Lin et al. proposed a discrete algorithm of the Wiener filtering operator on the fractional Fourier domain [13]. However, all the above algorithms are just the generalized forms of filter in the time (frequency) domain that need the prior statistical knowledge of observing signals and noises and simply be limited to a single rotation angle. Erden et al. designed a multi-iterative filtering on different order based on the additivity of rotations of FrFT [14], whose complexity is very high and the iterative process cannot guarantee convergence to the global optimal solution. The work in [15] determined optimal order and the transfer function of the filter by using transform and converted the fractional filter to a separating line in the plane. This method provided a useful solution in filter design, though no specific design is proposed.
In this paper, a novel fractional filter design is proposed and applied to eliminate the Wigner cross-term. According to the similarity between the plane and 2D image, the edges of signals and noises could be obtained and are used to acquire the parameters of optimal separating lines between different components by support vector machine (SVM), which is the key of the Fourier filter design. This method realizes the global optimization of filter parameters by machine learning and needs no prior knowledge of signals and noises, which can meet the reliability and universality simultaneously for filter design. The remainder of this paper is organized as follows. In Section 2, the principle of FrFT and fractional filter design is introduced. In Section 3, the details of the determination of separating lines on plane are given. For the case of linearly inseparable signal and noise, a piecewise linear fitting algorithm is used and the multiorder filter bank is designed with the parameters of each segment in Section 4. After that, Section 5 presents a method to eliminate the cross-term effect in WVD based on the above design of fractional filter. Finally, simulation results are explicated in Section 6 and the conclusion is stated in Section 7.
2. Principle of Fractional Filter Design
2.1. Fractional Fourier Transform
The pth FrFT of signal is defined as a linear integral transform with kernel :
where
Note that the u domain is generally known as the fractional Fourier domain which makes the angle with the time domain and it is just the time (frequency) domain when (). The discrete fractional Fourier transform (DFrFT) adopted in this paper is Pei sampling fast algorithm which has the closed-form analytic expression and can be efficiently calculated by fast Fourier transform (FFT) [16].
2.2. Fractional Filter Design
It is known that we can use FrFT for filter design, as follows:
where is the input signal, is the output signal, and is the filter transfer function. Here, the selections of transformation order and cutoff criteria are two important issues regarding the filter design in the u domain.
As a fact, the FrFT filter as shown in 3 is equivalent to a separating line in the time-frequency plane, which could remove the components on one side of and those on the other side are preserved [15]. Assume that the separating line is
Then, the transformation order p could be determined by the slope k and the cutoff frequency equal to the distance from the origin of the separating line where the coordinate transformation formulas are
Here, for , for or for , for , depending on which part the noise is.
For more conventional signal distribution, the noise and the desired signal are in such a shape that we cannot find a single rotated coordinate system where we can completely eliminate the noise term from the signal. Thus, series of rotation of the coordinate system are needed and 3 may be generalized into a filter bank with consecutively changing orders:
Furthermore, in the case where the distributions of noises and signals do not overlap in the plane, noises will be eliminated successfully by the filter designed by 6 as long as the transformation orders are chosen properly. However, in the case of distributions overlapping, the filters may be selected in order to minimize the mean-square error.
3. The Determination of the Optimal Separating Lines on the Time-Frequency Plane
From the above analysis, it can be seen that the option of the separating line is nonuniqueness. Hence, how to find an optimal solution is the key to the filter design. In this paper, SVM classifiers, which often have superior recognition rates in comparison to other classification methods, are used to solve the parameters of the optimal separating lines in the plane. At first, the data model of the optimal classification problem is built by transformation. Then, in order to construct the training set, an image boundary extraction algorithm is adopted. After that, the parameters of the optimal separating line could be obtained by using SVM either in linear separability or in nonlinear separability.
3.1. Time-Frequency Image Representations
In order to locate signal and noise components in the plane accurately, the distribution of the observed signals should be achieved at first. The transformation in this paper should have a rotation relation with the FrFT, which is the essential foundation of the filter design in the u domain. It is known that the classical transformation such as the Gabor transform (GT), the WVD, and the ones derived from them such as the smoothing pseudo WVD (SPWVD) and the Gabor-Wigner transform (GWT) all satisfied the above property and their expressions are shown as follows:
The GT is considered as an example here to interpret the similarity between the plane and the 2D image. In the practical applications, the plane is represented in a Gabor coefficient matrix which is obtained by the discrete GT for the samples of limited length signal and the element () in the mth row and the nth column shows the distribution strengthen of observed signal at the point in the plane whose coordinates are (). Obviously, the plane is similar to a gray image so that each point corresponds to a pixel in the image and an image, which consists of three parts: signal areas, noise areas, and background, is obtained. Multidiscrete highlight energy concentration areas represent several signal and noises components that exist simultaneously and one of the most direct and effective way of separating these components is according to the edge of these highlight areas. As a result, the edges of these signals and noises, which could be detected by the boundary extraction technology, are suitable for the construction of the training set of SVM classifier.
3.2. Image Boundary Extraction in Time-Frequency Domain
As mentioned above, as a plain gray image, there are only several discrete highlight areas in the image and their edges are just some closed curves. Hence, by selecting the threshold reasonably, we can convert the gray image to its binary counterpart without losing useful information and the image boundaries could be obtained by edge extraction and thinning and smoothing algorithms, as shown in Figure 1(a). Then, all the edge pixels are coded in the binary image with integer numbers in sequence, from left to right, and then from top to bottom, so that pixel with small coordinate values could corresponds to a sole small integer number, as presented in Figure 1(b). After that, the given label number of each edge pixel with the numbers of the pixels in their eight neighborhoods is compared (the default label numbers of pixels which are not on the edge is zero) and the minimum value of these nine pixels is selected as the label number of the edge pixel, which is shown in Figure 1(c). However, though the label numbers of pixels that belong to the same edge are the same, there is no consequence among these labels of different edges. Hence, arrange these labels in sequential order and replace them by the sequence number in order to facilitate the edge selection. As can be seen, the edge labels are the numbers in the bracket of Figure 1(c).
The diagram of edge labeling (a) the binary image; (b) the label numbers of pixels; (c) the edge labels.
Considering the presence of false edges, sort all edges in descending order according to their length and select the first n edges where n is the total number of the noise and signal components because the false edges are always much shorter than actual edges. Then, the middle-value of the abscissa intersection of arbitrary two mutually coupled edges is calculated and the corresponding average f-values of these edges are obtained where the larger f-value corresponds to the larger label edge, as shown in Figure 2(a). The above operation is repeated until all edges are placed in order where an example is presented in Figure 2(b). Now, the adjacency of all n edges is obtained and there should exist separating lines between each two adjacent edges so that the edges on both sides of the separating line are constructed, the training set of the SVM classifier.
The diagram of adjacent edge selection. (a) the comparison between two coupled edges: because is larger than , the label of () is larger than label of (); (b) ordering all edges: because , , so , , and the final order is and there are two separating lines, one is between and and the other one is between and .
3.3. The Parameters Determination of the Separating Line by SVM
The training set of SVM classifier is the following set of Q points:
where is a 2D position vector representing the edge pixels in image obtained from the boundary extraction algorithm and indicates that the vector belongs to the different edges.
Hence, the training goal of the SVM classifier is to find an optimal separating line as in 9 so that the training set could satisfy the condition of correct classification as in 10 and the normalized margin is maximized. Consider
The above problem is actually a convex quadratic programming which can be converted into its dual problem and be solved. N support vector and coefficients can be obtained from the SVM training and then we can use them to build the optimal support vector separating line equation.
In the case of linear separability, the optimal separating line is straight and defined by the following equation:
where is the dot product operation and the separating threshold is the midvalue of any pair of support vector in different edges.
In the case of nonlinear separability, the inner production of the support vector machine is needed instead of the dot product and Gaussian radial basis function is selected as the inner production in this paper so that the optimal separating line is a curve and the equation is
4. The Multiorder Fractional Filter Bank for Nonlinear Separability
It is obvious that, in the case of linear separability, the fractional filter as in 3 could be used directly so that, after getting the optimal separating line parameters by considering 4 and 11, the fractional filter can be constructed directly according to 5.
However, in the case of nonlinear separability, with the proper choice of SVM kernel function, an optimal separating curve is obtained which cannot assist FrFT filter design immediately. For this reason, a piecewise linear fitting algorithm may be used under a total least-square-error criterion where the curve is fitted to a set of linear segments connected end to end.
Provided that all M data points that belong to the separating curve have been known, the job is to solve the fitting function f:
which satisfies
where and are the starting point and the inflection point of the nth segment and N is the segment number.
It is evident that f is more close to and the separation effect of signal and noise is better with the increasing N. However, with the continuous increase of N, the order of filter bank and the degree of operation of FrFT also increase that would lead to high algorithm complexity. Furthermore, the discretization errors are accumulated in the repeated applications of DFrFT. As a consequence, the reasonable selection of N is an important impact on the performance of the filter and after that the parameters and could be determined by 14 and the filter of noise could be achieved by () times FrFT and N times multiplicative filter by the serial filter bank in 6.
A more efficient parallel filter bank is proposed in this paper. At first, according to the fitting result, divide the observed signals in the time domain which may be divided into N parts where each part is corresponding to a segment of the fitted polyline; that is,
Then, after determination of the transformation order and transfer function of each sub-filter, each fitting segment may be filtered separately and the output is superimposed as the ultimate recovered signal ; that is,
5. Application: Cross-Term Elimination in Wigner Distribution
The Wigner distribution function is succinct which satisfies many good mathematics properties and one of which is the excellence of focusing property, whereas, there is a problem for the WD; that is, “the cross-term problem.” This problem makes it difficult to distinguish between signal parts, noise parts, and the cross-term part of the WD so that WD is improper for the cases where the signal consists of several components.
Pei and Ding presented a method to detect and eliminate the WD cross-term based on the rotation characteristic of FrFT which could obtain the optimal autoterm resolution even that there are overlapping areas between the autoterms and the cross-terms [15]. However, it is an iteration-search algorithm which has a complexity computation and the inherent serial structure is hard to hardware implementation. Here, an algorithm based on this factional filter is proposed and the flowchart is shown as Figure 3. This method could completely eliminate the cross-term in WD and the time-frequency distribution that we get in the end high resolution and good readability which could also work well when autoterms and cross-terms overlap. Furthermore, the lower computation and more efficient parallel structure may be more easily implemented at engineering. The detailed procedure is as follows.
The observed signal is transformed by GT and a blur image without cross-terms is shown in the plane containing multidiscrete highlight energy concentration areas which represent signal or noise components.
The obtained GT gray image is converted to its binary counterpart by the efficient threshold selection method and then the image boundary extraction technology is used to select the edges of signal and noise areas which construct the training set of SVM classifier.
The different areas in the image are classified and the parameters of optimal separating lines are determined by SVM. If there are more than two components in the observed signal, that is, , the one-versus-rest SVMs should be constructed and the areas of different components are separated gradually.
According to the optimal transformation order and the transfer function of the filter (bank) which are determined by the parameters of the optimal classified line function (or functions), each signal (or noise) component in plane and then in t domain could be obtained.
Each filtered component is individually transformed in the plane again.
All these distribution outputs are added together in the plane, and a high-clarity image without cross-terms is obtained.
The flowchart of the WD cross-term elimination algorithm.
Furthermore, the proposed fractional filter could be used in many other applications besides cross-term elimination in Wigner distribution. For example, it can be also applied in the research on the moving targets detection and imaging by airborne synthetic aperture radar which needs further research.
6. Simulation
6.1. The Selection of Time-Frequency Distribution
An observed signal as in 17 is considered as follows:
where is a Gaussian amplitude modulated linear frequency modulated (LFM) signal with the additive noise . The observation time is from −2 s to 2 s and the sampling rate is 100 Hz. WVD, GT, SPWVD, and GWT of are shown separately in Figures 4(a)–4(d). It is obvious that the signal and noise present coupling either in the time domain or the frequency domain, though they have different focusing properties under different transforms.
The time-frequency distribution of the observed signal. (a) WD; (b) GT; (c) SPWVD; (d) GWT.
The comparison of fractional filter performance under different transforms is shown in Table 1, where IF is the SNR improvement factor and MSE is the mean square error of recovered signal; that is,
filter performances versus different transforms.
MSE (%)
IF (dB)
Training sample number of SVM
WVD
0.1083
29.6528
334
GT
0.1087
29.6382
394
SPWVD
0.1084
29.6496
396
GWT
0.1083
29.6531
327
Under these four classic transforms, it can be seen that, though the images and the boundaries of components are different, all the filters are able to recovery the signal successfully so that the fractional filter design method proposed in this paper is not limited to any particular transformation. When WVD or GWT is adopted, the fewer training sample number of SVM and a little better filtering effect are obtained. However, the cross-term in WVD could be avoided by using the method proposed in Section 5 but may increase the calculation. Hence, GWT will be adopted in the following experiments.
6.2. In the Case of Linear Separability
The input signal and the GWT of are shown in 17 and Figure 4(d). Through the boundary extraction algorithm, the edges of signal and noise can be selected as the SVM training set which are dashed lines in Figure 5(a). Based on these edges, the support vector and optimal separating line are obtained, which are shown in Figure 5(a) with black dots and solid line, and the separating line equation is l: . Figure 5(b) shows the process of filter in the u domain where parameters of the fractional filter are and , and the recovered signal and residual error are shown in Figure 5(c). As can be seen from the above results, the noise can be filtered effectively by using our design method in the case of linear separability.
The filtering process: (a) optimal separating line and support vector; (b) filtering in fractional domain; (c) recovered signal and recovered error.
In order to evaluate the influence of the filter performance from the optimal characteristic of separating line, four typical nonoptimal separating lines are constructed as shown in Figure 6 and the equations are
Four typical nonoptimal separating lines.
According to these four separating lines, fractional filters are constructed and the filter performances are shown in Table 2. It can be seen that the performance of the filter designed by SVM is better than that based on other separating lines because the truncation of the observed signal in the time domain and the picket fence effect of discrete spectral analysis cause the energy leakage of signals and noises to the entire plane, while the SVM classifier maximizes the margin in order to separate the signals and noises in the domain to the most degree.
filter performances versus different separating lines.
Operating line
l
MSE (%)
0.1083
0.1403
0.1715
0.1724
0.2158
IF (dB)
29.6531
28.5298
27.6558
27.6362
26.6720
6.3. In the Case of Nonlinear Separability
In this case, the observed signal consisted of a quadratic frequency modulated signal with noise :
The observation time is from −10 s to 10 s and the sampling rate is 30 Hz. Figure 7(a) shows the GWT of where the two components in the plane could not be separated by a straight line and the optimal separating curve is shown in Figure 7(b). As mentioned in Section 4, the curve should be fitted to a set of linear segments and the segment number N is a key to design the fractional filter bank. The value of coefficient of determination is adopted to measure the goodness of fit which is defined as follows:
where is the residual sum of squares (RSS), is the total sum of squares (TSS), and , , and are the data of the optimal separating curve, the fitting data, and the average of , respectively.
Filtering experiments in the case of nonlinear separability. (a) GWT of ; (b) the optimal classification curve and support vector; (c) 4th-order fitting of SVM separating line; (d) recovered signal and recovered error.
Table 3 shows the value of versus different segment number N. It can be seen that when , the fitting linear segments have a very high fitting precision, while already satisfies most practical cases. The 4th-order fitting of SVM separating line is shown in Figure 7(c) and the fitting equation is
The value of versus different segment number N.
N
1
2
3
4
5
6
7
0.0001
0.9301
0.9872
0.9958
0.9975
0.9981
0.9987
Calculate IF and with , and the result is .5421 dB, . The recovered signal and residual error are shown in Figure 7(d). As can be observed in the above results, the proposed algorithm still achieves an effective noise filtering in the case of nonlinear separability, while the performance degradation caused by the errors of piecewise linear fitting and the discrete multiorder filter bank cannot be helped.
6.4. Cross-Term Elimination in Wigner Distribution
The observed signal is the digitized echolocation pulse emitted by the large brown bat, Eptesicus fuscus. There are 400 samples and the sampling period is 7 ms [14]. The time domain waveform is given in Figure 8(a).
(a) The time domain waveform of ; (b) the WVD of ; (c) Gabor of ; (d) the binary image of .
As can be seen from Figure 8(b), there are many cross-terms in the WVD of and the difference between the intensity of each component is large where the weak components are submerged by the strong components and cross-terms so that the readability of the image is poor. The Gabor of has no cross-term though the image is blurring, which is shown in Figure 8(c). The threshold is determined by the characteristics of the image and the binary image is shown in Figure 8(d). It is obvious that there are four different components in the binary image so that they could be separated individually by our fractional filter bank. The optimal separating lines and the filtering process are shown in Figure 9.
The support vector and the optimal separating line. (a) ; (b) ; (c) .
The GWT of all single components, which is obtained from filtering one by one, is calculated and superimposed so that a clear image without cross-term is achieved as shown in Figure 10. It can be seen that our design method can avoid the cross-term completely and not affect the quality of the autoterms. Meanwhile, it is effective even in the case of overlap between the autoterms and the cross-terms. Furthermore, the image is more readable because the weak components are strengthened in the conversion process from the gray image to the binary image.
The clear image of without cross-term.
7. Conclusion
A novel general design of fractional filter is proposed in order to realize the lossless recovery of nonstationary signal in complicated noise environment. The estimation procedures for the parameters of the optimal separating lines in the case of linear separability and those of the optimal separating curves in the case of nonlinear separability in the plane are given in detail and the specific design methods in both of these two cases are presented. This design is versatility and can ensure the optimal performance of the filter without any statistic priori knowledge. Simulation results show that it still works well even in the case of strong coupling between the signal and noise and do not depend on the selected transformation. Furthermore, our fractional filter can realize the effective elimination of the cross-term in WD and image rich in detail can be achieved.
Footnotes
Conflict of Interests
The authors declare that there is no conflict of interests regarding the publication of this paper.
Acknowledgments
The authors wish to thank Curtis Condon, Ken White, and Al Feng of the Beckman Institute of the University of Illinois for the bat data and for the permission to use it in this paper. This work is supported by Tianjin Research Program of Application Foundation and Advanced Technology under Grant 14JCQNJC01400. This paper's work is also funded by the National Science Foundation of China (NSFC: 61401301).
References
1.
LiangQ.Radar sensor wireless channel modeling in foliage environment: UWB versus narrowbandIEEE Sensors Journal20111161448145710.1109/jsen.2010.20975862-s2.0-79955414672
2.
LiangQ.Automatic target recognition using waveform diversity in radar sensor networksPattern Recognition Letters20082933773812-s2.0-3704903750310.1016/j.patrec.2007.10.016
3.
LiangJ.LiangQ.Design and analysis of distributed radar sensor networksIEEE Transactions on Parallel and Distributed Systems201122111926193310.1109/tpds.2011.452-s2.0-80053576090
4.
OzaktasH. M.The Fractional Fourier Transform: With Applications in Optics and Signal Processing2000New York, NY, USAJohn Wiley & Sons
5.
SubramaniamS. R.LingB. W.-K.GeorgakisA.Filtering in rotated time-frequency domains with unknown noise statisticsIEEE Transactions on Signal Processing201260148949310.1109/TSP.2011.2171956
6.
NamiasV.The fractional order Fourier transform and its application to quantum mechanicsJournal of the Institute of Mathematics and its Applications198025324126510.1093/imamat/25.3.241MR5731532-s2.0-77958407025
7.
AlmeidaL. B.Fractional fourier transform and time-frequency representationsIEEE Transactions on Signal Processing199442113084309110.1109/78.3303682-s2.0-0028546458
8.
SharmaS. N.SaxenaR.SaxenaS. C.Tuning of FIR filter transition bandwidth using fractional Fourier transformSignal Processing20078712314731542-s2.0-3454796041210.1016/j.sigpro.2007.06.005
9.
YetikI. Ş.KutayM. A.OzaktasH. M.Optimization of orders in multichannel fractional Fourier-domain filtering circuits and its application to the synthesis of mutual-intensity distributionsApplied Optics200241204078408410.1364/AO.41.0040782-s2.0-0037055171
10.
PeiS.-C.DingJ.-J.Fractional Fourier transform, Wigner distribution, and filter design for stationary and nonstationary random processesIEEE Transactions on Signal Processing20105884079409210.1109/tsp.2010.2048206MR27801702-s2.0-77954593321
11.
ZalevskyZ.MendlovicD.Fractional Wiener filterApplied Optics19963520393039362-s2.0-000077349410.1364/ao.35.003930
12.
KutayM. A.OzaktasH. M.AnkanO.OnuralL.Optimal filtering in fractional fourier domainsIEEE Transactions on Signal Processing19974551129114310.1109/78.5756882-s2.0-0031143161
13.
LinQ.RanT.Si-yongZ.YueW.An approach for optimal filtering of LFM signalActa Electronica Sinica200432914641467
14.
Fatih ErdenM.Alper KutayM.OzaktasH. M.Repeated filtering in consecutive fractional Fourier domains and its application to signal restorationIEEE Transactions on Signal Processing19994751458146210.1109/78.7572442-s2.0-0032682104
15.
PeiS.-C.DingJ.-J.Relations between Gabor transforms and fractional Fourier transforms and their applications for signal processingIEEE Transactions on Signal Processing200755104839485010.1109/TSP.2007.896271MR27249942-s2.0-35148871148
16.
PeiS.-C.DingJ.-J.Closed-form discrete fractional and affine Fourier transformsIEEE Transactions on Signal Processing20004851338135310.1109/78.839981MR17634032-s2.0-33747799699