Randomized estimates in power spectral analysis

TR Number
Date
1957
Journal Title
Journal ISSN
Volume Title
Publisher
Virginia Polytechnic Institute
Abstract

This study has been concerned specifically with the problem of estimating the power spectrum associated with a random process. It has shown how the power spectral density function φ(ω) can be used to specify completely a stationary Gaussian process. Estimation of this function is therefore one of the fundamental problems in random time-series. The power spectral density function is given by

φ(ω) = [2/π] ∫0+∞ ρ(τ)cos ωτ dτ

And must be estimated from a partial realization of the process. To accomplish this, the usual procedure is to use estimated auto-covariance functions ρ̂(τ), computed from a set of observations X(ti) from which φ(ω) is approximated by numerical integration. This gives

φ̂(ω) = 1/W [ρ̂(0)+2∑ j=1m-1 ρ̂[jπ/W]cos(ωjπ/W) + ρ̂[mπ/W]cos(ωmπ/W)]

where the ρ[jπ/W]’s are estimated from

ρ̂[jπ/W] = (1/n)∑ i=1nX(ti)X(ti + jπ/W) j = 0, 1, …, m.

φ̂(ωα) is widely used in power spectral analysis and although it can be shown to be biased, the side lobes of its spectral window can be soothed in such a way that the bias is greatly reduced. The difficulty with the estimator is not so much with its bias, but rather with the considerable numerical task it creates even when digital computing equipment is available.

The primary objective of this research was to devise an estimator which would simulate the bias of the classical estimator φ̂(ωα) but which would require much less work to compute. To this end the randomizes estimator

φ*(ωα) = (1/n) i=1n X(ti)X(ti + kiΔt)Gα(ki)

was considered. Unlike φ̂(ωα) which was constructed by systematically forming all possible lagged products X(ti)X(ti + kiΔt), i=1, 2, …, n and k=0, 1, …, m , the new estimator utilizes a random subsample of lagged products. This is made possible by choosing the ki at random. The weighting function Gα(ki) is determined in such a way that the bias of φ*(ωα) is the same as the bias of φ̂(ωα).

As would be expected, the sampling variance of φ*(ωα) is larger than the variance of φ̂(ωα), since φ*(ωa) is based on considerably fewer points. It was discovered, however, that the variance of φ*(ωα) was affected by the probabilities used in the selection of the ki. Thus, the difference between the variances of the two estimators can be minimized by an appropriate choice of the probabilities P(j). It was shown also that by selecting the integers j = 0, 1, …, m with probabilities

P(j) = (√(f(j))) / ((∑ j=1m)(√(f(j)),

where

f(j) = (1/n)[ρ²(0) + ρ²(jΔt)]ρ²(j)G²α²(j),

that the variance of φ*(ωα) is minimized. For the special case, φ(ω) = λ and the point W/2, it was shown that sampling with equal probabilities is about half as efficient as with probabilities.

Finally, some of the areas in which research has been carried out using power spectral analysis were considered. In particular, a problem from the field of aeronautical engineering research was used to demonstrate how the randomized estimator φ*(ωα) would be calculated from real data. Using 900 observations on the pitching velocity of an aircraft, the power spectrum was estimated at ten points. The new estimator proved very tractable and it is felt that the loss of precision due to sampling will be more than offset by the economy and ease with which it produces estimates. This will be especially true when the need is for quick pilot estimates of spectra to be used in preliminary studies, as guidance for future research.

Description
Keywords
Citation