Related Topics: toprightheader.gif

Crow-AMSAA (NHPP) Model

Crow Extended Model

Statistical Tests for Effectiveness of Corrective Actions

Introduction

The purpose of the statistical tests is to explore the effectiveness of corrective actions during or at the end of a phase. Say we have two phases, Phase 1 and Phase 2. Suppose that corrective actions are incorporated during or at the end of Phase 1. The system is then operated during Phase 2. The general question is whether or not the corrective actions have been effective.

There are two questions that can be addressed regarding the effectiveness of the corrective actions:

Question 1. Is the average failure intensity for Phase 2 statistically less than the average failure intensity for Phase1?

Question 2. Is the average failure intensity for Phase 2 statistically less than the Crow-AMSAA (NHPP) instantaneous failure intensity at the end of Phase 1?

Average Failure Intensities Test

The purpose of this test is to compare the average failure intensity during Phase 2 with the average failure intensity during Phase 1.

The average failure intensity for Phase 1 is:

MATH (13)

where $T_{1}$ is the Phase 1 test time and $N_{1}$ is the number of failures during Phase 1.

 
 

Similarly, the average failure intensity for Phase 2 is:

MATH (14)

where $T_{2}$ is the Phase 2 test time and $N_{2}$ is the number of failures during Phase 2.

The overall test time, $T$, is:

MATH (15)

The overall number of failures, $N$, is:

MATH (16)

Define $P$ as:

MATH (17)

If the cumulative binomial probability $B(k;P,N)$ of up to $N_{2}$ failures is less than or equal to the statistical significance $\alpha $, then the average failure intensity for Phase 2 is statistically less than the average failure intensity for Phase 1 at the specific significance level.

The cumulative binomial distribution probability is given by:

MATH(18)

which gives the probability that the test failures, $f$, are less than or equal to the number of allowable failures, or acceptance number $k$ in $N$ trials, when each trial has a probability of succeeding of $P$.

Crow Extended - Continuous Evaluation Example 4

Suppose a test is being conducted and is divided into two phases. The test time for the first Phase is $T_{1}=27$ days and the test time for the second phase is $T_{2}=18$ days. The number of failures during Phase 1 is $N_{1}=11$ and the number of failures during Phase 2 is $N_{2}=2.$

Using Eqn. (13), the average failure intensity for Phase 1 is:

MATH

Similarly, using Eqn. (14), the average failure intensity for Phase 2 is:

MATH

Although the average failure intensities are different, we want to see, if at the 10% statistical significance level, the average failure intensity for Phase 2 is statistically less than the average failure intensity for Phase 1.

Solution to Crow Extended - Continuous Evaluation Example 4

Concerning the total test time, using Eqn. (15) we have:

MATH

Using Eqn. (16), the total number of failures is equal to:

MATH

Then, by using Eqn. (17) we calculate $P$ as:

MATH

Using Eqn. (18), we have:

MATH

Since 0.058 is lower than 0.10, the conclusion is that at the 10% significance level the average failure intensity for Phase 2 is statistically less than the average failure intensity for Phase 1. The conclusion would be different for a different significance level. For example, at the 5% significance level, since 0.058 is not lower than 0.05, we fail to reject the null hypothesis. In other words, we cannot statistically prove any significant difference between the average failure intensities at the 5% level.

Average vs. Demonstrated Failure Intensities Test

The purpose of this test is to compare the average failure intensity during Phase 2 with the Crow-AMSAA (NHPP) instantaneous failure intensity at the end of Phase 1; in other words, the demonstrated failure intensity at the end of Phase 1.

Once again, the average failure intensity for Phase 2 is given by Eqn. (14):

MATH

where $T_{2}$ is the Phase 2 test time and $N_{2}$ is the number of failures during Phase 2.

The Crow-AMSAA (NHPP) model estimate of failure intensity at time is MATH. In "Confidence Interval Procedures for the Weibull Process with Applications to Reliability Growth" [16], Dr. Larry H. Crow showed that the Crow-AMSAA (NHPP) estimate is approximately distributed as a random variable with standard deviation MATH

We therefore treat MATH as an approximate Poisson random variable with number of failures:

MATH (19)

We also set:

MATH (20)

Then we define:

MATH (21)

and:

MATH (22)

Let:

MATH (23)

If the cumulative binomial probability $B(k;P,N)$ of up to $N_{2}$ failures is less than or equal to the statistical significance $\alpha $, then the average failure intensity for Phase 2 is statistically less than the Crow-AMSAA (NHPP) instantaneous failure intensity at the end of Phase 1, at the specific significance level. The cumulative binomial distribution probability is again given by Eqn. (18).

Crow Extended - Continuous Evaluation Example 5

Suppose a test is being conducted and is divided into two phases. The test time for the first phase is $T_{1}=27$ days and the test time for the second phase is $T_{2}=18$ days. The number of failures during Phase 1 is $N_{1}=11$ and the number of failures during Phase 2 is $N_{2}=2.$ The Crow-AMSAA (NHPP) parameters for the first phase are $\beta =0.7189$ and $\lambda =1.0288.$

The demonstrated failure intensity at the end of Phase 1 is calculated as follows:

MATH

Using Eqn. (14), the average failure intensity for Phase 2 is:

MATH

Determine if the average failure intensity for Phase 2 is statistically less than the demonstrated failure intensity at the end of Phase 1 at the 10% significance level.

Solution to Crow Extended - Continuous Evaluation Example 5

From Eqn. (19), we can calculate $N_{1}^{\ast }:$

MATH

Using Eqn. (20), we have:

MATH

Concerning the total test time, using Eqn. (21) we have:

MATH

Concerning the total number of failures, using Eqn. (22) we have:

MATH

Then, by using Eqn. (23) we calculate $P$ as:

MATH

Since the number of failures $N=7.5$ is not an integer, we are going to calculate the cumulative binomial probabilities for $N=7$ and $N=8$, and then interpolate to $N=7.5.$

For $N=7$, using Eqn. (18) we have:

MATH

And for $N=8$ we have:

MATH

A linear interpolation between two data points MATH and MATH at the $\left( x,y\right) $ interpolant is given by:

MATH

So for $N=7.5$ we would have that:

MATH

Since $0.201$ is greater than $0.10$ the conclusion is that at the 10% significance level the average failure intensity for Phase 2 is not statistically different compared to the demonstrated failure intensity at the end of Phase 1.

Figure 10.18 shows the application of the two statistical tests for the Crow Extended - Continuous Evaluation model in RGA 7 for Example 2 of Definition Examples for the Crow Extended - Continuous Evaluation Model section of this on-line reference.

rga7_chxx_steca_interface.wmf

Figure 10.18: Statistical test for corrective actions in RGA 7