Skip Navigation U.S. Department of Health and Human Services www.hhs.gov
Agency for Healthcare Research Quality www.ahrq.gov
www.ahrq.gov
space
MEPS Home Medical Expenditure Panel Survey
FAQ Contact MEPS Espanol Site Map
 
space
 
MEPSnet/IC Statistical Help

For each chart generated by MEPSnet/IC, a table is provided which lists the survey estimates shown in the chart and their corresponding standard errors (SE). These standard errors reflect the estimated sampling error associated with the estimate (i.e. potential error introduced because data were collected for only a sample of establishments).

Analysts frequently generate 95% confidence intervals to assess the precision of survey estimates. These intervals are computed as:

Estimate +/- 1.96*SE.

MEPSnet/IC displays a 95 percent confidence interval for each estimate shown in the chart. A 95 percent confidence interval has the following general interpretation: applying the interval-estimating procedure to all possible samples, a statement that a given interval enclosed the true population mean would be correct 95 percent of the time. Therefore, one can be 95 percent sure that an interval constructed from one sample captures the true population mean.

As an example, the following chart and table generated using MEPSnet/IC shows the average total single premium levels from 1996-98 at private-sector establishments that offer health insurance. The estimated average premium in 1996 was $1,991.64, but the corresponding confidence interval was $1,991.64 +/- 1.96*14.46 (i.e. the interval ranges from $1963.30 to $2019.98).

Test of Significance

To interpret whether there has been a statistically significant change between 2 particular years, one can compute a z-statistic using the following formula:

formula showing the calculation of the z-statistic as the difference in the two estimates divided by the square root of the sum of the squares of the standard errors of the two estimates

For example, the z-statistic to assess whether the difference in average premiums between 1996 and 1998 is statistically significant would be computed as follows:

example showing the z-statistic calculation using the 1996 and 1998 estimates in the example above.  The difference in the estimates is calculated as $2,174.35-$1,991.64 = 182.71.  The square root of the sum of the squares of the standard errors of the two estimates is calculated as SQRT(17.02*17.02 + 14.46*14.46) = 22.33.  182.71 is divided by 22.33 to obtain the z-statistic, 8.18.

The threshold z-statistic for establishing statistical significance at the .05 level is 1.96. That is, if the calculated z-statistic is greater than 1.96 or less than –1.96, the estimates are significantly different at the .05 level. All values that are significant at the 0.05 level are marked with an *. For this example, the calculated z-statistic of 8.18 is greater than 1.96, so the difference between the two years is statistically significant.

The p-value shown in the table is the probability of having a z-statistic as large or larger than the one calculated from these estimates (or smaller in cases where the z-statistic is negative). When this p-value is less than or equal to the 0.05 level of significance, then the difference is statistically significant at that level and is marked with an *. In our example, the p-value associated with the z-statistic of 8.18 is very small (rounds to 0.00000) and thus this difference is statistically significant.

Average total single premium (in dollars) per enrolled employee at private-sector establishments that offer health insurance: United States

graph of the average total single premium (in dollars) per enrolled employee at private-sector establishments that offer health insurance in the United States from 1996 to 1998.  The data used to generate this graph are in the table that follows this graph.

199619971998
AverageSEAverageSEAverageSE
1,991.6414.462,050.8220.132,174.3517.02

z-Test Showing the Significance of Change Between Years
Years
Compared
Average SE Joint SE z-Statistic p-Value
(two-tail)
1996
1997
1,992
2,051
14.46
20.13
24.79 2.38771
0.01695*
1996
1998
1,992
2,174
14.46
17.02
22.33 8.18109
0.00000*
1997
1998
2,051
2,174
20.13
17.02
26.36 4.68611
0.00000*
* Significant at 0.05 level

 

spacer