Transcript Slide 1
BAYESIAN POSTERIOR DISTRIBUTIONS FOR PROBABILISTIC SENSITIVITY ANALYSIS Gordon B. Hazen and Min Huang, IEMS Department, Northwestern University, Evanston IL Observations from several heterogeneous controlled studies Abstract Purpose: In probabilistic sensitivity analyses (PSA), analysts assign probability distributions to uncertain model parameters, and use Monte Carlo simulation to estimate the sensitivity of model results to parameter uncertainty. Bayesian methods provide convenient means to obtain probability distributions on parameters given data. We present large-sample approximate Bayesian posterior distributions for probabilities, rates and relative effect parameters, and discuss how to use these in PSA. Observations from a single controlled study (or several pooled controlled studies) Observations from several heterogeneous studies (no controls) x Decision or Policy m Future observations y We conducted a probabilistic sensitivity analysis of the choice of interventions to reduce vertical HIV transmission in pregnant women, using data from Mrus & Tsevat. Observations from past studies Pooled observations from past studies y pooled An Illustrative Probabilistic Sensitivity Analysis x1 y1 . . . . . . xn yn $208 52.27323601 Decision or Policy Do nothing . Cost or Utility $208 52.27323601 $2,613,435 $242 52.27354212 Future observations x Cost or Utility y Methods: We use Bayesian random effects meta-analysis, extending procedures summarized by Ades, Lu and Claxton (2004). We outline procedures for using the resulting posterior distributions in Monte Carlo simulation. . 1-Pd Mother HIV + $52 Test+, treat Accept Pac $39 52.3 Offer rapid testing $208 52.27324 1-Pac Results and conclusions: We apply these methods to conduct a PSA for a recently published analysis of zidovudine prophylaxis following rapid HIV testing in labor to prevent vertical HIV transmission in pregnant women (Mrus and Tsevat 2004). Zidovudine prophylaxis is cost saving and has net benefit $553 per pregnancy compared to not testing for HIV, assuming a cost of $50,000 per lost QALY (mother and child). We based a PSA on data cited from Mrus and Tsevat on seven studies of vertical HIV transmission, as well as data for 5 other probability parameters. Infant HIV + Prophylaxis adequate $22,623 49.44215 Pd Deliver before prophylaxis adequate Infant HIV - $419 52.3 Mother HIV - Test Refuse Given this data, the two parameters (log Risk population mean) and (log Risk Ratio population mean) for vertical HIV transmission have approximate bivariate normal posterior with mean/sd equal to 1.39/0.12 and 1.02/0.23, and correlation 0.108. Using these and other posterior distributions for all 5 remaining probabilities in a PSA yields zidovudine prophylaxis optimal 95.9% (0.19%) of the time, and the expected value of perfect information on all 7 relative effects and probabilities equal to $10.65 (0.87) per pregnancy. These results concur with Mrus and Tsevat’s conclusion that the choice of rapid HIV testing followed by zidovudine prophylaxis is not a close call. Results: Baseline analysis Probabilistic Sensitivity Analysis Using the Bayesian Paradigm Observations • Using the standard value of $50,000/QALY, we found a net benefit of $522.96 per pregnancy for rapid HIV testing followed by zidovudine prophylaxis. from past studies • This is consistent with the results of Mrus and Tsevat. y1 Results: Probabilistic sensitivity analysis. Based on 40,000 Monte Carlo iterations: . . . x yn • Zidovudine prophylaxis optimal 95.9% (±0.19%) of the time. Decision or Policy Future observations y Example 2: Specificity of rapid HIV testing The following data is drawn from the 3 sources referenced by Mrus & Tsevat (2004). • The expected value of perfect information on all 8 relative effects and probabilities is equal to $10.65 (±$0.87) per pregnancy. p = specificity of rapid HIV testing Conclusion: These numbers indicate that the optimality of zidovudine prophylaxis is insensitive to simultaneous variation in these eight probability and efficacy parameters Cost or Utility Example 1 (continued): The effect of zidovudine prophylaxis on HIV transmission In decision or cost-effectiveness analyses, observations y1,…,yn may be available from past studies concerning unknown parameters x that influence future observations, costs and utilities. In order to conduct a probabilistic sensitivity analysis on x, one needs to assign a probability distribution to x. Bayesian methods provide in principle a straightforward method for this: Use the posterior distribution f(x| y1,…,yn) of x given the observations. Example 1: The effect of zidovudine prophylaxis on HIV transmission The following data is drawn from the 7 sources referenced by Mrus & Tsevat (2004). p0 = probability of HIV transmission without zidovudine prophylaxis p1 = probability of HIV transmission with zidovudine prophylaxis 200 Reference In practice there may be difficulties in obtaining posterior distribution f(x| y1,…,yn) • A prior distribution for x must be specified 100 Note that pooling results in a tighter distribution than not pooling. Improperly pooling may lead to misleading overconfidence in a probabilistic sensitivity analysis. • The burden of computing a posterior distribution on x may be excessive. However, both of these difficulties disappear when the number of observations is large. In this case, • the prior distribution has little effect on the resulting posterior, and • approximate large-sample normal posterior distributions can be inferred without extensive computation. This is consistent with the conventional sensitivity analyses conducted by Mrus and Tsevat. 0 0.95 0.96 0.97 0.98 p Unpooled P ooled 0.99 1 Mrus, J.M., Tsevat, J. Cost-effectiveness of interventions to reduce vertical HIV transmission from pregnant women who have not received prenatal care. Medical Decision Making, 24 (2004) 1, 30-39. p0 = probability of HIV transmission without zidovudine prophylaxis p1 = probability of HIV transmission with zidovudine prophylaxis Here pooling is incorrect and leads to misleadingly tight posterior distribution (compare graph at left). Ades AE, Lu G, Claxton K. Expected value of sample information calculations in medical decision modeling. Medical Decision Making. 24 (2004) 4, 207-227.