Bayesian Sample Size Optimization Method for Integrated Test Design of Missile Hit Accuracy

Guangling Dong, Chi He, Zhenguo Dai, Yanchang Huang, Xiaochu Hang

2015

Abstract

Sample size determination (SSD) for integrated test of missile hit accuracy is addressed in this paper. Bayesian approach to SSD gives test designer the possibility of taking into account of prior information and uncertainty on unknown parameters of interest. This fact offers the advantage of removing or mitigating typical drawbacks of classical methods, which might lead to serious miscalculation of the sample size. However, standard power prior based Bayesian SSD method cannot cope with integrated SSD for both simulation test and field test, as large numbers of simulation samples would cause contradiction between design prior and average posterior variance criterion (APVC). In allusion to this problem, we propose a test design effect equivalent method for equivalent sample size (ESS) calculation, which combined simulation credibility, sample size, and power prior exponent to get a rational design prior for subsequent field test. Average posterior variance (APV) of interested parameters is deduced by simulation credibility, sample sizes of two kinds of test, and prior distribution parameters. Thus, we get optimal design equations of integrated test scheme under both test cost constraints and required posterior precision constraint, whose effectiveness are illustrated with two examples.

References

  1. Adcock, C. J., 1997. Sample size determination: a review. Journal of the Royal Statistical Society: Series D (The Statistician), 46(2), 261-283.
  2. Balci, O., 1997. Verification validation and accreditation of simulation models, 135-141., In Proceedings of the 29th conference on Winter simulation, Atlanta, GA, USA.
  3. Balci, O., 2013. Verification, Validation, and Testing of Models, 1618-1627. In Gass, S., and Harris, C.M., eds., Encyclopedia of Operations Research and Management Science. Springer, New York.
  4. Bernardo, J. M., and Smith, A. F. M., 2000. Bayesian theory. John Wiley & Sons, New York.
  5. Clarke, B., and Yuan, A., 2006. Closed form expressions for Bayesian sample size. The Annals of Statistics, 34(3), 1293-1330.
  6. Claxton, J. D., Cavoli, C., and Johnson, C., 2012. Test and Evaluation Management Guide, The Defense Acquisition University Press. Fort Belvoir, VA. 6th Edition.
  7. De Santis, F., 2004. Statistical evidence and sample size determination for Bayesian hypothesis testing. Journal of statistical planning and inference, 124(1), 121-144.
  8. De Santis, F., 2007. Using historical data for Bayesian sample size determination. Journal of the Royal Statistical Society: Series A (Statistics in Society), 170(1), 95-113.
  9. Di Bacco, M., Amore, G. D., Scalfari, F., De Santis, F., & Pacifico, M. P., 2004. Two experimental settings in clinical trials: predictive criteria for choosing the sample size in interval estimation. Applied Bayesian Statistical Studies in Biology and Medicine, 109-130. Kluwer Academic Publishers, Norwell, MA, USA.
  10. Desu, M. M., and Raghavarao, D., 1990. Sample Size Methodology. Academic Press, Boston.
  11. Fryback, D. G., Chinnis, J. O., and Ulvila, J. W., 2001. Bayesian cost-effectiveness analysis. International Journal of Technology Assessment in Health Care, 17(1), 83-97.
  12. Greenhouse, J. B., and Waserman, L., 1995. Robust Bayesian methods for monitoring clinical trials. Statistics in Medicine, 14(12), 1379-1391.
  13. Ibrahim, J. G., Chen, M. H., and Sinha, D., 2003. On optimality properties of the power prior. Journal of the American Statistical Association, 98(461), 204-213.
  14. Ibrahim, J. G., and Chen, M. H., 2000. Power prior distributions for regression models. Statistical Science, 15(1), 46-60.
  15. Joseph, L., Du Berger, R., Belisle, P., and Others., 1997. Bayesian and mixed Bayesian/likelihood criteria for sample size determination. Statistics in Medicine, 16(7), 769-781.
  16. Joseph, L., Wolfson, D. B., and Du Berger, R., 1995. Sample size calculations for binomial proportions via highest posterior density intervals. The Statistician, 44(2), 143-154.
  17. Joseph, L., and Belisle, P. 1997. Bayesian sample size determination for normal means and differences between normal means. Journal of the Royal Statistical Society: Series D (The Statistician), 46(2), 209-226.
  18. Kraft, E. M., 1995. Integrated Test and Evaluation- A knowledge-based approach to system development., In 1st AIAA Aircraft Engineering, Technology, and Operations Congress. AIAA 95-3982, Los Angeles, US.
  19. Kushman, K. L., and Briski, M. S., 1992. Integrated test and evaluation for hypervelocity systems. In AIAA 17th Aerospace Ground Testing Conference. American Institute of Aeronautics and Astronautics, Nashville, TN.
  20. Murphy, K. R., Myors, B., and Wolach, A. H., 2009. Statistical power analysis: A simple and general model for traditional and modern hypothesis tests. Routledge, New York, NY.
  21. Nassar, M. M., Khamis, S. M., and Radwan, S. S., 2011. On Bayesian sample size determination. Journal of Applied Statistics, 38(5), 1045-1054.
  22. Rebba, R., Mahadevan, S., and Huang, S. P., 2006. Validation and error estimation of computational models. Reliability Engineering & System Safety, 91(10-11), 1390-1397.
  23. Reyes, E. M., and Ghosh, S. K., 2013. Bayesian Average Error-Based Approach to Sample Size Calculations for Hypothesis Testing. Journal of Biopharmaceutical Statistics, 23(3), 569-588.
  24. Schwartz, M., 2010. Defense acquisitions: How DoD acquires weapon systems and recent efforts to reform the process. Paper presented at the Congressional Research Service, Washington, DC.
  25. Spiegelhalter, D. J., Abrams, K. R., and Myles, J. P., 2004. Bayesian approaches to clinical trials and health-care evaluation. John Wiley & Sons, Ltd, Chichester, West Sussex, England.
  26. Spiegelhalter, D. J., and Freedman, L. S., 1986. A predictive approach to selecting the size of a clinical trial, based on subjective clinical opinion. Statistics in medicine, 5(1), 1-13.
  27. Wang, F., and Gelfand, A. E., 2002. A simulation-based approach to Bayesian sample size determination for performance under a given model and for separating models. Statistical Science, 17(2), 193-208.
  28. Waters, D. P., 2004. Integrating Modeling and Simulation with Test and Evaluation Activities. In USAF Developmental Test and Evaluation Summit. Woodland Hills, California: AIAA 2004-6800.
  29. Weiss, R. 1997. Bayesian sample size calculations for hypothesis testing. Journal of the Royal Statistical Society: Series D (The Statistician), 46(2), 185-191.
Download


Paper Citation


in Harvard Style

Dong G., He C., Dai Z., Huang Y. and Hang X. (2015). Bayesian Sample Size Optimization Method for Integrated Test Design of Missile Hit Accuracy . In Proceedings of the 5th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH, ISBN 978-989-758-120-5, pages 244-253. DOI: 10.5220/0005510902440253


in Bibtex Style

@conference{simultech15,
author={Guangling Dong and Chi He and Zhenguo Dai and Yanchang Huang and Xiaochu Hang},
title={Bayesian Sample Size Optimization Method for Integrated Test Design of Missile Hit Accuracy},
booktitle={Proceedings of the 5th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,},
year={2015},
pages={244-253},
publisher={SciTePress},
organization={INSTICC},
doi={10.5220/0005510902440253},
isbn={978-989-758-120-5},
}


in EndNote Style

TY - CONF
JO - Proceedings of the 5th International Conference on Simulation and Modeling Methodologies, Technologies and Applications - Volume 1: SIMULTECH,
TI - Bayesian Sample Size Optimization Method for Integrated Test Design of Missile Hit Accuracy
SN - 978-989-758-120-5
AU - Dong G.
AU - He C.
AU - Dai Z.
AU - Huang Y.
AU - Hang X.
PY - 2015
SP - 244
EP - 253
DO - 10.5220/0005510902440253