The Theoretical and Empirical Equivalence of Cronbach Alpha and Kuder-Richardson Formular-20 Reliability Coefficients

Abstract

Reliability as one the psychometric properties of a research and measurement instrument is very desirable in research, under the classical test theory(CTT). One group of such reliability measures is that of internal consistency of a scale. Cronbach Alpha and Kuder-Richardson formula 20 are measures of internal consistencies. In many texts, authorities specify that Kuder-Richardson formula 20 should be applied when test items are dichotomously scored while Cronbach Alpha should be applied when test items are not scored dichotomously. These guide lines are religiously adhered to by both researchers and measurement practitioners. Both reliability estimates are recognized as valid measures of internal constituency.  In research, an informed choice has to be made about which one to apply, particularly, when only one of them has to be applied. These guidelines are seen as conditions that validate the use of each of them. These specifications are erroneously interpreted. A score is a score whether dichotomous or not. This paper examined both the theoretical and empirical equivalence of these two estimates, for tests of the same length and for varying test lengths. To demonstrate the empirical equivalence of Cronbach Alpha and KR-20, 65 biology achievement tests of the same length (40 items), were administered on 65 samples of senior secondary two students, consisting of 60 students selected from 36 public secondary schools, in Calabar Education zone of Cross River State, Nigeria. Both the Cronbach Alpha and KR-20 were estimated for each test and for the 65 samples. Another test of 100 items adapted from the 2018 and 2019 WAEC-SSCE English Language objective test, was administered on a sample of 300 students. Both reliability measures were estimated for varied lengths of the test, by randomly removing five (5) items at a time. This resulted in 19 sub-tests. The resulting reliability coefficients were compared using the related sample t-test while repeated measures ANOVA was used to compare the reliability coefficients under the influence test length, measured in terms of number of items. The results showed that there is significant difference between Cronbach Alpha and KR-20(t=4.022, p=.000). The correlation between KR-20 and Cronbach alpha is positive and highly significant(r=.944& .999, p=.000). Test length has significant influence on the difference between KR-20 and Cronbach alpha reliability estimates (F=1372.074, p=.000). The implications of these results for tests developers and users are discussed.

Country : Nigeria

1 Denis A Uyanah Ph.D.2 Nsikhe U. I.

  1. Department of Educational Foundations and Childhood Education, Faculty of Education, Cross River University of Technology, Calabar, Nigeria
  2. Cross River State College of Education, Akamkpa, Nigeria

IRJIET, Volume 7, Issue 5, May 2023 pp. 17-23

doi.org/10.47001/IRJIET/2023.705003

References

  1. Ahmad, D. E.2016). A response to the question: Is it wrong to use Cronbach alpha coefficient to Assess the internal consistency of a questionnaire with binary options? Retrieved from Retrieved from https//www.researchgate.net. Posted January.
  2. Al-Hemyari, A. M. (2018). A response to the question what reliability measure to adopt when a test Consist of both items that are dichotomous and items that are not. Retrieved from https//www.researchgate.net.  Posted January.
  3. Bernard, J. P. (2018). A response to the issue of the difference between Kuder-Richardson formular 20 and Cronbach alpha coefficient. Retrieved from https//www.researchgate.net. Posted January.
  4. Ebel, R.L. (1879). Essentials of educational measurements (3rd ed.).New Jersey: Prentice Hall.
  5. Emilio, P. R. (2016). A response to the question: Is it wrong to use Cronbach alpha coefficient to assess the internal consistency of a questionnaire with binary options? Retrieved from Retrieved from https//www.researchgate.net.  Posted January.
  6. Joshua, M. T. (2005). Fundamentals of tests and measurement in education. Calabar: University of Calabar Press.
  7. Kerlinger, F. N. (1986) Foundation of behavioural research (3rd ed.).New York: Holt, Rinehart and Winston.
  8. Kuder, G, F. & Richardson, M. W. (1937). The theory of estimation of test reliability. Psychometrika, 2, 151-160.
  9. McNeish, D.(2015). A response to the issue of the difference between Kuder-Richardson formular 20 and Cronbach alpha coefficient. Retrieved from https//www.researchgate.net. Posted January.
  10. Morgan, D. L. (2016). A response to the question: Is it wrong to use Cronbach alpha coefficient to assess the internal consistency of a questionnaire with binary options? Retrieved from Retrieved from https//www.researchgate.net.  Posted January.
  11. Nurchotimah, E. (2018). A response to the issue of the difference between Kuder-Richardson formular 20 and Cronbach alpha coefficient. Retrieved from https//www.researchgate.net. Posted January.
  12. Qingke, Fu. (2019). A response to the issue of the difference between Kuder-Richardson formular 20 and Cronbach alpha coefficient. Retrieved from https//www.researchgate.net.
  13. Rarkov, T.,Dimitrov,D. M. & Asparouhov, T. (2010).Evaluation of scale reliability with binary measures using latent variable modeling. Structural equation modeling: Multidisciplinary Journal, 17(2), 265-279.
  14. Schemelieh-Engel, K. (2020). A response to the question: Is it wrong to use Cronbach alpha coefficient to assess the internal consistency of a questionnaire with binary options? Retrieved from https//www.researchgate.net.  Posted January.
  15. Stanley, J. C. & Hopkins, K. D. (1972). Educational and psychological measurement and evaluation. London: Prentice Hall.
  16. Umoinyang, A.E.,Asim, A.E., Akwa, A. M. & Bassey, S. W.(2004).Principles and techniques of educational assessment and evaluation. Calabar: Helimo Associates.
  17. Uyanah, D. A. (2007). Functional correlates of the reliability of cognitive and affective mathematics Measures. A Master’s thesis submitted to Post Graduate School, University of Calabar, Calabar, Nigeria.
  18. Yeboah, C. (2019). A response to the issue of the difference between Kuder-Richardson formular 20 And Cronbach alpha coefficients. Retrieved from https//www.researchgate.net. Posted January.