Exploring the factors of the English Comprehension Test

Abstract

The empirically designed English Comprehension Test was initially developed as a means of assessing individual’s English comprehension skills. The test development of the English Comprehension Test led to the piloting of two test versions of the English Comprehension Test, namely, version 1.2 and version 1.3. The purpose of this study was to statistically explore the factors emerging from the two test versions of the English Comprehension Test. This study is the initial step towards establishing the construct validity, which forms part of the validation of the English Comprehension Test. This quantitative study involved an exploratory inspection of the factors of the English Comprehension Test, with the use of factor analyses. It also employed two factor extraction methods (Principal Component Analysis and Principal Axis Factoring) for comparison. These two factor extraction methods used for the exploratory factor analyses revealed a dominant factor for both test versions of the English Comprehension Test, thereby endorsing an argument for unidimensionality of the English Comprehension Test. The similarities between the results for the two test versions confirmed the existence of an inherent structure for the English Comprehension Test, despite the differences between the two test versions. The labelling of the factors of the test also suggests that the English Comprehension Test could be an assessment of cognitive (verbal) aptitude. A major limitation of this study is the restriction of range and lack of generalizability. The contribution made by this study will enhance psychometric validation studies in South Africa as well as increasing literature on South African test construction for multicultural and multilingual individuals.

Keywords

Comprehension factor analysis Principal Axis Factoring Principal Component Analysis psychometrics test development

Get full access to this article

View all access options for this article.

References

Arendse

D. E.

(2011). Analysis of the English Comprehension Test Version 1.2. Unpublished research report, Military Psychological Institute, Pretoria, South Africa.

Broom

Jewson

D. D.

(2013). The Stanford Diagnostic Reading Test: Assessing English reading comprehension and vocabulary in South Africa. Per Linguam, 29(2), 1–16.

Field

A. P.

(2017). Discovering statistics using IBM SPSS Statistic. London, England: SAGE.

Foxcroft

C. D.

(2004). Planning a psychological test in the multicultural South African context. South African Journal of Industrial Psychology, 30(4), 8–15.

Gernsbacher

M. A.

(1990). Language comprehension as structure building. Hillsdale, NJ: Lawrence Erlbaum.

Lin

(2015). A study on the relationship between English reading comprehension and English vocabulary knowledge. Education Research International, 2015, Article 209154.

Mahoney

K. S.

MacSwan

(2005). Re-examining identification and reclassification of English language learners: A critical discussion of select state practices. Bilingual Research Journal, 29, 31–42.

McDonald

Van Eeden

(2014). The impact of home language on the understanding of the vocabulary used in the South African version of the sixteen Personality Factor Questionnaire Fifth Edition. South African Journal of Psychology, 44, 228–242.

Oberholzer

(2005). The relationship between reading difficulties and academic performance among a group of foundation phase learners who have been: 1) identified as experiencing difficulty with reading and 2) referred for reading remediation (Unpublished master’s thesis). Richards Bay, South Africa: University of Zululand.

10.

Ormrod

J. E.

(2008). Educational psychology, developing learners (6th ed.). Upper Saddle River, NJ: Pearson/Prentice Hall.

11.

Pretorius

E. J.

(2002). Reading ability and academic performance in South Africa: Are we fiddling while Rome is burning? Language Matters, 33, 169–196.

12.

Salehi

(2011). On the factor structure of a reading comprehension test. English Language Teaching, 4, 242–249.

13.

Sijtsma

(2012). Psychological measurement between physics and statistics. Theory & Psychology, 22, 786–809.

14.

Tabachnick

B. G.

Fidell

L. S.

(2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson Education.

15.

Van de Vijver

F. J. R.

Rothmann

(2004). Assessment in multicultural groups: The South African case. South African Journal of Industrial Psychology, 30(4), 1–7.

16.

Van de Vijver

F. J. R.

Tanzer

N. K.

(2004). Bias and equivalence in cross-cultural assessment: An overview. Revue Europeenne de psychologie appliquee, 54, 119–135.

17.

Van den Broek

Gustafson

(1999). Comprehension and memory for texts: Three generations of reading research. In Goldman

S. R.

Graesser

A. C.

Van den Broek

(Eds.), Narrative comprehension, causality and coherence: Essays in honor of Tom Trabasso (pp. 15–34). Mahwah, NJ: Lawrence Erlbaum.

18.

Williams

Onsman

Brown

(2010). Exploratory factor analysis: A five-step guide for novices. Journal of Emergency Primary Health Care, 8(3), 1–13.

19.

Yong

A. C.

Pearce

(2013). A beginner’s guide to factor analysis: Focusing on exploratory factor analysis. Tutorials in Quantitative Methods for Psychology, 9(2), 79–94.