Assessing the Universality of the Zero Originality Lists of the Torrance Tests of Creative Thinking (TTCT)-Figural: An Examination With African American College Students

Abstract

Originality is scored based on standard zero-originality lists (ZOLs) in the Torrance Tests of Creative Thinking (TTCT). The applicability of those ZOLs to diverse groups has not been examined. We examined the consistency of TTCT-Figural’s sample-based (SB) ZOLs and the published ZOLs based on a sample of predominantly African American college students (n = 464 and n = 493 for Forms A and B, respectively). Then, we scored 193 forms using SB-ZOLs and published ZOLs. Compared with the old ZOLs, the updated ZOLs yielded more consistent results with the SB-ZOLs when a 3% cutoff is used for Activity 3. However, the new ZOLs made more improvement in Form A than Form B and in Activity 2 than Activities 1 and 3. Further studies are needed to determine if the inconsistencies stem from cultural differences or the method of updating the ZOLs. The results are discussed in terms of the implications for gifted identification.

Keywords

assessment creativity psychometrics

Get full access to this article

View all access options for this article.

References

Acar

Runco

M. A.

(2014). Assessing associative distance among ideas elicited by tests of divergent thinking. Creativity Research Journal, 26(2), 229-238. https://doi.org/10.1080/10400419.2014.901095

Acar

Runco

M. A.

(2019). Divergent thinking: New methods, recent research, and extended theory. Psychology of Aesthetics, Creativity, and the Arts, 13(2), 153-158. https://doi.org/10.1037/aca0000231

Acar

Runco

M. A.

Park

(2020). What should people be told when they take a divergent thinking test? A meta-analytic review of explicit instructions for divergent thinking. Psychology of Aesthetics, Creativity, and the Arts, 14(1), 39-49. https://doi.org/10.1037/aca0000256

Amabile

T. M.

(1982). Social psychology of creativity: A consensual assessment technique. Journal of Personality and Social Psychology, 43(5), 997-1013. https://doi.org/10.1037/0022-3514.43.5.997

Besemer

S. P.

(1998). Creative product analysis matrix: Testing the model structure and a comparison among products—three novel chairs. Creativity Research Journal, 11(4), 333-346. https://doi.org/10.1207/s15326934crj1104_7

Bravo

(2003). Instrument development: Cultural adaptations in ethnic minority research. In Bernal

Trimble

Burlew

Leong

(Eds.), Handbook of racial ethnic minority psychology (pp. 220-232). Sage.

Burlew

A. K.

Peteet

B. J.

McCuistian

Miller-Roenigk

B. D.

(2019). Best practices for researching diverse groups. American Journal of Orthopsychiatry, 89(3), 354-368. https://doi.org/10.1037/ort0000350

Carson

S. H.

Peterson

J. B.

Higgins

D. M.

(2005). Reliability, validity, and factor structure of the creative achievement questionnaire. Creativity Research Journal, 17(1), 37-50. https://doi.org/10.1207/s15326934crj1701_4

Clark

P. M.

Mirels

H. L.

(1970). Fluency as a pervasive element in the measurement of creativity. Journal of Educational Measurement, 7(2), 83-86. https://doi.org/10.1111/j.1745-3984.1970.tb00699.x

10.

Collegedata.com. (2020). College profile: University of the Virgin Islands. https://www.collegedata.com/college-search/university-of-the-virgin-islands

11.

Cramond

(1994). The Torrance Tests of Creative Thinking: From design through establishment of predictive validity. In Subotnik

R. F.

Arnold

K. D.

(Eds.), Creativity research: Beyond Terman: Contemporary longitudinal studies of giftedness and talent (pp. 229-254). Ablex Publishing.

12.

Cramond

Matthews-Morgan

Bandalos

Zuo

(2005). A report on the 40-year follow-up of the Torrance Tests of Creative Thinking: Alive and well in the new millennium. Gifted Child Quarterly, 49(4), 283-291. https://doi.org/10.1177/001698620504900402

13.

Domino

(1970). Identification of potentially creative persons from the Adjective Check List. Journal of Consulting and Clinical Psychology, 35(1, pt. 1), 48-51. https://doi.org/10.1037/h0029624

14.

Dumas

Dunbar

K. N.

(2014). Understanding fluency and originality: A latent variable perspective. Thinking Skills and Creativity, 14(December), 56-67. https://doi.org/10.1016/j.tsc.2014.09.003

15.

Eid

Gollwitzer

Schmitt

(2011). Statistik und forschungsmethoden: Lehrbuch [Statistics and research methods: A textbook]. Beltz.

16.

Engerman

Alexandridis

Drost

Michailidis

(2010). The pedagogical use of creative problem solving. In Pardlow

Trent

M. A.

(Eds.), Cultivating visionary leadership by learning for global success: Beyond the language and literature classroom (pp. 196-207). Cambridge Scholars Publishing.

17.

Forster

E. A.

Dunbar

K. N.

(2009). Creativity evaluation through latent semantic analysis. In Taatgen

N. A.

van Rijn

(Eds.), In Proceedings of the 31st Annual Conference of the Cognitive Science Society (pp. 602-607). Cognitive Science Society.

18.

Forthmann

Paek

S. H.

Dumas

Barbot

Holling

(2020). Scrutinizing the basis of originality in divergent thinking tests: On the measurement precision of response propensity estimates. British Journal of Educational Psychology, 90(3), 683-699. https://doi.org/10.1111/bjep.12325

19.

Forthmann

Szardenings

Holling

(2020). Understanding the confounding effect of fluency in divergent thinking scores: Revisiting average scores to quantify artifactual correlation. Psychology of Aesthetics, Creativity, and the Arts, 14(1), 94-112. https://doi.org/10.1037/aca0000196

20.

Gilhooly

K. J.

Fioratou

Anthony

S. H.

Wynn

(2007). Divergent thinking: Strategies and executive involvement in generating novel uses for familiar objects. British Journal of Psychology, 98(4), 611-625. https://doi.org/10.1111/j.2044-8295.2007.tb00467.x

21.

Guilford

J. P.

(1956). The structure of intellect. Psychological Bulletin, 53(4), 267-293. https://doi.org/10.1037/h0040755

22.

Guilford

J. P.

(1967). The nature of human intelligence. McGraw-Hill.

23.

Guilford

J. P.

(1988). Some changes in the structure-of-intellect model. Educational and Psychological Measurement, 48(1), 1-4. https://doi.org/10.1177/001316448804800102

24.

Hass

R. W.

(2017). Tracking the dynamics of divergent thinking via semantic distance: Analytic methods and theoretical implications. Memory & Cognition, 45(2), 233-244. https://doi.org/10.3758/s13421-016-0659-y

25.

Hébert

T. P.

Cramond

Neumeister

K. L. S.

Millar

Silvian

A. F.

(2002). E. Paul Torrance: His life, accomplishments, and legacy. University of Connecticut, National Research Center on the Gifted and Talented.

26.

Hocevar

(1979, April 16-19). The development of the Creative Behavior Inventory [Paper presentation]. Annual meeting of the Rocky Mountain Psychological Association. https://eric.ed.gov/?id=ED170350

27.

Hocevar

(1981). Measurement of creativity: Review and critique. Journal of Personality Assessment, 45(5), 450-464. https://doi.org/10.1207/s15327752jpa4505_1

28.

Hunsaker

S. L.

Callahan

C. M.

(1995). Creativity and giftedness: Published instrument uses and abuses. Gifted Child Quarterly, 39(2), 110-114. https://doi.org/10.1177/001698629503900207

29.

G. W. M.

Chen

Chiu

C. Y.

(2006). The relationship of promotion focus, need for cognitive closure, and categorical accessibility in American and Hong Kong Chinese university students. Journal of Creative Behavior, 40(3), 201-215. https://doi.org/10.1002/j.2162-6057.2006.tb01273.x

30.

Johnson

(2015). Who moved my cheese? Random House.

31.

Kaltsounis

(1974). Race, socioeconomic status and creativity. Psychological Reports, 35(1), 164-166. https://doi.org/10.2466/pr0.1974.35.1.164

32.

Kaufman

J. C.

(2009). Creativity, intelligence, and culture: Connections and possibilities. In Meusburger

Funke

Wunder

(Eds.), Milieus of creativity: An interdisciplinary approach to spatiality of creativity (Vol. 2., pp. 155-168). Springer.

33.

Kaufman

J. C.

Plucker

J. A.

Baer

(2008). Essentials of creativity assessment (Vol. 53). John Wiley.

34.

Kim

K. H.

(2006). Can we trust creativity tests? A review of the Torrance Tests of Creative Thinking (TTCT). Creativity Research Journal, 18(1), 3-14. https://doi.org/10.1207/s15326934crj1801_2

35.

Kim

K. H.

(2011). The creativity crisis: The decrease in creative thinking scores on the Torrance Tests of Creative Thinking. Creativity Research Journal, 23(4), 285-295. https://doi.org/10.1080/10400419.2011.627805

36.

Kim

K. H.

Cramond

Bandalos

D. L.

(2006). The latent structure and measurement invariance of scores on the Torrance Tests of Creative Thinking–Figural. Educational and Psychological Measurement, 66(3), 459-477. https://doi.org/10.1177/0013164405282456

37.

Kirton

(1976). Adaptors and innovators: A description and measure. Journal of Applied Psychology, 61(5), 622-629. https://doi.org/10.1037/0021-9010.61.5.622

38.

Krumm

Filipppetti

V. A.

Lemos

Koval

Balabanian

(2016). Construct validity and factorial invariance across sex of the Torrance Test of Creative Thinking: Figural Form A in Spanish-speaking children. Thinking Skills and Creativity, 22(December), 180-189. https://doi.org/10.1016/j.tsc.2016.10.003

39.

Landis

J. R.

Koch

G. G.

(1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159-174. https://doi.org/10.2307/2529310

40.

Lenhard

(2014). Hypothesis tests for comparing correlations. https://www.psychometrica.de/correlation.html.

41.

Lubart

Besançon

Barbot

(2011). EPOC: évaluation du potentiel créatif. Hogrefe.

42.

Marín

B. V.

(1991). Applied social research methods series: Research with Hispanic populations. Sage.

43.

Millar

G. W.

(1995). E. Paul Torrance: “The creativity man.” Ablex.

44.

Mouchiroud

Lubart

(2001). Children’s original thinking: An empirical examination of alternative measures derived from divergent thinking tasks. Journal of Genetic Psychology, 162(4), 382-401. https://doi.org/10.1080/00221320109597491

45.

Peters

S. J.

Gentry

Whiting

G. W.

McBee

M. T.

(2019). Who gets served in gifted education? Demographic representation and a call for action. Gifted Child Quarterly, 63(4), 273-287. https://doi.org/10.1177/0016986219833738

46.

Plucker

J. A.

Qian

Schmalensee

S. L.

(2014). Is what you see what you really get? Comparison of scoring techniques in the assessment of real-world divergent thinking. Creativity Research Journal, 26(2), 135-143. https://doi.org/10.1080/10400419.2014.901023

47.

Price-Williams

D. R.

Ramirez

III . (1977). Divergent thinking, cultural differences, and bilingualism. Journal of Social Psychology, 103(1), 3-11. https://doi.org/10.1080/00224545.1977.9713289

48.

Reiter-Palmon

Forthmann

Barbot

(2019). Scoring divergent thinking tests: A review and systematic framework. Psychology of Aesthetics, Creativity, and the Arts, 13(2), 144-152. https://doi.org/10.1037/aca0000227

49.

Ross

(1963). A report on the Torrance Tests of Creative Thinking administered to fifth-graders at two socioeconomic levels. Department of Research, Oakland Public Schools.

50.

Runco

M. A.

(1991). Divergent thinking. Ablex Publishing Corporation.

51.

Runco

M. A.

(2020). Divergent thinking. In Runco

M. A.

Pritzker

S. R.

(Eds.), Encyclopedia of creativity (3rd ed., Vol. 1, pp. 356-361). Academic Press.

52.

Runco

M. A.

Acar

(2010). Do tests of divergent thinking have an experiential bias? Psychology of Aesthetics, Creativity, and the Arts, 4(3), 144-148. https://doi.org/10.1037/a0018969

53.

Runco

M. A.

Millar

Acar

Cramond

(2010). Torrance tests of creative thinking as predictors of personal and public achievement: A fifty-year follow-up. Creativity Research Journal, 22(4), 361-368. https://doi.org/10.1080/10400419.2010.523393

54.

Saeki

Fan

Van Dusen

L. V.

(2001). A comparative study of creative thinking of American and Japanese college students. Journal of Creative Behavior, 35(1), 24-38. https://doi.org/10.1002/j.2162-6057.2001.tb01219.x

55.

Said-Metwaly

Fernández-Castilla

Kyndt

Van den Noortgate

(2018). The factor structure of the Figural Torrance Tests of Creative Thinking: A meta-confirmatory factor analysis. Creativity Research Journal, 30(4), 352-360. https://doi.org/10.1080/10400419.2018.1530534

56.

Silvia

P. J.

Nusbaum

E. C.

Beaty

R. E.

(2017). Old or new? Evaluating the old/new scoring method for divergent thinking tasks. Journal of Creative Behavior, 51(3), 216-224. https://doi.org/10.1002/jocb.101

57.

Smith

R. M.

(1965). The relationship of creativity to social class (Final Report on Cooperative Research Project 2250, Office of Education). School of Education, University of Pittsburgh.

58.

Snyder

H. T.

Hammond

J. A.

Grohman

M. G.

Katz-Buonincontro

(2019). Creativity measurement in undergraduate students from 1984-2013: A systematic review. Psychology of Aesthetics, Creativity, and the Arts, 13(2), 133-143. https://doi.org/10.1037/aca0000228

59.

Torrance

E. P.

(1966). Torrance tests of creative thinking: Norms-technical manual (Research ed.). Personnel Press.

60.

Torrance

E. P.

(1969). Prediction of adult creative achievement among high school seniors. Gifted Child Quarterly, 13(4), 223-229. https://doi.org/10.1177/001698626901300401

61.

Torrance

E. P.

(1971). Are the Torrance Tests of Creative Thinking biased against or in favor of “disadvantaged” groups? Gifted Child Quarterly, 15(2), 75-80. https://doi.org/10.1177/001698627101500201

62.

Torrance

E. P.

(1972a). Career patterns and peak creative achievements of creative high school students twelve years later. Gifted Child Quarterly, 16(2), 75-88. https://doi.org/10.1177/001698627201600201

63.

Torrance

E. P.

(1972b). Predictive validity of the Torrance Tests of Creative Thinking. Journal of Creative Behavior, 6(4), 236-252. https://doi.org/10.1002/j.2162-6057.1972.tb00936.x

64.

Torrance

E. P.

(1974). Torrance Tests of Creative Thinking Norms: Technical manual. Personal Press/Ginn and Company.

65.

Torrance

E. P.

(1977). Discovery and nurturance of giftedness in the culturally different (ERIC Document Reproduction Service No. ED145621). ERIC Clearinghouse on Handicapped and Gifted Children. https://files.eric.ed.gov/fulltext/ED145621.pdf

66.

Torrance

E. P.

(1980). Norms-technical manual: Demonstrator form for the Torrance Tests of Creative Thinking [Unpublished Manuscript]. Georgia Studies of Creative Behavior, Athens, GA.

67.

Torrance

E. P.

(1981a). Empirical validation of criterion-referenced indicators of creative ability through a longitudinal study. Creative Child and Adult Quarterly, 6(3), 136-140.

68.

Torrance

E. P.

(1981b). Predicting the creativity of elementary school children (1958–80)—and the teacher who “made a difference.” Gifted Child Quarterly, 25(2), 55-62. https://doi.org/10.1177/001698628102500203

69.

Torrance

E. P.

(1998). Torrance Tests of Creative Thinking: Streamlined scoring guide for Figural Forms A and B. Scholastic Testing Services, Inc.

70.

Torrance

E. P.

(2008). Torrance Tests of Creative Thinking: Streamlined scoring guide for Figural Forms A and B. Scholastic Testing Services, Inc.

71.

Torrance

E. P.

(2017). Torrance Tests of Creative Thinking: Streamlined scoring guide for Figural Forms A and B. Scholastic Testing Services, Inc.

72.

Van de Vijver

Tanzer

N. K.

(2004). Bias and equivalence in cross-cultural assessment: An overview. European Review of Applied Psychology, 54(2), 119-135. https://doi.org/10.1016/j.erap.2003.12.004

73.

Villalba

(2012). Searching for the holy grail of measuring creativity. Creativity Research Journal, 24(1), 1-2. https://doi.org/10.1080/10400419.2012.649235

74.

Wallach

M. A.

Kogan

(1965). Modes of thinking in young children: A study of the creativity–intelligence distinction. Holt, Rinehart, & Winston.

75.

Yoon

C. H.

(2017). A validation study of the Torrance Tests of Creative Thinking with a sample of Korean elementary school students. Thinking Skills and Creativity, 26(December), 38-50. https://doi.org/10.1016/j.tsc.2017.05.004

Supplementary Material

Please find the following supplemental material available below.

For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.

For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.

0.00 MB

0.02 MB