Test of Figural Creativity – version for children and adults: an investigation of reliability by different methods

Tatiana de Cassia Nakano; Isabella Wonsik Cano; Ana Luiza Pelaquim Silva; Isabel Cristina Camelo de Abreu; Laura Gandia Romancini

doi:10.24310/escpsi.18.1.2025.20111

Authors

Tatiana de Cassia Nakano Brazil https://orcid.org/0000-0002-5720-8940
Isabella Pontifical Catholic University of Campinas Brazil
Ana Luiza Pontifical Catholic University of Campinas Brazil
Isabel Pontifical Catholic University of Campinas Brazil
Laura Pontifical Catholic University of Campinas Brazil

DOI:

https://doi.org/10.24310/escpsi.18.1.2025.20111

Keywords:

Reliability, Psychometric qualities, Psychological assesment

Abstract

Creative thinking has been valued in different contexts and is considered an essential skill in the 21st century. Despite this emphasis on the construct, the instruments for its assessment remain restricted in Brazil. Due to this scenario, this article presents the results of two studies aimed at investigating the reliability of the Figural Creativity Test
for adolescents and adults. In study 1, the temporal stability is estimated in a sample composed by 179 Brazilian participants aged 14 to 80 years. Correlation between test and retest was r = .665. In study 2, evaluator reliability, two judges evaluated the responses of 97 participants
and the correlation was r = .88. Favorable results motivate the continuation of the studies until the instrument can be available for professional use.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Publication Facts

This article

Author statements

Data availability

N/A

16%

External funding

N/A

32%

Competing interests

N/A

11%

This journal

Other journals

Articles accepted

16%

33%

Days to publication

384

145

Indexed in

—

Editor & editorial board: profiles
Academic society: N/A
Publisher: UNIVERSIDAD DE MÁLAGA

References

Acar, S., Berthiaume, K., Grajzel, K., Dumas, D., Flemister, C. T., & Organisciak, P. (2023). Applying automated originality score to the verbal form of Torrance Tests of Creative Thinking. Gifted Child Quarterly, 67(1), 3-27. https://doi.org/10.1177/00169862211061874

Acar, S., Branch, M. J., Burnett, C., & Cabra, J. F. (2021). Assessing the Universality of the Zero Originality Lists of the Torrance Tests of Creative Thinking (TTCT)-Figural: An Examination with African American College Students. Gifted Child Quarterly, 65(4), 354-369. https://doi.org/10.1177/00169862211012964

Acar, S., Lee, L. E., & Hodges, J. (2023). Assessing the Robustness of the Factor Structure of TTCT-Figural: A Meta-CFA Replication-Extension. Creativity Research Journal, 35(4), 547–567. https://doi.org/10.1080/10400419.2023.2209393

Alabbasi, A. M. A., Paek, S. H., Kim, D., & Cramond, B. (2022). What do educators need to know about the Torrance Test of Creative Thinking: a comprehensive view. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.1000385

Ambiel, R. A. M., & Carvalho, L. F. (2017). Validade e precisão de instrumentos de avaliação psicológica [Validity and reliability of psychological tests]. In M. R. C. Lins & J. C. Borsa (Orgs.), Avaliação psicológica: Aspectos teóricos e práticos [Psychological assessment: theoretial and practices aspects] (pp. 115-125). Vozes.

Anastasi, A. & Urbina, S. (2000). Testagem Psicológica [Psychological testing]. Artes Médicas.

Andrade, J.M. & Valentini, F. (2018). Diretrizes para a construção de testes psicológicos: a Resolução CFP n.009/2018 em destaque [Guidelines for the Construction of Psychological Tests: Regulation CFP No: 009/2018 in Highlight]. Psicologia Ciência e Profissão, 38 (n.spe.), 28-39. http://doi/org/10.1590/1982-3703000208890

Barbot, B., Hass, R. W., & Reiter-Palmon, R. (2019). Creativity assessment in psychological research: (Re)setting the standards. The Psychology of Aesthetics, Creativity, and the Arts, 13(2), 233-240. https://doi.org/10.1037/aca0000233

Bart, W. M., Hokanson, B., & Can, I. (2017). An investigation of the factor structure of the Torrance Tests of Creative Thinking. Educational Sciences: theory and practice, 17(2), 515-528. https://doi.org/10.12738/estp/2017.2.0051

Barth, P., & Stadtmann, G. (2024). Creativity in the West and the East: A Meta-Analysis of Cross-Cultural Differences. Creativity Research Journal, 1–47. https://doi.org/10.1080/10400419.2024.2369442

Becker, M., & Cabeza, R. (2023). Assessing creativity independently of language: A language-independent remote associate task (LI-RAT). Behavior Research Methods, 55, 85–102. https://doi.org/10.3758/s13428-021-01773-5

Berg, J., Vestena, C. L. B., & Costa-Lobo, C. (2020). Creativity in Brazilian education: review of a decade of literature. Creative Education, 11(3), 420-433. https://doi.org/10.4236/ce.2020.113030

Chu, T., & Lin, W. (2013). Uniqueness, integration, or separation? Exploring the nature of creativity through creative writing by elementary school students in Taiwan. International Journal of Experimental Educational Psychology, 33(5), 582-595. https://doi.org/10.1080/01443410.2013.821459

Cropley, D. H., Theurer, C., Mathijssen, A. C. S., & Marrone, R. L. (2024). Fit-For-Purpose Creativity Assessment: Automatic Scoring of the Test of Creative Thinking – Drawing Production (TCT-DP). Creativity Research Journal, 1–16. https://doi.org/10.1080/10400419.2024.2339667

De La Torre, S. (1991). Evaluacion de la creatividad. Editorial Escuela Española.

Gagné, F. (2004). Transforming gifts into talents: the DMGT as a developmental theory. High Ability Studies, 15(2), 119–147. https://doi.org/10.1080/1359813042000314682

Green, A. E., Beaty, R. E., Kenett, Y. N., & Kaufman, J. C. (2023). The Process Definition of Creativity. Creativity Research Journal, 36(3), 544–572. https://doi.org/10.1080/10400419.2023.2254573

Helfand, M., Kaufman, J. C., & Beghetto, R. A. (2017). The Four C Model of Creativity: Culture and context. In V. P. Glăveanu (Ed.), Palgrave handbook of creativity and culture research (pp. 15-360). Palgrave.

Jung, J. Y. (2022). Physical giftedness/talent: A systematic review of the literature on identification and development. Frontiers in Psychology, 13. https://doi.org/10.3389/fpsyg.2022.961624

Kasirer, A., Adi-Japha, E., & Mashal, N. (2020). Verbal and figural creativity in children with autism spectrum disorder and Typical Development. Frontiers in Psychology, 11. https://doi.org/10.3389/fpsyg.2020.559238

Kim, K. H. (2006). Can we trust creativity tests? A review of the Torrance Tests of Creative Thinking (TTCT). Creativity Research Journal, 18(1), 3-14. https://doi.org/10.1207/s15326934crj1801_2

Kim, K. H. (2011). The APA 2009 division 10 debate: are the Torrance Tests of Creative Thinking still relevant in the 21st century? Psychology of Aesthetics, Creativity, and the Arts, 5(4), 302-308. https://doi.org/10.1037/a0021917

Krumm, G., Arán-Filippetti, V., & López, M. B. (2024). Evaluación de la creatividad: dos estudios normativos del Test de Pensamiento Creativo de Torrance (TTCT), Figuras, Formas A y B en niños argentinos. Psicogente 27(51), 1-24. https://doi.org/10.17081/psico.27.51.6419

Kupers, E., Lehmann-Wermser, A., McPherson, G., & van Geert, P. (2019). Children’s Creativity: A Theoretical Framework and Systematic Review. Review of Educational Research, 89(1), 93–124. https://doi.org/10.3102/0034654318815707

Lassig, C. (2019). Creativity talent development: fostering creativity in schools. In S.R. Smith (Ed.), Handbook of giftedness and talent development in the Asia-Pacific (pp. 1-25). Springer.

Lee, L. E., Meyer, M. S., & Crutchfield, K. (2021). Gifted Classroom Environments and the Creative Process: A Systematic Review. Journal for the Education of the Gifted, 44(2), 107-148. https://doi.org/10.1177/01623532211001450

Lee, L. E., Rinn, A. N., & Rambo-Hernandez, K. E. (2024). What Happens After Nomination? Evaluating the Probability of Gifted Identification with the Torrance Test of Creative Thinking. Gifted Child Quarterly, 68(2), 119-136. https://doi.org/10.1177/00169862231222886

Long, H., & Wang, J. (2022). Dissecting Reliability and Validity Evidence of Subjective Creativity Assessment: A Literature Review. Educational Psychology Review, 34, 1399–1443. https://doi.org/10.1007/s10648-022-09679-0.

Lubart, T., Zenasni, F., & Barbot, B. (2013). Creative potential and its measurement. International Journal form Talent Development and Creativity, 1(2), 41-50. https://files.eric.ed.gov/fulltext/EJ1301375.pdf

Nakano, T. C., & Wechsler, S. M. (2006). Teste Brasileiro de Criatividade Figural: proposta de instrumento [Brazilian test of figural creativity.: instrumental proposal] Interamerican Journal of Psychology, 40(1), 103-110. https://www.redalyc.org/pdf/284/28440111.pdf.

Nakano, T. C., & Wechsler, S. M. (2018). Creativity and innovation: Skills for the 21 Century. Estudos de Psicologia (Campinas), 35(3), 237-246. https://doi.org/10.1590/1982- 02752018000300002

Nakano, T. C., Batagin, L. R., Cano, I. W., & Fusaro, G. J. (2023). Teste de Criatividade Figural versão adolescentes e adultos: evidências de validade convergente [The Figural Creativity Test: Teen and Adult Version: Evaluation of the Converging Type’s Validity]. Revista Iberoamericana de Diagnóstico y Evaluación – e Avaliação Psicológica, 69(3), 5-14. https://doi.org/10.21865/RIDEP69.3.01

Nakano, T. C., Fusaro, G. J., Cano, I. W., Batagin, L. R., & de Abreu, I. C. C. (2023). A influência da idade na cotação de originalidade em um teste de criatividade figural [The effect of age on originality quotations in a figural creativit test]. Revista Ibero-Americana de Criatividade e Inovação-RECRIAI, 4. https://recriai.emnuvens.com.br/revista/article/view/92

Nakano, T. C., Primi, R., & Zaia, P. (2023). Revisão dos modelos de criatividade [Review of creativity models]. In Instituto Ayrton Senna, R. Primi, T. C. Nakano, K. McGrew, & J. Schneider (Orgs.), Educação no século XXI: inteligência, pensamento crítico e criatividade (pp. 185-291). Hogrefe e Instituto Ayrton Senna.

Nakano. T. C. (2018). A criatividade pode ser medida? Reflexões sobre métodos utilizados e questões envolvidas [Can creativity be measured? Reflections on methods used and issues involved]. Arquivos Brasileiros de Psicologia, 70(1), 128-145). https://doi.org/10.1590/1413-82712018230313

Niu, W., & Sternberg, R. J. (2006). The philosophical roots of Western and Eastern conceptions of creativity. Journal of Theoretical and Philosophical Psychology, 26(1–2), 18–38. https://doi.org/10.1037/h0091265

Nunes, C. H. S. S., & Primi, R. (2010). Aspectos técnicos e conceituais da ficha de avaliação dos testes psicológicos [Technical and conceptual aspects of the psychological test evaluation form]. In Conselho Federal de Psicologia (CFP), Avaliação Psicológica: diretrizes na regulamentação da profissão (pp. 101-128). CFP.

O’Tolle, K., & Horvát, E. (2024). Extending human creativity with AI. Journal of Creativity, 34(2), 100080. https://doi.org/10.1016/j.yjoc.2024.100080

Oliveira, K. S., Nakano, T. C., & Wechsler, S. M. (2016). Criatividade e saúde mental: uma revisão da produção científica na última década [Creativity and Mental Health: A Review of Scientifi c Production in the Last Decade]. Temas em Psicologia, 24(4), 1493-1506. http://doi.org/10.9788/TP2016.4-16

Patterson, J. D., Merseal, H. M., Johnson, D. R., Agnoli, S., Baas, M., Baker, B. S., Barbot, B., Benedek, M., Borhani, K., Chen, Q., Christensen, J. F., Corazza, G. E., Forthmann, B., Karwowski, M., Kazemian, N., Kreisberg-Nitzav, A., Kenett, Y. N., Link, A., Lubart, T.,… Beaty, R. E. (2023). Multilingual semantic distance: Automatic verbal creativity assessment in many languages. Psychology of Aesthetics, Creativity, and the Arts, 17(4), 495–507. https://doi.org/10.1037/aca0000618

Peixoto, E. M., & Ferreira-Rodrigues, C. F. (2019). Propriedades psicométricas dos testes psicológicos [Psychometrics Properties of psychological tests]. In M. N. Baptista et al. (Orgs.), Compêndio de avaliação psicológica (pp. 29-39). Vozes.

Plucker, J. A. (2022). The Patient is Thriving! Current Issues, Recent Advances, and Future Directions in Creativity Assessment. Creativity Research Journal, 35(3), 291–303. https://doi.org/10.1080/10400419.2022.2110415

Plucker, J. A., & Beghetto, R. (2004). Why creativity is domain general, why it looks domain specific, and why the distinction does not matter. In R. J. Sternberg, E. L. Grigorenko, & J. L. Singer (Eds.), Creativity: from potential to realization (pp. 153-167). American Psychological Association. https://doi.org/10.1037/10692-009

Plucker, J. A., Guo, J., & Makel, M. C. (2018). Creativity. In S. I. Pfeiffer (Ed.), Handbook of giftedness in children (2nd ed., pp. 81-99). Springer.

Puccio, G. J., & Murdock, M. C. (1999). Creativity assessment: Readings and resources. Creative Education Foundation Press.

Renzulli, J. S. (2005). The Three-Ring Conception of Giftedness: A Developmental Model for Promoting Creative Productivity. In R. J. Sternberg & J. E. Davidson (Eds.), Conceptions of giftedness (2nd ed., pp. 246–279). Cambridge University Press. https://doi.org/10.1017/CBO9780511610455.015

Renzulli, J. S. (2016). The three-ring conception of giftedness: A developmental model for promoting creative productivity. In S. M. Reis (Ed.), Reflections on gifted education (pp. 55–86). Prufrock Press.

Revelle, W., & Condon, D. M. (2019). Reliability from α to ω: A tutorial. Psychological Assessment, 31(12), 1395–1411. https://doi.org/10.1037/pas0000754

Rocha, K. N. & Wechsler, S. M. (2018). A avaliação da criatividade nas organizações: estudo comparativo entre técnicas usuais e estandardizadas de avaliação psicológica [The Evaluation of Creativity in Organizations: Comparative Study of Usual and Standardized Psychological Evaluation Techniques]. Revista Iberoamericana de Diagnostico y Evaluacion – e Avaliação Psicológica, 48(3), 139-149. https://www.redalyc.org/journal/4596/459657523013/

Runco, M. A. (2023). Updating the Standard Definition of Creativity to Account for the Artificial Creativity of AI. Creativity Research Journal, 37(1), 1–5. https://doi.org/10.1080/10400419.2023.2257977

Runco, M.A. (2016). We must prepare for the unforeseeable future. In D. Ambrose & R.J. Sternberg (Eds.), Creative intelligence in the 21st century: grappling with enormous problems and huge opportunities (pp. 65-73). Sense Publishers.

Sánchez-Meca, J., López-Pina, J. A., & López-López, J. A. (2008). A review of the meta-analytic studies of reliability generalization. Escritos de Psicologia, 2(1), 110-121. https://revistas.uma.es/index.php/espsi/article/view/13365/13660

Sato, D. T. B., & Seabra A., G. (2022). Avaliação na Neuropsicopedagogia clínica [Assessment in Clinical Neuropsychology]. Wak Editora.

Sierra, M. D. V., Cervantes, C. J. R., Verche, E., & Espinoza, B. V. P. (2024). Creativity and Decision Making in Giftedness. Education Sciences, 14(3), 251. https://doi.org/10.3390/educsci14030251

Sternberg, R. J. (1997). The triarchic theory of intelligence. In D. P. Flanagan, J. L. Genshaft, & P. L. Harrison (Eds.), Contemporary intellectual assessment: Theories, tests, and issues (pp. 92–104). The Guilford Press.

Sternberg, R. J., Glăveanu, V., & Kaufman, J. C. (2022). In Quest of Creativity: Three Paths toward an Elusive Grail. Creativity Research Journal, 36(1), 155–175. https://doi.org/10.1080/10400419.2022.2107299

Sternberg, R.J. (2005). The WICS model of giftdness. In R. J. Stenberg & J. E. Davidson (Eds.), Conceptions of Giftdeness (pp. 243-327). Cambridge University Press.

Tannenbaum, A. J. (1986). Giftedness: A psychosocial approach. In R. Sternberg, y J. David- son, J. (Eds.). Conceptions of giftedness (pp. 21-52). Cambridge University Press.

Terai, H., Miwa, K., & Mizuno, S. (2024). Stability of Assessment Using Creativity-Related Indices. Japanese Psychological Research, 1-14. http://doi.org/10.1111/jpr.12519

Treffinger, D. J. (1995). School development, talent development, and creativity. Roeper Review, 18, 93-97. https://doi.org/10.1080/02783199509553707

Treffinger, D. J., Schoonover, P. F., & Selby, E. C. (2013). Educating for creativity & innovation. Prufrock.

Xu, S., Reiss, M. J., & Lodge, W. (2024). Comprehensive Scientific Creativity Assessment (C-SCA): A New Approach for Measuring Scientific Creativity in Secondary School Students. International Journal of Science and Mathematics Education, https://doi.org/10.1007/s10763-024-10469-z

Yahn, L., & Kaufman, J. C. (2016). Asking the wrong question: Why shouldn’t people dislike creativity? In D. Ambrose & R. J. Sternberg (Eds.), Creative intelligence in the 21st century: Grappling with enormous problems and huge opportunities (pp. 75-87). Sense.

Zhu, W., Shang, S., Jiang, W., Pei, M., & Su, Y. (2019). Convergent thinking moderates the relationship between divergent thinking and scientific creativity. Creativity Research Journal, 31(3), 320-328. http://doi.org/10.1080/10400419.2019.1641685

Ziegler, A. (2009). Research on giftedness in the 21st century. In L.V. Shavinina (Ed.), International Handbook on Giftedness (pp.1509-1524). Springer. https://doi.org/10.1007/978-1-4020-6162-228