Abstract
Background: The Short Mood and Feelings Questionnaire (SMFQ) is one of the few well-established available measures designed to assess childhood depression. The objective of the present study was to assess the psychometric properties and explore the differential item functioning (DIF) of the SMFQ in a community sample of Spanish children. Gender and age differences in SMFQ scores were also analyzed. Method: The sample included 824 students aged 8-12 years (Mage = 9.64, SD = 1.2) recruited from four public and private schools in urban areas in the southeast of Spain. Results: Findings from factor analysis and Polytomous Rasch analysis supported a unidimensional interpretation of the SMFQ, thereby replicating findings across cultures and languages. The SMFQ had good reliability, and test-retest analysis indicated fair to good temporal stability. Evidence of construct validity was provided by a path diagram of the SMFQ and SDQ subscales. No age or gender differences in the SMFQ scores were observed. However, two items (3 and 11) exhibited gender-related DIF. Conclusions: The use of SMFQ sum-scores as a continuous measure of the severity of depressive symptoms can be supported. The measure shows promise as brief, reliable, valid instrument for the assessment of depressive symptoms in Spanish children.
References
Adewuya, A. O., Ola, B. A., Dada, A. O., & Fasoto, O. O. (2006). Validation of the Edinburgh Postnatal Depression Scale as a screening tool for depression in late pregnancy among Nigerian women. Journal of Psychosomatic Obstetrics and Gynecology, 27(4), 267-272. https://doi.org/10.1080/01674820600915478
Aggen, S. H., Neale, M. C., & Kendler, K. S. (2005). DSM criteria for major depression: Evaluating symptom patterns using latent-trait item response models. Psychological Medicine, 35, 475-487. https://doi.org/10.1017/S0033291704003563
American Psychiatric Association (2013). Diagnostic and statistical manual of mental disorders, fifth edition (DSM-5). American Psychiatric Publishing. https://doi.org/10.4135/9781483365817.n433
Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/BF02293814 Angold, A., Costello, E. J., Messer, S. C., Pickles, A., Winder, F., & Silver, D. (1995). Development of a short questionnaire for use in epidemiological studies of depression in
children and adolescents. International Journal of Methods in Psychiatric Research, 5, 237-249.
Angold, A., Costello, E. J., Pickles, E., & Winder, F. (1987). The development of a questionnaire for use in epidemiological studies of depression in children and adolescents. Unpublished manuscript.
Angold, A., Erkanli, A., Silberg, J., Eaves, L., & Costello, E. J. (2002). Depression scale scores in 8-17-year-olds: Effects of age and gender. Journal of Child Psychology and Psychiatry, 43(8), 1052-1063. https://doi.org/10.1111/1469-7610.00232
Avenevoli, S., Swendsen, J., He, J. P., Burstein, M., & Merikangas, K. R. (2015). Major depression in the national comorbidity survey-adolescent supplement: Prevalence, correlates, and treatment. Journal of the American Academy of Child & Adolescent Psychiatry, 54(1), 37-44. https://doi.org/10.1016/j.jaac.2014.10.010
Banh, M. K., Crane, P. K., Rhew, I., Gudmundsen, G., Stoep, A. V., Lyon, A., & McCauley, E. (2012). Measurement equivalence across racial/ethnic groups of the Mood and Feelings Questionnaire for childhood depression. Journal of Abnormal Child Psychology, 40, 353-367. https://doi.org/10.1007/s10802-011-9569-4
Beck, A. T. (1961). Beck Depression Inventory [Measurement Instrument]. Center for Cognitive Therapy.
Bernaras, E., Jaureguizar, J., & Garaigordobil, M. (2019). Child and adolescent depression: A review of theories, evaluation instruments, prevention programs, and treatments. Frontiers in Psychology, 10, Article 543. https://doi.org/10.3389/fpsyg.2019.00543
Bond, T. G., & Fox, C. M. (2013). Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press.
Canals-Sans, J., Hernández-Martínez, C., Sáez-Carles, M., & Arija-Val, V. (2018). Prevalence of DSM-5 depressive disorders and comorbidity in Spanish early adolescents: Has there been an increase in the last 20 years? Psychiatry Research, 268, 328-334. https://doi.org/10.1016/j.psychres.2018.07.023
Choi, S. W., Gibbons, L. E., & Crane, P. K. (2011). Lordif: An R package for detecting differential item functioning using iterative hybrid ordinal logistic regression/item response theory and Monte Carlo simulations. Journal of Statistical Software, 39(8), 1-30. https://doi.org/10.18637/jss.v039.i08
Clark, C., Rodgers, B., Caldwell, T., Power, C., & Stansfeld, S. (2007). Childhood and adulthood psychological ill health as predictors of midlife affective and anxiety disorders: The 1958 British birth cohort. Archives of General Psychiatry, 64, 668-678. https://doi.org/10.1001/archpsyc.64.6.668
Costello, E. J., Benjamin, R., Angold, A., & Silver, D. (1991). Mood variability in adolescents: A study of depressed, nondepressed and comorbid patients. Journal of Affective Disorders, 23(4), 199-212. https://doi.org/10.1016/0165-0327(91)90101-w
Deeba, F., Rapee, R. M., & Prvan, T. (2015). Psychometric properties of two measures of childhood internalizing problems in a Bangladeshi sample. British Journal of Clinical Psychology, 54, 214-232. https://doi.org/10.1111/bjc.12071
Español-Martín, G., Pagerols, M., Prat, R., Rivas, C., Sixto, L., Valero, S., Artigas, M. S., Ribasés, M., Ramos-Quiroga, J. A., Casas, M., & Bosch, R. (2021). Strengths and Difficulties Questionnaire: Psychometric Properties and Normative Data for Spanish 5 to 17 Years Old. Assessment, 28(5), 1445–1458. https://doi.org/10.1177/1073191120918929
Fernández-Martínez, I., Morales, A., Espada, J. P., & Orgilés, M. (2020). Psychometric properties and factorial structure of the Spanish version of the parent-report Mood and Feelings Questionnaire (MFQ-P). Clinical Child Psychology and Psychiatry, 25(2), 533-544. https://doi.org/10.1177/1359104519897939
Ferrando, P. J., Lorenzo-Seva, U., Hernández-Dorado, A., & Muñiz, J. (2022). Decalogue for the factor analysis of test items. Psicothema, 34(1), 7-17. https://doi.org/10.7334/psicothema2021.456
Fleiss, J. L. (1986). The design and analysis of clinical experiments. Wiley.
Forero, C. G., Maydeu-Olivares, A., & Gallardo-Pujol, D. (2009). Factor analysis with ordinal indicators: A Monte Carlo study comparing DWLS and ULS estimation. Structural Equation Modeling, 16(4), 625–641. https://doi.org/10.1080/10705510903203573
Gadermann, A. M., Guhn, M., & Zumbo, B. D. (2012). Estimating ordinal reliability for Likert-type and ordinal item response data: A conceptual, empirical, and practical guide. Practical Assessment, Research & Evaluation, 17(3), 1–13.
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology & Psychiatry & Allied Disciplines, 38, 581-586. https://doi.org/10.1037/t00540-000
Gradisar, M., Gardner, G., & Dohnt, H. (2011). Recent worldwide sleep patterns and problems during adolescence: A review and meta-analysis of age, region, and sleep. Sleep Medicine, 12(2), 10-118. https://doi.org/10.1016/j.sleep.2010.11.008
Hambleton, R. K. (2005). Issues, designs, and technical guidelines for adapting tests into multiple languages and cultures. In R. K. Hambleton, P. F. Merenda, & C. D. Spielberger (Eds.), Adapting educational and psychological tests for cross-cultural assessment (pp. 3–38). Lawrence Erlbaum Associates. https://doi.org/10.4324/9781410611758-6
Hankin, B. L. (2015). Depression from childhood through adolescence: Risk mechanisms across multiple systems and levels of analysis. Current Opinion in Psychology, 4, 13-20. https://doi.org/10.1016/j.copsyc.2015.01.003
Hernández, A., Hidalgo, M. D., Hambleton, R. K., & Gómez-Benito, J. (2020). International Test Commission guidelines for test adaptation: A criterion checklist. Psicothema, 32(3), 390–398. https://doi.org/10.7334/psicothema2019.306
Hernández, A., Ponsoda, V., Muñiz, J., Prieto, G., & Elosua, P. (2016). Revisión del modelo para evaluar la calidad de los tests utilizados en España [Review of the model to evaluate the quality of the tests used in Spain]. Papeles del Psicólogo, 37(3), 192-197.
Hu,L.,&Bentler,P.M.(1999).Cutoffcriteriaforfitindexesincovariancestructure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6(1), 1–55. https://doi.org/10.1080/10705519909540118
Jeffreys, M., Rozenman, M. Gonzalez, A., Warnick, E. M., Dauser, C., Scahill, L., Woolston, J., & Weersing, V. R. (2016). Factor structure of the parent-report Mood and Feelings Questionnaire (MFQ) in an outpatient mental health sample. Journal of Abnormal Child Psychology, 44, 1111-1120. https://doi.org/10.1007/s10802-015-0108-6
Kaiser, H. F., & Rice, J. (1974). Little jiffy, mark IV. Educational and Psychological Measurement, 34(1), 111-117. https://doi. org/10.1177/001316447403400115
Kovacs, M. (1992). Children’s Depression Inventory Manual. Multi-Health Systems. https://doi. org/10.1037/t00788-000
Kuo, E. S., Stoep, A. V., & Stewart, D. G. (2005). Using the Short Mood and Feelings Questionnaire to detect depression in detained adolescents. Assessment, 12(4), 374-383. https://doi.org/10.1177/1073191105279984
Lawton, A., & Moghraby, O. S. (2016). Depression in children and young people: Identification and management in primary, community and secondary care (NIDE guideline CG28). Archives of Disease in Childhood: Education and Practice, 101, 206-209. https://doi.org/10.1136/archdischild-2015-308680
Lerthattasilp, T., Tapanadechopone, P., & Butrdeewong, P. (2020). Validity and reliability of the Thai version of the Short Mood and Feelings Questionnaire. East Asian Archives of Psychiatry, 30(2), 48-51. https://doi. org/10.12809/eaap1875
Lundervold, A. J., Breivik, K., Posserud, M. B., Stormark, K. M., & Hysing, M. (2013). Symptoms of depression as reported by Norwegian adolescents on the Short Mood and Feelings Questionnaire. Frontiers in Psychology, 4, Article 613. https://doi.org/10.3389/fpsyg.2013.00613
McKenzie, D. P., Toumbourou, J. W., Forbes, A. B., Mackinnon, A. J., McMorris, B. J., Catalano, R. F., & Patton, G. C. (2011). Predicting future depression in adolescents using the Short Mood and Feelings Questionnaire: A two-nation study. Journal of Affective Disorders, 134, 151-159. https://doi.org/10.1016/j.jad.2011.05.022
Messer, S. C., Angold, A., Costello, E., J., Loeber, R., Van Kammen, W., & Stouthamer-Loeber, M. (1995). Development of a short questionnaire for use in epidemiological studies of depression in children and adolescents. Factor composition and structure across development. International Journal of Methods in Psychiatric Research, 5, 251-262.
Mulaik, S. A. (2010). Foundations of factor analysis. Chapman & Hall.
Olsen, K. S. (2015). Symptoms of depression in adolescents: Examining the psychometric properties of a Norwegian translation of the Short Mood and Feelings Questionnaire [Master’s thesis]. University of Oslo.
Pinto, E. R. (2014). Short Mood and Feelings Questionnaire: traduçao para lingua portuguesa, adaptaçao cultural e validaçao. [Master’s thesis].
University of Sao Paulo.
R Core Team (2018). RStudio: integrated development for R (Version 1.1.453). Computer software.
Santa Cruz, C., Espinoza, V., & Hohlberg, E. (2021). Problemas socioemocionales en niños con discapacidad auditiva, discapacidad visual y desarrollo típico [Socioemotional problems in children with hearing impairment, visual impairment and typical development]. Revista Latinoamericana de Educación Inclusiva, 15(1), 95-116. https://doi.org/10.4067/S0718-73782021000100095
Sharp, C., Goodyer, I. M., & Croudace, T. J. (2006). The Short Mood and Feelings Questionnaire (SMFQ): A unidimensional item response theory and categorical data factor analysis of self-report ratings from a community sample of 7 through 11-year-old children. Journal of Abnormal Child Psychology, 34(3), 365-377. https://doi.org/10.1007/s10802-006-9027-x
Stevanovic, D. (2012). Childhood depression and anxiety disorders in Serbia: A psychometric study of four screening questionnaires. Epidemiology and psychiatric sciences, 21(1), 111-116. https://doi.org/10.1017/S20457960110000655
Sucupira, E., Sabino, M., Luiz, E., Moreira, G., Azevedo, M. J., & Masako, L. (2017). Short Mood and Feelings Questionnaire for screening children and adolescents for plastic surgery: Cross-cultural validation study. Sao Paulo Medical Journal, 135(6), 518-528. https://doi.org/10.1590/1516-3180.2017.0036030517
Thabrew, H., Stasiak, K., Bavin, L. M., Frampton, C., & Merry, S. (2018). Validation of the mood and feelings questionnaire (MFQ) and short mood and feelings questionnaire (SMFQ) in New Zealand help-seeking adolescents. International Journal of Methods in Psychiatric Research, 27(3), 1-9. https://doi.org/10.1002/mpr.1610
Turner, N., Joinson, C., Peters, T. J., Wiles, N., & Lewis, G. (2014). Validity of the Short Mood and Feelings Questionnaire in late adolescence. Psychological Assessment, 26(3), 752-762. https://doi.org/10.1037/a0036572
Viladrich, C., Angulo-Brunet, A., & Doval, E. (2017). A journey around alpha and omega to estimate internal consistency reliability. Anales de Psicología, 33(3), 755-782.
https://doi.org/10.6018/analesps.33.3.268401
World Health Organization (2017). Depression and other common mental disorders: Global health estimates. World Health Organization.
Yu, M., Xu, W., Xie, Q., Zhu, Y., Chasson, G. S., & Wang, J. (2017). Automatic thoughts as a predictor of internalizing and externalizing problems in Chinese adolescents: A test of the cognitive content-specificity hypothesis with age effects. Scandinavian Journal of Psychology, 58(5), 351-358. https://doi.org/10.1111/sjop.12373