Keywords
Online assessment
Generalized anxiety disorder
Validity study Periodo perinatal
Evaluación online
Trastorno de ansiedad generalizada
Estudio de validez
How to Cite
Abstract
Background: The use of online questionnaires to assess common mental disorders such as perinatal anxiety has spread due to the proliferation of Internet-based psychological interventions and research. This study analyses the validity and reliability of the online version of the Generalized Anxiety Disorder-7 (GAD-7) in a sample of pregnant and postpartum Spanish women. Method: A total of 3082 pregnant (n = 1260) and postpartum (n = 1822) women were recruited via the Internet and underwent three follow-up evaluations during a six-month period. Results: A one-factor solution was assigned by Exploratory Factor Analysis and confirmed by Confirmatory Factor Analysis for both pregnant (CFI = 0.998; RMSEA = 0.035) and postpartum (CFI = 0.998; RMSEA = 0.038) women. The one-factor model showed strict invariance across groups. Validity was confirmed by assessing correlations between GAD-7, the Edinburgh Postnatal Depression Scale, and the 10-item Posttraumatic Stress Disorder checklist at three time points. The reliability coefficient was .92 for the two groups. Conclusions: This study shows that the Spanish online GAD-7 version has good psychometric properties and can be used to assess anxiety symptoms during the perinatal period.
References
Alavi, M., Visentin, D. C., Thapa, D. K., Hunt, G. E., Watson, R., & Cleary, M. (2020). Chi‐square for model fit in confirmatory factor analysis. Journal of Advanced Nursing, 76(9), 2209–2211. https://doi.org/10.1111/ jan.14399
American Educational Research Association; American Psychological Association; National Council on Measurement in Education. (2014). The standards for educational and psychological testing. American Educational Research Association.
Andersson, G., Titov, N., Dear, B. F., Rozental, A., & Carlbring, P. (2019). Internet-delivered psychological treatments: from innovation to implementation. World Psychiatry, 18(1), 20–28. https://doi.org/10.1002/ wps.20610
Andrews, G., Hobbs, M. J., Borkovec, T. D., Beesdo, K., Craske, M. G., Heimberg, R. G., Rapee, R. M., Ruscio, A. M., & Stanley, M. A. (2010). Generalized worry disorder: A review of DSM-IV generalized anxiety disorder and options for DSM-V. Depression and Anxiety, 27(2), 134–147. https://doi.org/10.1002/da.20658
Austin, M. P. V., Mule, V., Hadzi-Pavlovic, D., & Reilly, N. (2022). Screening for anxiety disorders in third trimester pregnancy: A comparison of four brief measures. Archives of Women’s Mental Health, 25(2), 389–397. https:// doi.org/10.1007/s00737-021-01166-9
Beijers, R., Jansen, J., Riksen-Walraven, M., & De Weerth, C. (2010). Maternal prenatal anxiety and stress predict infant illnesses and health complaints. Pediatrics, 126(2), e401–e409. https://doi.org/10.1542/peds.2009-3226
Buchanan, T. (2003). Internet-based questionnaire assessment: Appropriate use in clinical contexts. Cognitive Behaviour Therapy, 32(3), 100–109. https://doi.org/10.1080/16506070310000957
Cox, J. L., Holden, J. M., & Sagovsky, R. (1987). Detection of postnatal depression: Development of the 10-item Edinburgh Postnatal Depression scale. British Journal of Psychiatry, 150(JUNE), 782–786. https://doi.org/10.1192/bjp.150.6.782
Donker, T., van Straten, A., Marks, I., & Cuijpers, P. (2011). Quick and easy self-rating of generalized anxiety disorder: Validity of the Dutch web-based GAD-7, GAD-2 and GAD-SI. Psychiatry Research, 188(1), 58–64. https://doi.org/10.1016/j.psychres.2011.01.016
Elosua, P., Aguado, D., Fonseca-Pedrero, E., Abad, F. J., & Santamaría, P. (2023). New trends in digital technology-based psychological and educational assessment. Psicothema, 35(1), 50–57. https://doi.org/10.7334/ psicothema2022.241
Fawcett, E. J., Fairbrother, N., Cox, M. L., White, I. R., & Fawcett, J. M. (2019). The prevalence of anxiety disorders during pregnancy and the postpartum period: A multivariate bayesian meta-analysis. The Journal of Clinical Psychiatry, 80(4), Article 18r12527. https://doi.org/10.4088/JCP.18r12527
Garcia-Campayo, J., Zamorano, E., Ruiz, M. A., Pardo, A., Perez-Paramo, M., Lopez-Gomez, V., Freire, O., & Rejas, J. (2010). Cultural adaptation into Spanish of the generalized anxiety disorder-7 (GAD-7) scale as a screening tool. Health and Quality of Life Outcomes, 8(1), Article 8. https://doi.org/10.1186/1477-7525-8-8
Garcia-Esteve, L., Ascaso, C., Ojuel, J., & Navarro, P. (2003). Validation of the Edinburgh Postnatal Depression Scale (EPDS) in Spanish mothers. Journal of Affective Disorders, 75(1), 71–76. https://doi.org/10.1016/ S0165-0327(02)00020-4
Gong, Y., Zhou, H., Zhang, Y., Zhu, X., Wang, X., Shen, B., Xian, J., & Ding, Y. (2021). Validation of the 7-item Generalized Anxiety Disorder scale (GAD-7) as a screening tool for anxiety among pregnant Chinese women. Journal of Affective Disorders, 282(419), 98–103. https://doi.org/10.1016/j. jad.2020.12.129
Grigoriadis, S., Graves, L., Peer, M., Mamisashvili, L., Tomlinson, G., Vigod, S. N., Dennis, C.-L., Steiner, M., Brown, C., Cheung, A., Dawson, H., Rector, N. A., Guenette, M., & Richter, M. (2018). Maternal anxiety during pregnancy and the association with adverse perinatal outcomes: Systematic review and meta-analysis. The Journal of Clinical Psychiatry, 79(5), Article 17r12011. https://doi.org/10.4088/JCP.17r12011
Heiervang, E., & Goodman, R. (2011). Advantages and limitations of web-based surveys: Evidence from a child mental health survey. Social Psychiatry and Psychiatric Epidemiology, 46(1), 69–76. https://doi.org/10.1007/s00127-009-0171-9
Hinz, A., Klein, A. M., Brähler, E., Glaesmer, H., Luck, T., Riedel-Heller, S. G., Wirkner, K., & Hilbert, A. (2017). Psychometric evaluation of the Generalized Anxiety Disorder Screener GAD-7, based on a large German general population sample. Journal of Affective Disorders, 210, 338–344. https://doi.org/10.1016/j.jad.2016.12.012
Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural equation modeling: a multidisciplinary journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Leach, L. S., Poyser, C., & Fairweather‐schmidt, K. (2017). Maternal perinatal anxiety: A review of prevalence and correlates. Clinical Psychologist, 21(1), 4–19. https://doi.org/10.1111/cp.12058
Luca, D. L., Margiotta, C., Staatz, C., Garlow, E., Christensen, A., & Zivin, K. (2020). Financial toll of untreated perinatal mood and anxiety disorders among 2017 births in the United States. American Journal of Public Health, 110(6), 888–896. https://doi.org/10.2105/AJPH.2020.305619
Matthey, S. (2016). Anxiety and Stress during pregnancy and the postpartum period. In A. Wenzel (Ed.), The Oxford Handbook of Perinatal Psychology (pp. 132–166). Oxford University Press.
McDonald, R. P., & Ho, M.-H. R. (2002). Principles and practice in reporting structural equation analyses. Psychological Methods, 7(1), 64–82. https:// doi.org/10.1037/1082-989X.7.1.64
Moreno, E., Muñoz-Navarro, R., Medrano, L. A., González-Blanch, C., Ruiz-Rodríguez, P., Limonero, J. T., Moretti, L. S., Cano-Vindel, A., & Moriana, J. A. (2019). Factorial invariance of a computerized version of the GAD-7 across various demographic groups and over time in primary care patients. Journal of Affective Disorders, 252(March), 114–121. https://doi.org/10.1016/j.jad.2019.04.032
Motrico, E., Bina, R., Domínguez-Salas, S., Mateus, V., Contreras-García, Y., Carrasco-Portiño, M., Ajaz, E., Apter, G., Christoforou, A., Dikmen- Yildiz, P., Felice, E., Hancheva, C., Vousoura, E., Wilson, C. A., Buhagiar, R., Cadarso-Suárez, C., Costa, R., Devouche, E., Ganho-Ávila, A., … Mesquita, A. (2021). Impact of the Covid-19 pandemic on perinatal mental health (Riseup-PPD-COVID-19): Protocol for an international prospective cohort study. BMC Public Health, 21(1), Article 368. https://doi.org/10.1186/s12889-021-10330-w
Motrico, E., Domínguez-Salas, S., Rodríguez-Domínguez, C., Gómez-Gómez, I., Rodríguez-Muñoz, M. F., & Gómez-Baya, D. (2022). The impact of the COVID-19 pandemic on perinatal depression and anxiety: A large cross-sectional study in Spain. Psicothema, 34(2), 200–208. https://doi.org/10.7334/psicothema2021.380
Muñoz-Navarro, R., Cano-Vindel, A., Moriana, J. A., Medrano, L. A., Ruiz-Rodríguez, P., Agüero-Gento, L., Rodríguez-Enríquez, M., Pizà,
M. R., & Ramírez-Manent, J. I. (2017). Screening for generalized anxiety disorder in Spanish primary care centers with the GAD-7. Psychiatry Research, 256(June), 312–317. https://doi.org/10.1016/j. psychres.2017.06.023
Muñoz, R. F., Chavira, D. A., Himle, J. A., Koerner, K., Muroff, J., Reynolds, J., Rose, R. D., Ruzek, J. I., Teachman, B. A., & Schueller, S. M. (2018). Digital apothecaries: A vision for making health care interventions accessible worldwide. MHealth, 4, 18–18. https://doi.org/10.21037/ mhealth.2018.05.04
National Institute for Health and Care Excellence. (2015). Antenatal and postnatal mental health: clinical management and service guidance. Essentially MIDIRS, 6(1), 14. www.nice.org.uk/guidance/cg192%0Ahttp://search.ebscohost.com/login.aspx?direct=true&db=cin20&AN=201291055 6&site=ehost-live
National Institute for Health and Care Excellence. (2020). Antenatal and postnatal mental health: Clinical management and service guidance. Essentially MIDIRS, 6(1), 14. www.nice.org.uk/guidance/cg192
Nyongesa, M. K., Mwangi, P., Koot, H. M., Cuijpers, P., Newton, C. R. J. C., & Abubakar, A. (2020). The reliability, validity and factorial structure of the Swahili version of the 7-item generalized anxiety disorder scale (GAD-7) among adults living with HIV from Kilifi, Kenya. Annals of General Psychiatry, 19(1), 1–10. https://doi.org/10.1186/s12991-020-00312-4
O’Connor, E. A., Henninger, M. L., Perdue, L. A., Coppola, E. L., Thomas, R. G., & Gaynes, B. N. (2023). Anxiety Screening: Evidence report and systematic review for the US Preventive Services Task Force. JAMA, 329(24), 2171–2184. https://doi.org/10.1001/jama.2023.6369
Plummer, F., Manea, L., Trepel, D., & McMillan, D. (2016). Screening for anxiety disorders with the GAD-7 and GAD-2: A systematic review and diagnostic metaanalysis. General Hospital Psychiatry, 39, 24–31. https://doi.org/10.1016/j.genhosppsych.2015.11.005
Putnick, D. L., & Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions for psychological research. Developmental Review, 41, 71–90. https://doi.org/10.1016/j.dr.2016.06.004
Rees, S., Channon, S., & Waters, C. S. (2019). The impact of maternal prenatal and postnatal anxiety on children’s emotional problems: A systematic review. European Child & Adolescent Psychiatry, 28(2), 257–280. https://doi.org/10.1007/s00787-018-1173-5
Rogers, A., Obst, S., Teague, S. J., Rossen, L., Spry, E. A., MacDonald, J. A., Sunderland, M., Olsson, C. A., Youssef, G., & Hutchinson, D. (2020). Association between maternal perinatal depression and anxiety and child and adolescent Development: A meta-analysis. JAMA Pediatrics, 174(11), 1082–1092. https://doi.org/10.1001/jamapediatrics.2020.2910 Rosseel, Y. (2012). Lavaan: An R package for structural equation modeling. Journal of Statistical Software, 48(2), 1–36. https://doi.org/10.18637/jss.v048.i02
Ruiz, M. A., Zamorano, E., García-Campayo, J., Pardo, A., Freire, O., & Rejas, J. (2011). Validity of the GAD-7 scale as an outcome measure of disability in patients with generalized anxiety disorders in primary care. Journal of Affective Disorders, 128(3), 277–286. https://doi.org/10.1016/j. jad.2010.07.010
Simpson, W., Glazer, M., Michalski, N., Steiner, M., & Frey, B. N. (2014). Comparative efficacy of the Generalized Anxiety Disorder 7-Item Scale and the Edinburgh Postnatal Depression Scale as screening tools for generalized anxiety disorder in pregnancy and the postpartum period. The Canadian Journal of Psychiatry, 59(8), 434–440. https://doi. org/10.1177/070674371405900806
Sireci, S., & Benítez, I. (2023). Evidence for test validation: A guide for practitioners. Psicothema, 35(3), 217–226. https://doi.org/10.7334/psicothema2022.477
Soto-Balbuena, C., Rodríguez-Muñoz, M.F., & Le, H. N. (2021). Validation of the generalized anxiety disorder screener (GAD-7) in Spanish pregnant women. Psicothema, 33(1), 164–170. https://doi.org/10.7334/ psicothema2020.167
Sousa, T. V., Viveiros, V., Chai, M. V., Vicente, F. L., Jesus, G., Carnot, M. J., Gordo, A. C., & Ferreira, P. L. (2015). Reliability and validity of the Portuguese version of the Generalized Anxiety Disorder (GAD-7) scale. Health and Quality of Life Outcomes, 13(1), 1–8. https://doi.org/10.1186/s12955-015-0244-2
Spitzer, R. L., Kroenke, K., Williams, J. B. W., & Löwe, B. (2006). A brief measure for assessing generalized anxiety disorder: The GAD-7. Archives of Internal Medicine, 166(10), 1092–1097. https://doi.org/10.1001/archinte.166.10.1092
Sutter-Dallay, A. L., Giaconne-Marcesche, V., Glatigny-Dallay, E., & Verdoux, H. (2004). Women with anxiety disorders during pregnancy are at increased risk of intense postnatal depressive symptoms: A prospective survey of the MATQUID cohort. European Psychiatry, 19(8), 459–463. https://doi.org/10.1016/j.eurpsy.2004.09.025
Thomason, M. E., Graham, A., & VanTieghem, M. R. (2022). The COPE- IS: Coronavirus Perinatal Experiences – Impact Survey. Retrieved from https://www.nlm.nih.gov/dr2/COPE-impact_Survey_Perinatal_Pandemic_ Survey.pdf
van Ballegooijen, W., Riper, H., Cuijpers, P., van Oppen, P., & Smit, J. H. (2016). Validation of online psychometric instruments for common mental health disorders: A systematic review. BMC Psychiatry, 16(1), Article 45. https://doi.org/10.1186/s12888-016-0735-7
Van Gelder, M. M. H. J., Bretveld, R. W., & Roeleveld, N. (2010). Web- based questionnaires: The future in epidemiology? American Journal of Epidemiology, 172(11), 1292–1298. https://doi.org/10.1093/aje/ kwq291
Vázquez, M. B., & Míguez, M. C. (2019). Validation of the Edinburgh Postnatal Depression Scale as a screening tool for depression in Spanish pregnant women. Journal of Affective Disorders, 246, 515–521. https://doi.org/10.1016/j.jad.2018.12.075
Vogazianos, P., Motrico, E., Domínguez-Salas, S., Christoforou, A., & Hadjigeorgiou, E. (2022). Validation of the generalized anxiety disorder screener (GAD-7) in Cypriot pregnant and postpartum women. BMC Pregnancy and Childbirth, 22(1), Article 841 (2022). https://doi.org/10.1186/s12884-022-05127-7
Ward, P., Clark, T., Zabriskie, R., & Morris, T. (2014). Paper/Pencil Versus Online Data Collection. Journal of Leisure Research, 46(1), 84–105. https://doi.org/10.1080/00222216.2014.11950314
Wright, K. B. (2006). Researching internet-based populations: Advantages and disadvantages of online survey research, online questionnaire authoring software packages, and web Survey Services. Journal of Computer- Mediated Communication, 10(3), Article JCMC1034. https://doi.org/10.1111/j.1083-6101.2005.tb00259.x
Zhong, Q., Gelaye, B., Zaslavsky, A. M., Fann, J. R., Rondon, M. B., Sánchez, S. E., & Williams, M. A. (2015). Diagnostic validity of the Generalized Anxiety Disorder - 7 (GAD-7) among Pregnant women. PLOS ONE, 10(4), Article e0125096. https://doi.org/10.1371/journal. pone.0125096