Validation of a Multidimensional Spiritual Guidance Intensity Instrument: Examining Content Validity Using Aiken's V and Likert-Based Item Analysis
DOI:
https://doi.org/10.15575/idajhs.v19i2.51763Keywords:
Expert judgement; intensity scale; spiritual guidance; validity.Abstract
This study examines the content validity of the spiritual guidance intensity instrument through expert judgment from five Islamic counseling and psychology experts. A total of 48 items were analyzed using Aiken's V formula. The results showed that 39 items (81.25%) were declared acceptable and 9 items (18.75%) were acceptable with minor revisions, indicating good content validity for the entire instrument. This indicates that all items have good content validity and are suitable for use. This study confirms that behavioural and observable dimensions tend to have higher and more consistent content validity than experiential or transformational dimensions. Theoretically, this study contributes to the development of spiritual guidance measurement instruments with an evidence-based approach through content validation. This study is the first to test the feasibility of spiritual guidance intensity instruments based on expert judgement.
References
Aiken, L. R. (1985). Three coefficients for analysing the reliability and validity of ratings. Educational and Psychological Measurement, 45 (1), 131–142. https://doi.org/10.1177/0013164485451012
Almanasreh, E., Moles, R., & Chen, T. F. (2019). Evaluation of methods used for estimating content validity. Research in Social and Administrative Pharmacy, 15 (2), 214–221. https://doi.org/10.1016/j.sapharm.2018.03.066
Artino, A. R., La Rochelle, J. S., Dezee, K. J., & Gehlbach, H. (2014). Developing questionnaires for educational research: AMEE Guide No. 87. Medical Teacher, 36 (6), 463–474. https://doi.org/10.3109/0142159X.2014.889814
Boateng, G. O., Neilands, T. B., Frongillo, E. A., Melgar-Quiñonez, H. R., & Young, S. L. (2018). Best practices for developing and validating scales for health, social, and behavioural research: A primer. Frontiers in Public Health, 6 , 149. https://doi.org/10.3389/fpubh.2018.00149
Carpenter, S. (2018). Ten steps in scale development and reporting: A guide for researchers. Communication Methods and Measures, 12 (1), 25–44. https://doi.org/10.1080/19312458.2017.1396583
Cordon, C. P. (2015). Confidence intervals for Aiken’s validity coefficient. Journal of Modern Applied Statistical Methods, 14 (2), 26–37. https://doi.org/10.22237/jmasm/1446350880
Counted, V., Possamai, A., McAuliffe, C., & Meade, T. (2022). Attachment to God and mental health: Spiritual formation, cultural contexts, and resilience during COVID-19. Journal of Religion and Health, 61(1), 405–431.
Cucchi, A., & Qoronfleh, M. W. (2025). Cultural perspective on religion, spirituality and mental health. Frontiers in Psychology, 16
DeVellis, R. F., & Thorpe, C. T. (2022). Scale development: Theory and applications (5th ed.). SAGE Publications.
DeVon, H. A., Block, M. E., Moyle-Wright, P., Ernst, D. M., Hayden, S. J., Lazzara, D. J., Savoy, S. M., & Kostas-Polston, E. (2007). A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship, 39 (2
Dew, R. E., Daniel, S. S., Goldston, D. B., McCall, W. V., Kuchibhatla, M., Schleifer, C., Triplett, M. F., Koenig, H. G., & Weder, N. (2023). Religiosity and spirituality in the prevention and management of depression and anxiety in young people: A systematic review and meta-analysis. BMC Psychiatry, 23 (1
Evans, A. L., & Nelson, J. K. (2021). The value of adapting counselling to clients' spirituality and religion: Evidence-based relationship factors. Religions, 12 (11), 951. https://doi.org/10.3390/rel12110951
Garssen, B., Visser, A., & Pool, G. (2021). Does spirituality or religion positively affect mental health? Meta-analysis of longitudinal studies. The International Journal for the Psychology of Religion, 31 (1), 4–20. https://doi.org/10.1080/10508619.2020.1729570
Grant, J. S., & Davis, L. L. (1997). Selection and use of content experts for instrument development. Research in Nursing & Health, 20 (3
Gultom, A. F., Munir, M., & Ariani, I. (2019). Changes in self-identity in Kierkegaard's existentialism: Its relevance to the mentality of Indonesian citizens. Journal of Civic Education, 9 (2), 77–84. https://doi.org/10.23887/jpk.v9i2.21738
Hațegan, V. (2021). The practice of counselling between philosophy and spirituality: An interdisciplinary approach. Journal for the Study of Religions and Ideologies, 20 (58), 146–160. https://doi.org/10.58683/jsri.202058.09
Joshi, A., Kale, S., Chandel, S., & Pal, D. K. (2015). Likert scale: Explored and explained. British Journal of Applied Science & Technology, 7 (4), 396–403. https://doi.org/10.9734/BJAST/2015/14975
Kapuscinski, A. N., & Masters, K. S. (2020). The current status of measures of spirituality: A critical review of scale development. Psychology of Religion and Spirituality, 12(4), 398–412.
Kim, S., & Esquivel, G. B. (2023). Spiritual well-being and religious coping: A systematic review of measurement validity. Psychology of Religion and Spirituality, 15(2), 234–248.
Koenig, H. G. (2020). Maintaining health and well-being by putting faith into action during the COVID-19 pandemic. Journal of Religion and Health, 59 (5), 2205–2214. https://doi.org/10.1007/s10943-020-01035-2
Komarudin, K., Bukhori, B., Karim, A., Haqqi, M. F. H., & Yulikhah, S. (2022). Examining social support, spirituality, gratitude, and their associations with happiness through self-acceptance. Psikohumaniora: Journal of Psychological Research, 7 (2), 263–278. https://doi.org/10.21580/pjpp.v7i2.13371
Kyriazos, T A. (2018). Applied psychometrics: Sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology, 9 (8), 2207–2230. https://doi.org/10.4236/psych.2018.98126
Kyriazos, Theodoros A, & Stalikas, A. (2018). Applied psychometrics: The steps of scale development and standardisation process. Psychology, 9 (11), 2531–2560. https://doi.org/10.4236/psych.2018.911145
Lucchetti, G., Góes, L. G., Amaral, S. G., Ganadjian, G. T., Andrade, I., Almeida, P. O. D. A., do Carmo, V. M., & Manso, M. E. G. (2021). Spirituality, religiosity and the mental health consequences of social isolation during the COVID-19 pandemic. International Journal of Social Psychiatry, 67 (6
Lynn, M. R. (1986). Determination and quantification of content validity. Nursing Research, 35 (6), 382–385. https://doi.org/10.1097/00006199-198611000-00017
McCoach, D. B., Gable, R. K., & Madura, J. P. (2013). Instrument development in the affective domain: School and corporate applications (3rd ed.). Springer.
Merino-Soto, C. (2018). Confidence interval for difference between coefficients of content validity (Aiken’s V): A SPSS syntax. Anales de Psicología, 34(3), 587–590. https://doi.org/10.6018/analesps.34.3.283481
Merino-Soto, C. (2023). Aiken’s V coefficient: An updated critical review. Revista Argentina de Ciencias Del Comportamiento, 15(1), 91–108.
Moreira-Almeida, A., Sharma, A., van Rensburg, B. J., Verhagen, P. J., & Cook, C. C. H. (2021). WPA position statement on spirituality and religion in psychiatry. World Psychiatry, 20 (1), 87–88. https://doi.org/10.1002/wps.20304
Morgado, F. F. da R., Meireles, J. F. F., Neves, C. M., Amaral, A. C. S., & Ferreira, M. E. C. (2018). Scale development: Ten main limitations and recommendations to improve future research practices. Psychology: Reflection and Criticism, 30 (1
Muhtasor, M., & Irawan, E. (2022). The effectiveness of spiritual healing-based counselling in overcoming students' academic anxiety. Indonesian Journal of Islamic Psychology, 4 (1), 63–82. https://doi.org/10.18326/ijip.v4i1.63-82
Nurjanah, S., Setiawati, F. A., & Sulistiobudi, R. A. (2023). Content validity: Definition, test procedure, and interpretation. Jurnal MEDIAPSI, 9 (1), 81–91. https://doi.org/10.21776/ub.mps.2023.009.01.8
Oxhandler, H. K., Parrish, D. E., Torres, L. R., & Achenbaum, W. A. (2023). The integration of clients’ religion and spirituality in social work practice: A national survey. Social Work, 68 (1), 7–16. https://doi.org/10.1093/sw/swac040
Padilla, J. L., & Benítez, I. (2014). Validity evidence based on response processes. Psicothema, 26 (1), 136–144. https://doi.org/10.7334/psicothema2013.259
Pargament, K. I. (1997). The psychology of religion and coping: Theory, research, practice. Guilford Press.
Pargament, K. I., Falb, M. D., Ano, G. G., & Wachholtz, A. B. (2013). The religious dimension of coping: Advances in theory, research, and practice (R. F. Paloutzian & C. L. B. T.-H. of the psychology of religion and spirituality Park (eds.); 2nd ed., pp. 560–579). Guilford Press.
Pargament, K. I., Feuille, M., & Burdzy, D. (2011). The Brief RCOPE: Current psychometric status of a short measure of religious coping. Religions, 2
Pargament, K. I., Koenig, H. G., & Perez, L. M. (2000). The many methods of religious coping: Development and initial validation of the RCOPE. Journal of Clinical Psychology, 56 (4), 519–543. https://doi.org/10.1002/(SICI)1097-4679(200004)56:4<519::AID-JCLP6>3.0.CO;2-1
Penfield, R. D., & Giacobbi Jr., P. R. (2004). Applying a score confidence interval to Aiken’s item content-relevance index. Measurement in Physical Education and Exercise Science, 8 (4), 213–225. https://doi.org/10.1207/s15327841mpee0804_3
Peterman, A. H., Fitchett, G., Brady, M. J., Hernandez, L., & Cella, D. (2002). Measuring spiritual well-being in people with cancer: The Functional Assessment of Chronic Illness Therapy—Spiritual Well-Being Scale (FACIT-Sp). Annals of Behavioural Medicine, 24 (1
Polit, D F, & Beck, C. T. (2006). The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Research in Nursing & Health, 29 (5), 489–497. https://doi.org/10.1002/nur.20147
Polit, D F, Beck, C. T., & Owen, S. V. (2007). Is the CVI an acceptable indicator of content validity? Appraisal and recommendations. Research in Nursing & Health, 30 (4), 459–467. https://doi.org/10.1002/nur.20199
Polit, Denise F, & Yang, F. M. (2016). Measurement and the measurement of change. Wolters Kluwer Health. https://doi.org/10.1097/NNR.0000000000000077
Preston, C. C., & Colman, A. M. (2000). Optimal number of response categories in rating scales: Reliability, validity, discriminating power, and respondent preferences. Acta Psychologica, 104 (1), 1–15. https://doi.org/10.1016/S0001-6918(99)00050-5
Retnawati, H. (2016). Validity, reliability, and item characteristics. Parama Publishing.
Rican, P., Janošová, P., & Exline, J. J. (2020). Measuring spiritual struggles: Development and validation of a Czech version. Journal of Religion and Health, 59(6), 2827–2844.
Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27 (2), 94–104. https://doi.org/10.1093/swr/27.2.94
Sharma, P., Mahapatra, A., & Ghosh, D. (2021). Psychometric properties of spirituality assessment scales: A systematic review. Journal of Religion and Health, 60(4), 2578–2601.
Sharma, P., & Sharma, N. (2021). Cross-cultural validation of spiritual coping scales: Challenges and recommendations. International Journal of Psychology and Counselling, 13(2), 45–58.
Shi, J., Mo, X., & Sun, Z. (2012). Content validity index in scale development. Zhong Nan Da Xue Xue Bao Yi Xue Ban, 37 (2
Sousa, V. D., & Rojjanasrirat, W. (2011). Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: A clear and user-friendly guideline. Journal of Evaluation in Clinical Practice, 17
Stefana, A., Youngstrom, E. A., Chen, J., Hinshaw, S., Maxwell, V., Michalak, E., & Van Meter, A. R. (2025). The Bipolar Prodrome Symptom Scale–Retrospective: A new assessment of the premorbid course of bipolar disorder. Psychological Assessment, 37 (1), 1–14. https://doi.org/10.1037/pas0001262
Streiner, D. L., Norman, G. R., & Cairney, J. (2015). Health measurement scales: A practical guide to their development and use (5th ed.). Oxford University Press.
Suárez-Alvarez, J., Pedrosa, I., Lozano, L. M., García-Cueto, E., Cuesta, M., & Muñiz, J. (2018). Using reversed items in Likert scales: A questionable practice. Psicothema, 30(2), 149–158.
Suyani, Keliat, B. A., & Mustikasari. (2023). Spiritual therapy approach toward people with mental disorder: Literature review. Jurnal Aisyah: Jurnal Ilmu Kesehatan, 8 (2), 511–518. https://doi.org/10.30604/jika.v8i2.8269
Swan, A. J., Watson, H. J., & Jelalian, E. (2023). Understanding the reliability, validity, and clinical utility of parent-reported quality of life in paediatric obesity treatment. Childhood Obesity, 19 (6), 383–391. https://doi.org/10.1089/chi.2022.0116
Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. International Journal of Academic Research in Management, 5 (3), 28–36. https://doi.org/10.2139/ssrn.3205040
Terwee, C. B., Prinsen, C. A., Chiarotto, A., Westerman, M. J., Patrick, D. L., Alonso, J., Bouter, L. M., de Vet, H. C., & Mokkink, L. B. (2018). COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study. Quality of Life Research, 27 (5
Tsang, S., Royse, C. F., & Terkawi, A. S. (2017). Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi Journal of Anaesthesia, 11 (Suppl 1), S80–S89. https://doi.org/10.4103/sja.SJA_203_17
Underwood, L. G., & Teresi, J. A. (2002). The Daily Spiritual Experience Scale: Development, theoretical description, reliability, exploratory factor analysis, and preliminary construct validity using health-related data. Annals of Behavioural Medicine, 24 (1), 22–33. https://doi.org/10.1207/S15324796ABM2401_04
Waltz, C. F., Strickland, O. L., & Lenz, E. R. (2010). Measurement in nursing and health research (4th ed.). Springer Publishing Company.
Wright, A. G., & Zimmermann, J. (2019). Applied ambulatory assessment: Integrating idiographic and nomothetic principles of measurement. Psychological Assessment, 31 (12), 1467–1480. https://doi.org/10.1037/pas0000685
Yaden, D. B., Kaufman, S. B., Hyde, E., Chirico, A., Gaggioli, A., Zhang, J. W., & Keltner, D. (2022). The development of the Awe Experience Scale (AWE-S): A multifactorial measure for a complex emotion. The Journal of Positive Psychology, 17(1), 88–104.
Yoon, S., & Kim, J. H. (2020). Psychometric properties of reverse-coded items in spiritual well-being scales: A cross-cultural validation study. Mental Health, Religion & Culture, 23(8), 789–805.
Yusoff, M. S. B. (2019). ABC of content validation and content validity index calculation. Education in Medicine Journal, 11 (2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
Zamroni, E., Hanurawan, F., Muslihati, Hambali, I., & Hidayah, N. (2022). Trends and research implications of guidance and counselling services in Indonesia from 2010 to 2020: A bibliometric analysis. SAGE Open, 12 (2), 1–18. https://doi.org/10.1177/21582440221091261
Zanon, C., Bastianello, M. R., Pacico, J. C., & Hutz, C. S. (2021). Relationships between positive and negative affect and the five personality factors in a Brazilian sample. Paidéia (Ribeirão Preto), 31 , e3112.
Zhang, X., & Savalei, V. (2023). Improving the precision of reliability estimates: The role of reverse-coded items in scale construction. Psychological Methods, 28(1), 1–18.
Downloads
Published
How to Cite
Issue
Section
Citation Check
License
Copyright (c) 2026 Abdul Karim, Agus Riyadi, Adi Slamet Kusumawardana
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
Authors who publish articles in Ilmu Dakwah: Academic Journal for Homiletic Studies agree to the following terms:
- Authors retain copyright of the article and grant the journal right of first publication with the work simultaneously licensed under a CC-BY-SA or The Creative Commons AttributionShareAlike License.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
