Rasch Rating Scale Model: Bias Detection and Validation Test of Indonesian-Adolescent Life Satisfaction Scale

Authors

  • Yonathan Natanael Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia
  • Rahmaditya Salsabilla Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia
  • Denisa Aulia Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia
  • Dwi Khoirunnisa Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia
  • Husna Nursaid Munawar Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia
  • Nada Salsabila Hidayat Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia
  • Romi Faizal Firdaus Faculty of Psychology, Universitas Islam Negeri Sunan Gunung Djati Bandung, Indonesia

DOI:

https://doi.org/10.15575/psy.v9i1.14270

Keywords:

life satisfaction, modern-construct oriented scale construction, rating scale model

Abstract

Life satisfaction instrument among psychology related analyses has weaknesses in terms of gender bias testing, especially among adolescents. Therefore, this research aims to develop and validate a life satisfaction instrument in the Indonesian language which is new and undetected by gender bias. The modern construct-oriented scale construction method was selected as a guide in developing the instrument, and the participants were 474 adolescents from various cities in Indonesia. At the initial screening stage using the Rasch model analysis, 54 participants were detected as outliers, hence further analysis was only conducted on 420. The results show that I-ALSS fulfills the assumptions of unidimensional and local independence, with a good reliability score. Furthermore, I-ALSS correctly categorizes answer choices into 8 items, without detecting gender bias. Therefore, it is a fairly good instrument to be used in Indonesia.

References

Aiken, L. R. (1985). Three coefficients for analyzing reliability and validity of rating. Educational and Psychological Measurement, 45, 131–142. https://doi.org/10.1177/07399863870092005

American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (2014). Standars for educational and psychological testing. American Education Research Association.

Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43(4), 561–573. https://doi.org/10.1007/BF02293814

Arifin, Z. (2017). Kriteria instrumen dalam suatu penelitian. Jurnal Theorems (The Original Research of Mathematics), 2(1), 28–36.

Arikan, Ç. A., & Zorbaz, S. D. (2020). Measurement invariance of the satisfaction with life scale across gender and time. Turkish Journal of Education, 9(4), 260–272. https://doi.org/10.19128/turje.774452

Boroel, B., Aramburo, V., & Gonzalez, M. (2017). Development of a scale to measure attitudes toward professional values: An analysis of dimensionality using rasch measurement. Procedia - Social and Behavioral Sciences, 237, 292–298. https://doi.org/10.1016/j.sbspro.2017.02.079

Borualogo, I. S., & Casas, F. (2022). Subjective well-being of children and adolescents during the COVID-19 pandemic in Indonesia: Two data collections. Current Psychology. https://doi.org/10.1007/s12144-022-03346-x

Christensen, K. B., Makransky, G., & Horton, M. (2017). Critical values for Yen’s Q3: Identification of local dependence in the rasch model using residual correlations. Applied Psychological Measurement, 41(3), 178–194. https://doi.org/10.1177/0146621616677520

Diener, E., & Diener, M. (1995). Cross-cultural correlates of life satisfaction and self-esteem. Journal of Personality and Social Psychology, 68(4), 653–663. https://doi.org/10.1037/0022-3514.68.4.653

Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49, 71–75.

Etikan, I., & Bala, K. (2017). Sampling and sampling methods. Biometrics & Biostatistics International Journal, 5(6), 215–217. https://doi.org/10.15406/bbij.2017.05.00149

Fauzia, F. (2012). Perbandingan sosial desirabilitas bentuk skala likert, semantik diferensial, dan forced-choice dalam pengukuran prosocial tendencies. Jurnal Pengukuran Psikologi dan Pendidikan Indonesia, I(4), 263–282. https://doi.org/10.15408/jp3i.v1i4.10727

Fernández-Portero, C., Alarcón, D., & Padura, Ã. B. (2017). Dwelling conditions and life satisfaction of older people through residential satisfaction. Journal of Environmental Psychology, 49, 1–7. https://doi.org/10.1016/j.jenvp.2016.11.003

Giusta, M. Della, Jewell, S. L., & Kambhampati, U. S. (2011). Gender and life satisfaction in the UK. Feminist Economics, 17(3), 1–34. https://doi.org/10.1080/13545701.2011.582028

Google Scholar. (2022). The satisfaction with life scale diener 1985. https://scholar.google.com/scholar?hl=id&as_sdt=0%2C5&q=the+satisfaction+with+life+scale+diener+1985&btnG=

Holster, T. A., & Lake, J. (2016). Guessing and the rasch model. Language Assessment Quarterly, 13(2), 124–141. https://doi.org/10.1080/15434303.2016.1160096

John, O. P., & Bent-Martinez, V. (2013). Measurement reliability, construct validation, and scale construction. In H. T. Reis & C. M. Judd (Eds), Handbook of Research Methods in Social and Personality Psychology Measurement (hal. 473–503). https://doi.org/10.1017/CBO9780511996481.023

Karnik, S., & Kanekar, A. (2012). Childhood obesity: A global public health crisis. International Journal of Preventive Medicine, 3(1), 1–7. https://doi.org/10.1201/b18227-3

Moksnes, U. K., Løhre, A., Byrne, D. G., & Haugan, G. (2014). Satisfaction with life scale in adolescents: Evaluation of factor structure and gender invariance in a Norwegian sample. Social Indicators Research, 118(2), 657–671. https://doi.org/10.1007/s11205-013-0451-3

Moksnes, U. K., Løhre, A., Lillefjell, M., Byrne, D. G., & Haugan, G. (2016). The association between school stress, life satisfaction and depressive symptoms in adolescents: Life satisfaction as a potential mediator. Social Indicators Research, 125(1), 339–357. https://doi.org/10.1007/s11205-014-0842-0

Natanael, Y. (2021). Analisis rasch model Indonesia problematic internet use scale (IPIUS). Persona: Jurnal Psikologi Indonesia, 10(1), 167–186. https://doi.org/10.30996/persona.v10i1.4827

Natanael, Y., & Novanto, Y. (2020). Pengujian model pengukuran congeneric, tau-Equivalent dan parallel pada satisfaction with life scale (SWLS). Psympathic: Jurnal Ilmiah Psikologi, 7(2), 285–298. https://doi.org/10.15575/psy.v7i2.6405

Novanto, Y., & Pali, M. (2019). Teachers’s life satisfaction in Palopo and Toraja: A descriptive study. Jurnal Sains Psikologi, 8(2), 207–217. https://doi.org/10.17977/um023v8i22019p207

Othman, H., Ismail, N. A., Asshaari, I., Hamzah, F. M., & Nopiah, Z. M. (2015). Application of rasch measurement model for reliability measurement instrument in vector calculus course. Journal of Engineering Science and Technology, 10(2), 77–83.

Raju, N. S., Laffitte, L. J., & Byrne, B. M. (2002). Measurement equivalence: A comparison of methods based on confirmatory factor analysis and item response theory. Journal of Applied Psychology, 87(3), 517–529. https://doi.org/10.1037/0021-9010.87.3.517

Ridho, A. (2014). Differential item functioning pada tes multidimensi (Disertasi tidak diterbitkan). Universitas Gajah Mada, Fakultas Psikologi.

Rissanen, T. (2015). Studies on life satisfaction in samples of the general population and depressive patients (Dissertation unpublished). Faculty of Health Sciences, University of Eastern Finland.

Rogers, H. J., & Swaminathan, H. (1990). A comparison of logistic regression and differential item functioning. Applied Psychological Measurement, 17(2), 105–116. https://doi.org/10.1177/014662169301700201

Salsabila, D. F., Rofifah, R., Natanael, Y., & Ramdani, Z. (2019). Uji validitas konstruk Indonesian-psychological measurement of islamic religiousness (I-PMIR). JPIB: Jurnal Psikologi Islam dan Budaya, 2(2), 1–10. https://doi.org/10.15575/jpib.v2i2.5494

Schnettler, B., Miranda-Zapata, E., Lobos, G., del Carmen Lapo, M., Adasme-Berríos, C., & Hueche, C. (2017). Measurement invariance in the satisfaction with life scale in Chilean and Ecuadorian older adults. Personality and Individual Differences, 110, 96–101. https://doi.org/10.1016/j.paid.2017.01.036

Sufren, & Natanael, Y. (2014). Belajar otodidak SPSS pasti bisa. Elex Media Komputindo.

Tomás, J. M., Gutiérrez, M., Sancho, P., & Romero, I. (2015). Measurement invariance of the satisfaction with life scale (SWLS) by gender and age in Angola. Personality and Individual Differences, 85, 182–186. https://doi.org/10.1016/j.paid.2015.05.008

Tresnawaty, Y. (2013). Pendeteksian differential item functioning pada item dikotomus dengan menggunakan pendekatan item response theory (IRT), logistic regression (LR) dan confirmatory factor analysis (CFA) (Tesis tidak diterbitkan). UIN Syarif Hidayatullah Jakarta, Fakultas Psikologi.

van Beuningen, J. (2012). The satisfaction with life scale examining construct validity. Statistics Netherlands.

van der Laan, S. E. I., Finkenauer, C., Lenters, V. C., van Harmelen, A. L., van der Ent, C. K., & Nijhof, S. L. (2021). Gender-specific changes in life satisfaction after the COVID-19–related lockdown in Dutch adolescents: A longitudinal study. Journal of Adolescent Health, 69(5), 737–745. https://doi.org/10.1016/j.jadohealth.2021.07.013

Van Zile-Tamsen, C. (2017). Using rasch analysis to inform rating scale development. Research in Higher Education, 58(8), 922–933. https://doi.org/10.1007/s11162-017-9448-0

Wicaksono, D. A., Roebianto, A., & Sumintono, B. (2021). Internal validation of the warwick-edinburgh mental well-being scale: Rasch analysis in the Indonesian context. Journal of Educational, Health and Community Psychology, 10(2), 229–248. https://doi.org/10.12928/jehcp.v10i2.20260

Zanon, C., Bardagi, M. P., Layous, K., & Hutz, C. S. (2014). Validation of the satisfaction with life scale to Brazilians: Evidences of measurement noninvariance across Brazil and US. Social Indicators Research, 119(1), 443–453. https://doi.org/10.1007/s11205-013-0478-5

Downloads

Published

2022-10-27

Issue

Vol. 9 No. 1 (2022): PSYMPATHIC

Section

Articles

Citation Check

License

The author whose published manuscript approved the following provisions:

1. The right of publication of all material published in the journal / published on the E-Journal of Psychology website is held by the editorial board with the knowledge of the author (moral right remains the author of the script).

2. The formal legal provisions for access to digital articles of this electronic journal are subject to the terms of the Creative Commons Attribution-ShareAlike license (CC BY-SA), which means that the Journal of Psychology reserves the right to save, transmit media / format, manage in database form, , maintain, and publish articles without requesting permission from the Author as long as it continues to include the name of the Author as the owner of Copyright.

3. Printed and published print and electronic manuscripts are open access for any purposes. In addition to these objectives, the editorial board shall not be liable for violations of copyright law.

Â