Pilot Validation of The Use Instrument for Evaluating a Psychological Skills Training Module Designed for Rugby Coaches
DOI:
https://doi.org/10.37134/jsspj.vol14.sp.12.2025Keywords:
Usability Evaluation, Psychological Skills Training, Sport Psychology, Rugby Coaching, Psychometric Validation, Content ValidityAbstract
This pilot study evaluated the preliminary psychometric properties of an adapted USE (Usefulness, Satisfaction, and Ease of Use) questionnaire designed to assess the usability of a Psychological Skills Training (PST) module for Malaysian rugby coaches. A total of 30 coaches from state and national levels participated in the study. Psychometric analysis focused on content and face validity, internal consistency reliability, and item-level performance using the Percentage Calculation Method and Cronbach’s Alpha with Corrected Item-Total Correlation (CITC). Results demonstrated excellent internal consistency (ɑ= .918), with 20 out of 30 items surpassing the CITC threshold (≥ .50). Content validity scores exceeded 96%, affirming the instrument’s clarity and relevance. These findings provide promising preliminary evidence of the instrument’s content validity and internal consistency reliability, supporting its feasibility for future large-scale psychometric evaluation and potential integration into broader sports psychology coaching frameworks.
Downloads
References
Ashford, M., Cope, E., Abraham, A., & Poolton, J. (2025). Coaching player decision making in rugby union: Exploring coaches’ espoused theories and theories in use as an indicator of effective coaching practice. Physical Education and Sport Pedagogy, 30(1), 28–49. https://doi.org/10.1080/17408989.2022.2153822
Beaven, C. M., Kilduff, L. P., & Cook, C. J. (2023). Mental rehearsal improves passing skill and stress resilience in rugby players. International Journal of Sports Physiology and Performance, 18(9), 1047–1052. https://doi.org/10.1123/ijspp.2023-0117
Bird, M. D., Swann, C., & Jackman, P. C. (2024). The what, why, and how of goal setting: A review of the goal-setting process in applied sport psychology practice. Journal of Applied Sport Psychology, 36(1), 75–97. https://doi.org/10.1080/10413200.2023.2185699
Çakır, G., & Yılmaz, Ö. C. (2025). The role of emotional intelligence in athletes' effective decision making. Turkish Psychological Counseling and Guidance Journal, 15(78), 455–465. https://doi.org/10.17066/tpdrd.1502522
Camiré, M., Turgeon, S., Kramers, S., Rathwell, S., Bean, C., Sabourin, C., & Pierce, S. (2021). Development and initial validation of the Coaching Life Skills in Sport Questionnaire. Psychology of Sport and Exercise, 53, 101845. https://doi.org/10.1016/j.psychsport.2020.101845
DeVellis, R. F., & Thorpe, C. T. (2021). Scale development: Theory and applications. Sage Publications.
George, D., & Mallery, P. (2024). IBM SPSS Statistics 29 step by step: A simple guide and reference. Routledge.
Hair, J. F., Babin, B. J., Anderson, R. E., & Black, W. C. (2022). Multivariate data analysis (8th ed.). Cengage Learning.
Hollman, H., Liu, S., Davenport, M., & Rhodes, R. E. (2024). A critical review and user’s guide for conducting feasibility and pilot studies in the physical activity domain. Sport, Exercise, and Performance Psychology. https://doi.org/10.1037/spy0000350
Jaladin, M., Aga, R., & Lim, O. M. (2024). Development and validation of a psychoeducational module for empowering B40 youth's resilience and family functioning. Pertanika Journal of Social Sciences & Humanities, 32(1), 223–247. https://doi.org/10.47836/pjssh.32.1.10
Johnson, S. G., Potrebny, T., Larun, L., Ciliska, D., & Olsen, N. R. (2022). Usability methods and attributes reported in usability studies of mobile apps for health care education: Scoping review. JMIR Medical Education, 8(2), e38259. https://doi.org/10.2196/38259
Khan, T. K. A., Malek, N. F. A., Muszali, R., Salimin, N., Sankaravel, M., & Adnan, M. A. (2023). The challenges and psychological skills training experiences of Malaysian elite field hockey players. International Journal of Human Movement and Sports Sciences, 11(5), 1011–1019. https://doi.org/10.13189/saj.2023.110509
Liu, H., Yaakop, N., & Yang, X. (2025). Usability evaluation of the KSSR gymnastics training module among primary school physical education experts. Research Square. https://doi.org/10.21203/rs.3.rs-6426862/v1
Lima, J. D. S., Rojas, I. L., Strale, C. M., Bastías, D. D., Cumillaf, A. G., & Ramírez, F. G. (2025). Sports motivation in Chilean rugby players: Impact of occupational status. Retos: Nuevas Tendencias en Educación Física, Deporte y Recreación, (67), 37–45. https://doi.org/10.47197/retos.v67.112257
Lund, A. M. (2001). Measuring usability with the USE questionnaire. Usability Interface, 8(2), 3–6.
Razak, A. E. A., Kassim, M., Idriss, A. F. A., Israj, M. F. M., Rustam, S., & Maliki, A. B. H. M. (2025). Psychometric validation and implementation of a psychological skills training (PST) module for rugby coaches in Malaysia. Journal of Physical Education and Sport, 25(8), 1778–1785. https://doi.org/10.7752/jpes.2025.0819
Taherdoost, H., & Madanchian, M. (2024). A comprehensive survey and literature review on TOPSIS. International Journal of Service Science, Management, Engineering, and Technology, 15(1), 1–65. https://doi.org/10.4018/IJSSMET.347947
Yiğit, Ş., & Şahin, M. (2025). Investigation of psychological resilience and self-confidence levels of volleyball players. Online Journal of Recreation & Sports, 14(4). https://doi.org/10.22282/tojras.1765600
Downloads
Published
Issue
Section
License
Copyright (c) 2025 Ahmad Effendy Abdul Razak, Shahrulfadly Rustam, Mohar Kassim, Ahmad Fadzlee Ahmad Idriss, Ahmad Bisyri Husin Musawi Maliki
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
