Education Quarterly Reviews
ISSN 2621-5799
Published: 23 December 2023
Developing A SERVQUAL-Based Scale for Measuring Student Satisfaction with Academic Service in Higher Education
Yosef, Arief Rachman Ibrahim, Muhammad Yusup, Damar Tutur Wicaksono, Putri Amalia
Sriwijaya University, Indonesia
Download Full-Text Pdf
10.31014/aior.1993.06.04.793
Pages: 146-157
Keywords: Academic Service, Student Satisfaction, Higher Education, Service Quality
Abstract
Assessing student satisfaction with academic services provided by higher education institutions has always been a challenging task. This study aimed to create a valid, reliable, and practical web-based student satisfaction scale (SSS) through a design and validation stage. Applying the SERVQUAL model in this development research, during the design stage, the SSS consisted of three subscales with 32 items. These items were established and validated through expert review for content validity, pilot testing for practicality, and a main test for concurrent validity. The results showed that the it had an acceptable level of content validity with I-CVI scores ranging from .80 to 1.00 and an S-CVI of .90. It also met practicality criteria with an S-SPI of 0.9. The concurrent validity of the SSS ranged from .665 to .999, and reliability was .888 to .999. These findings suggest that the SSS met valid, reliable, and practical criteria. It has diagnostic and predictive value for improving quality assurance purposes.
References
Abili, K., Narenji Thani, F., & Afarinandehbin, M. (2012). Assessing quality gap of university services. Asian Journal on Quality, 13(3), 204–211. https://doi.org/10.1108/15982681211287766
Andres, F. da C., Andres, S. C., Moreschi, C., Rodrigues, S. O., & Ferst, M. F. (2020). The use of the Google Forms platform in academic research: Experience report. Research, Society and Development, 9(9), 1–7. https://doi.org/http://dx.doi.org/10.33448/rsd-v9i9.7174 A
Bertea, P. A., & Zait, A. (2013). Scale Validity in Exploratory Stages of. Management & Marketing, 9(1), 38–46.
Butt, B. Z., & Rehman, K. ur. (2010). A study examining the students satisfaction in higher education. Procedia Social and Behavioral Sciences, 2(2), 5446–5450. https://doi.org/10.1016/j.sbspro.2010.03.888
Cohen, R. J., & Swerdlik, M. E. (2017). Psychological testing and assessment: An introduction to tests and measurement (9th ed.). Mc Graw Hill.
Dan, P. (2012). Measuring Quality Satisfaction with Servqual Model. In A. Pusca (Ed.), The 7th Edition of Internationa Conference European Integration Realities and Perspectives (Issue January, pp. 696–707). Danubius University, Romania. https://doi.org/10.2139/ssrn.2263867
Douglas, J., Douglas, A., & Barnes, B. (2006). Measuring student satisfaction at a UK university. Quality Assurance in Education, 14(3), 251–267. https://doi.org/10.1108/09684880610678568
Goumairi, O., Aoula, E. S., & Souda, S. B. E. N. (2020). Application of the servqual model for the evaluation of the service quality in Moroccan higher education: Public engineering school as a case study. International Journal of Higher Education, 9(5), 223–229. https://doi.org/10.5430/ijhe.v9n5p223
Harlow, A. (2010). Online surveys—possibilities, pitfalls and practicalities: The experience of the TELA evaluation. Waikato Journal of Education, 15(2). https://doi.org/10.15663/wje.v15i2.116
Harvey, L. (2022). Back to basics for student satisfaction : improving learning rather than constructing fatuous rankings Back to basics for student satisfaction : improving learning rather than constructing fatuous rankings. Quality in Higher Education, 28(3), 265–270. https://doi.org/10.1080/13538322.2022.2050477
Kanwar, A., & Sanjeeva, M. (2022). Student satisfaction survey: A key for quality improvement in the higher education. Journal of Innovation and Entrepreneurship, 11, 1–10. https://doi.org/10.1186/s13731-022-00196-6
Krsmanovic, M., Horvat, A., & Ruso, J. (2014). Application of SERVQUAL model in high education. 11th International Conference “Standardization, Protypes and Quality: A Means of Balkan Countries’ Collaboration, September. https://www.researchgate.net/publication/267980133_Application_of_SERVQUAL_model_in_high_education
Lee, D., & Lim, H.-W. (2008). Scale Construction. In P. P. Heppner, D. M. Kivlighan, & B. E. Wampold (Eds.), Research Design in Counseling(3th ed., pp. 494–510). Thomson Brooks/Cole.
Liu, S., & Liu, J. (2017). Chapter 2 - Quality Assurance in Chinese Higher Education A2 - Shah, Mahsood. In M. S. Do & Q. T.N. (Eds.), The Rise of Quality Assurance in Asian Higher Education (pp. 15–33). Chandos Publishing. https://doi.org/https://doi.org/10.1016/B978-0-08-100553-8.00001-X
Mann, B. L. (2006). Formative Evaluation of Instructional Material. In B. Mann (Ed.), Selected style in web-based educational researcch (pp. 232–242). Idea Group Publishing. https://eric.ed.gov/?id=ED508893
McCowan, R. J., & McCowan, S. J. (1999). Item Analysis for Criterion-Referenced Tests. In Online Submission. Center for Development of Human Services. http://eric.ed.gov/ERICWebPortal/recordDetail?accno=ED501716
Mishra, S. (2007). Quali1y Assurance In Higher Education: An Introducation (2nd ed.). National Assessment and Accreditation Council and Commonwealth of Learning. https://oasis.col.org/server/api/core/bitstreams/5154fb34-2c2e-4bd0-8388-c2f5b2046f26/content
Nayak, M. S. D. P., & Narayan, K. A. (2019). Strengths and Weakness of Online Surveys. IOSR Journal of Humanities and Social Sciences, 24(5), 31–38. https://doi.org/10.9790/0837-2405053138
Özkan, H. A. (2016). Weaknesses of servqual whıch resources from cognıtıve dıfferences. International Journal of Business and Social Research, 06(11), 34–41. https://www.researchgate.net/publication/6185294_Is_the_CVI_an_acceptable_indicator_of_content_validity_Appraisal_and_recommendations
Parasuraman, A. P., Zeithaml, V. A., & Berry, L. L. (1985). A Conceptual Model of Service Quality and its Implication for Future Research ( SERVQUAL ). Journal of Marketing, 49(January), 41–45. https://doi.org/10.2307/1251430
Parasuraman, A. P., Zeithaml, V. A., & Berry, L. L. (1988). SERVQUAL : A multiple- Item Scale for measuring consumer perceptions of service quality. Journal of Retailing, 64(January), 12–40. https://www.researchgate.net/publication/225083802_SERVQUAL_A_multiple-_Item_Scale_for_measuring_consumer_perceptions_of_service_quality
Polit, D. F., Beck, C. T., & Owen, S. V. (2007). Focus on Research Methods Is the CVI an Acceptable Indicator of Content Validity? Appraisal and Recommendations. Research in Nursing & Health, 30, 459–467. https://doi.org/10.1002/nur.20147
Rao, T. A., Ehsan-ul-Haq, & Tariq, S. (2018). Quality Assurance of Web-Based Applications. Internasional Journal of Multidisciplinary Science and Engineering, 2(2), 1–5. https://www.researchgate.net/publication/323676961_Quality_Assurance_of_Web-Based_Applications
Razinkina, E., Pankova, L., Trostinskaya, I., Pozdeeva, E., Evseeva, L., & Tanova, A. (2018). Student satisfaction as an element of education quality monitoring in innovative higher education institution. E3S Web of Conferences, 33, 1–8. https://doi.org/10.1051/e3sconf/20183303043
Regmi, P. R., Waithaka, E., Paudyal, A., Simkhada, P., & Van Teijlingen, E. (2016). Nepal journal of epidemiology guide to the design and application of online questionnaire surveys. Nepal Journal of Epedemiology, 6(4), 640–644. www.nepjol.info/index.php/NJE
Rubio, D. M., Berg-Weger, M., Tebb, S. S., Lee, E. S., & Rauch, S. (2003). Objectifying content validity: Conducting a content validity study in social work research. Social Work Research, 27(2), 1869–1876. https://doi.org/10.1016/b0-12-227055-x/00351-5
Saliba, K., & Zoran, A. G. (2018). Measuring Higher Education Services Using the SERVQUAL Model. Journal of Universal Excellence, 4(4), 160–179. https://www.fos-unm.si/media/pdf/IP/IP_37_SALIBA_ZORAN.pdf
Salinda Weerasinghe, I. M., Lalitha, R., & Fernando, S. (2017). Students’ Satisfaction in Higher Education Literature Review. American Journal of Educational Research, 5(5), 533–539. https://doi.org/10.12691/education-5-5-9
Santosa, P. I. (2016). Measuring user experience during a web-based survey: A case Of back-to-back online surveys. International Journal on Advanced Science, Engineering and Information Technology, 6(3), 339–344. https://doi.org/10.18517/ijaseit.6.3.815
Shabbir, M., Khalid, M. I., Bakhsh, K., Mohsin, M. N., Rasool, S., & Mohsin, M. S. (2015). Improving Professional Development System through Quality Assurance Practices in the Universities of Pakistan. International Education Studies, 9(1), 141. https://doi.org/10.5539/ies.v9n1p141
Sharma, H. (2022). How short or long should be a questionnaire for any research? Researchers dilemma in deciding the appropriate questionnaire length. Saudi Journal of Anaesthesia, 16(1), 65–68. https://doi.org/10.4103/sja.sja_163_21
Siming, L., Gao, J., & Xu, D. (2015). Factors leading to students ’ satisfaction in the higher learning institutions. Journal of Education and Pratice, 6(31), 114–118. https://files.eric.ed.gov/fulltext/EJ1083362.pdf
Soares, M. C., Novaski, O., & Anholon, R. (2017). SERVQUAL model applied to higher education public administrative services. Brazilian Journal of Operations & Production Management, 14(3), 338–349. https://doi.org/10.14488/bjopm.2017.v14.n3.a7
Son, D. H., Linh, T. V., & Van, P. T. H. (2021). Applying Google form in Doing Job Survey : A Case Study At Binh Thuan Medical College. American Journal of Sciences and Engineering Research, 4(6), 176–187. https://iarjournals.com/upload/46176187.pdf
Sunarto, K. (2022). Chapter 5 - The Rise of Quality Assurance in Indonesian Higher Education (M. S. Do & Q. T.N. (eds.); pp. 67–86). Chandos Publishing. https://doi.org/https://doi.org/10.1016/B978-0-08-100553-8.00008-2
Teeroovengadum, V., Kamalanabhan, T. J., & Seebaluck, A. K. (2016). Measuring service quality in higher education. Quality Assurance in Education, 24(2), 244–258. https://doi.org/10.1108/QAE-06-2014-0028
Visscher, A. J. (2009). Improving quality assurance in European vocational education and training: Factors influencing the use of quality assurance findings. In Improving Quality Assurance in European Vocational Education and Training: Factors Influencing the Use of Quality Assurance Findings (Issue April 2009, pp. 1–182). https://doi.org/10.1007/978-1-4020-9527-6
Warn, J., & Tranter, P. (2001). Measuring Quality in Higher Education: A Competency Approach. Quality in Higher Education, 3(3). https://doi.org/10.1080/13538320120098078
Wolf, R. (1967). Evaluation of Several Formulae for Correction of Item-Total Correlation in Item Analysis. Journal of Educational Measurement, 4(1), 21. https://doi.org/10.1111/j.1745-3984.1967.tb00565.x
Wong, W. H., & Chapman, E. (2022). Student satisfaction and interaction in higher education. Higher Education, 85(5), 957–978. https://doi.org/10.1007/s10734-022-00874-0
Wu, M. J., Zhao, K., & Fils-Aime, F. (2022). Response rates of online surveys in published research: A meta-analysis. Computers in Human Behavior Reports, 7(February), 1–11. https://doi.org/10.1016/j.chbr.2022.100206
Wyatt, J. C. (2000). When to Use Web-based Surveys. Journal of the American Medical Informatics Association, 7(4), 426–430. https://doi.org/10.1136/jamia.2000.0070426
Yaghmaie, F. (2003). Validity and Its Estimation. Journal of Medical Education, 3(1), 25–27. https://www.researchgate.net/publication/277034169_Content_validity_and_its_estimation
Yusoff, M. S. B. (2019). ABC of Content Validation and Content Validity Index Calculation. Education in Medicine Journal, 11(2), 49–54. https://doi.org/10.21315/eimj2019.11.2.6
Zaki, M. (2020). Academic Quality Assurance Survey in Higher Education. International Journal of Higher Education, 9(6), 268–275. https://doi.org/10.5430/ijhe.v9n6p268
Zamanzadeh, V., Ghahramanian, A., Rassouli, M., Abbaszadeh, A., & Alavi-, H. (2015). Design and Implementation Content Validity Study : Development of an instrument for measuring Patient-Centered Communication. Journal of Caring Sciences, 4(5), 165–178. https://doi.org/10.15171/jcs.2015.017
Zeithaml, V. A., Parasuraman, A., & Malhotra, A. (2002). Service quality delivery through web sites: A critical review of extant knowledge. Journal of the Academy of Marketing Science, 30(4), 362–375. https://doi.org/10.1177/009207002236911