Evaluasi Usabilitas Mobile Learning Matematika SMA Menggunakan SUS dan Evaluasi Heuristik
Abstract
AbstrakPenggunaan aplikasi mobile learning dalam pembelajaran matematika berkembang pesat, namun aspek usabilitas masih jarang dikaji secara mendalam pada siswa SMA di Indonesia. Penelitian ini menganalisis usabilitas aplikasi mobile learning matematika menggunakan dua metode yang saling melengkapi, yaitu System Usability Scale (SUS) dan Heuristic Evaluation Nielsen, dengan pendekatan deskriptif kuantitatif yang melibatkan 25 siswa SMA di Kota Manado sebagai responden SUS dan 5 evaluator ahli untuk pengujian heuristik berdasarkan 10 prinsip Nielsen. Hasil penelitian menunjukkan skor rata-rata SUS sebesar 71,4 (SD = 9,82) yang berada pada kategori “Good” dengan tingkat penerimaan “Acceptable”. Heuristic evaluation mengidentifikasi 22 temuan unik usabilitas pada 10 prinsip Nielsen, dengan tiga prinsip paling kritis yaitu Error Prevention (severity 3,0), User Control and Freedom (2,8), dan Help and Documentation (2,8). Triangulasi kedua metode menunjukkan bahwa skor SUS yang baik tidak otomatis menjamin tidak adanya permasalahan usabilitas signifikan, sehingga menjadi dasar rekomendasi perbaikan terstruktur bagi pengembangan media pembelajaran digital matematika di Indonesia.
Kata Kunci: Usabilitas, Mobile Learning, System Usability Scale, Heuristic Evaluation, Triangulasi Metode
AbstractThe use of mobile learning applications in mathematics education has grown rapidly, yet usability remains underexplored among Indonesian senior high school (SMA) students. This study analyzes the usability of a mathematics mobile learning application using two complementary methods, the System Usability Scale (SUS) and Nielsen’s Heuristic Evaluation, through a quantitative descriptive approach involving 25 SMA students in Manado City as SUS respondents and 5 expert evaluators for heuristic testing based on Nielsen’s 10 usability heuristics. The results show a mean SUS score of 71.4 (SD = 9.82), categorized as “Good” with an “Acceptable” rating. The heuristic evaluation identified 22 unique usability issues across the 10 Nielsen principles, with the three most critical being Error Prevention (severity 3.0), User Control and Freedom (2.8), and Help and Documentation (2.8). Triangulation of both methods reveals that a high SUS score does not automatically indicate the absence of significant usability problems, providing the basis for structured improvement recommendations for digital mathematics learning media in Indonesia.
Keywords: Usability, Mobile Learning, System Usability Scale, Heuristic Evaluation, Method Triangulation
References
Anam, M. K., Susanti, S., Nurjayadi, N., Zoromi, F., & Sari, A. K. (2025). Evaluation of an existing system using the System Usability Scale (SUS) as a guideline for system improvement. Jurnal Teknik Informatika, 18(1), 122–132. https://doi.org/10.15408/jti.v18i1.40766
Bangor, A., Kortum, P., & Miller, J. (2009). Determining what individual SUS scores mean: Adding an adjective rating scale. Journal of Usability Studies, 4(3), 114–123.
Brooke, J. (1996). SUS: A “quick and dirty” usability scale. Dalam P. W. Jordan, B. Thomas, B. A. Weerdmeester, & A. L. McClelland (Eds.), Usability evaluation in industry (hlm. 189–194). Taylor & Francis.
Cecep, Mutaqin, A., & Pamungkas, A. S. (2019). Pengembangan modul Quick Math berbasis mobile learning sebagai penunjang pembelajaran matematika di SMA. Prisma Sains: Jurnal Pengkajian Ilmu dan Pembelajaran Matematika dan IPA IKIP Mataram, 7(2), 148–158.
Dutta, R., Mantri, A., & Singh, G. (2022). Evaluating system usability of mobile augmented reality application for teaching Karnaugh-Maps. Smart Learning Environments, 9(1), Article 6. https://doi.org/10.1186/s40561-022-00188-9
Hoehle, H., & Venkatesh, V. (2015). Mobile application usability: Conceptualization and instrument development. MIS Quarterly, 39(2), 435–472. https://doi.org/10.25300/MISQ/2015/39.2.08
International Organization for Standardization. (2018). ISO 9241-11:2018 — Ergonomics of human-system interaction — Part 11: Usability: Definitions and concepts. ISO. https://www.iso.org/standard/63500.html
Kumar, B. A., & Goundar, M. S. (2019). Usability heuristics for mobile learning applications. Education and Information Technologies, 24(2), 1819–1833. https://doi.org/10.1007/s10639-019-09860-z
Kumar, B. A., Goundar, M. S., & Chand, S. S. (2020). A framework for heuristic evaluation of mobile learning applications. Education and Information Technologies, 25(4), 3189–3204. https://doi.org/10.1007/s10639-020-10112-8
Landis, J. R., & Koch, G. G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33(1), 159–174. https://doi.org/10.2307/2529310
Lewis, J. R., & Sauro, J. (2009). The factor structure of the System Usability Scale. Dalam M. Kurosu (Ed.), Human Centered Design. HCD 2009. Lecture Notes in Computer Science, vol. 5619 (hlm. 94–103). Springer. https://doi.org/10.1007/978-3-642-02806-9_12
Navarro-Cota, C., Molina, A. I., Redondo, M. A., & Lacave, C. (2024). A comprehensive usability measurement tool for m-learning applications. IEEE Transactions on Education, 67(2), 209–223. https://doi.org/10.1109/TE.2023.3347191
Nielsen, J. (1994a). 10 usability heuristics for user interface design. Nielsen Norman Group. https://www.nngroup.com/articles/ten-usability-heuristics/
Nielsen, J. (1994b). Severity ratings for usability problems. Nielsen Norman Group. https://www.nngroup.com/articles/how-to-rate-the-severity-of-usability-problems/
Nielsen, J., & Molich, R. (1990). Heuristic evaluation of user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI ’90), 249–256. https://doi.org/10.1145/97243.97281
Nugroho, K. T., Julianto, B., & Nur MS, D. F. (2022). Usability testing pada sistem informasi manajemen AKN Pacitan menggunakan metode System Usability Scale. Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 11(1), 74–83. https://doi.org/10.23887/janapati.v11i1
Purwani, F., & Farhah, F. A. (2024). Usability testing analysis on professional social media using the System Usability Scale (SUS) method. Jurnal Perangkat Lunak, 6(3), 392–399. https://doi.org/10.32520/jupel.v6i3.3426
Ramlan, M. F., & Nasir, M. K. M. (2023). The impact of mobile applications in education: A concept paper. International Journal of Academic Research in Progressive Education and Development, 12(3), 2364–2371. https://doi.org/10.6007/IJARPED/v12-i3/19609
Sauro, J., & Lewis, J. R. (2016). Quantifying the user experience: Practical statistics for user research (2nd ed.). Elsevier/Morgan Kaufmann.
Singh, V., & Thurman, A. (2019). How many ways can we define online learning? A systematic literature review of definitions of online learning (1988–2018). American Journal of Distance Education, 33(4), 289–306. https://doi.org/10.1080/08923647.2019.1663082
Suria, O. (2024). A statistical analysis of System Usability Scale (SUS) evaluations in online learning platform. Journal of Information Systems and Informatics, 6(2), 992–1007. https://doi.org/10.51519/journalisi.v6i2.750
Vlachogianni, P., & Tselios, N. (2022). Perceived usability evaluation of educational technology using the System Usability Scale (SUS): A systematic review. Journal of Research on Technology in Education, 54(3), 392–409. https://doi.org/10.1080/15391523.2020.1867938
