Integrating User Perception and Technical Assessment for Comparative Software Quality Evaluation of Shopee and Tokopedia Based on ISO/IEC 25010

Authors

  • Rizky Ramadhan Narotama University image/svg+xml
  • Achmad Zakki Falani Narotama University
  • Eman Setiawan Narotama University

DOI:

https://doi.org/10.32664/j-intech.v14i03.2521

Keywords:

ISO/IEC 25010, Marketplace, Software Quality Assurance, Shopee, Tokopedia

Abstract

This study evaluates and compares the software quality of Shopee and Tokopedia based on four ISO/IEC 25010 characteristics, namely usability, performance efficiency, reliability, and portability. A quantitative evaluative-comparative approach was employed using data from 56 respondents and the USE Questionnaire for usability assessment. Technical evaluation was conducted using GTMetrix for performance efficiency, Apache JMeter for reliability, and cross-platform testing on Google Chrome, Mozilla Firefox, Android, and iOS for portability. The results show that Shopee achieved a usability score of 79.74%, while Tokopedia obtained 79.07%, with both classified as Good. For performance efficiency, Tokopedia achieved a Performance Score of 63%, whereas Shopee obtained 26%, which was classified as Bad. Reliability testing showed comparable results, with both applications achieving a 100% success rate and 0% error rate. The average response time was 1,522 ms for Shopee and 1,550 ms for Tokopedia. In terms of portability, Shopee achieved an overall success rate of 92.5%, while Tokopedia achieved 85%, both classified as Very Good. Overall, Shopee demonstrated better usability and portability, while Tokopedia demonstrated better performance efficiency. The reliability results were considered comparable under the applied 100-user baseline testing scenario. These findings demonstrate that software quality comparison should consider multiple ISO/IEC 25010 characteristics rather than relying on a single quality dimension.

References

[1] R. P. I. Paramaeswari and R. Sarno, “Analysis of E-Commerce (Bukalapak, Shopee, and Tokopedia) Acceptance Models Using TAM2 Method,” International Seminar on Application for Technology of Information and Communication (iSemantic), pp. 505–510, 2020, doi: https://doi.org/10.1109/iSemantic50169.2020.9234271.

[2] M. S. Lamada, A. Sa’ban Miru, and R. Amalia, “Pengujian Aplikasi Sistem Monitoring Perkuliahan Menggunakan Standar ISO 25010,” Jurnal MediaTIK : Jurnal Media Pendidikan Teknik Informatika dan Komputer, vol. 3, no. 3, pp. 1–7, Sep. 2024, doi: 10.59562/mediatik.v3i3.1559.

[3] A. Roeke and S. Nurlela, “Analisis Kualitas Aplikasi Shopee Menggunakan Metode Importance Performance Analysis (IPA),” Jurnal Infortech, vol. 5, no. 1, pp. 30–35, Jun. 2023, doi: 10.31294/infortech.v5i1.15457.

[4] Y. Jordan, V. Handrianus Pranatawijaya, and Widiatry, “Analisis Kualitas Dan Penerapan Software Quality Assurance Pada Aplikasi Dana Menggunakan Model ISO/IEC 9126 (Studi Kasus: Aplikasi Dana),” JATI (Jurnal Mahasiswa Teknik Informatika), vol. 8, no. 4, pp. 7687–7691, 2024, doi: 10.36040/jati.v8i4.10048.

[5] I. P. A. A. Santana and Z. Z. Bawazir, “Evaluasi Aplikasi Tokopedia Menggunakan Metode System Usability Scale (SUS) Dalam Pengadaan Barang Kantor,” Jurnal Ilmiah Sains Sosial, Kewirausahaan Dan Kebudayaan, vol. 3, no. 1, pp. 19–24, 2025, doi: https://doi.org/10.58878/jissiwirabuda.v3i1.372.

[6] E. Sulma Safinatus Sofiyah and Fersellia, “Analisis Usability dan User Experience Aplikasi Tokopedia Menggunakan Metode System Usability Scale (SUS) dan User Experience Questionnaire (UEQ),” JUKI : Jurnal Komputer dan Informatika, vol. 7, no. 1, pp. 70–79, May 2025, doi: 10.53842/juki.v7i1.1052.

[7] C. Anwar, S. Farizy, and S. Wijayanto, “Implementasi ISO/IEC 25010 Dalam Evaluasi Kualitas Fungsional Dan Usability Sistem Informasi Keuangan Studi Kasus PT Teknologi Informatika Solusindo,” Jurnal Mahasiswa Teknik Informatika, vol. 10, no. 2, pp. 3034–3042, Apr. 2026, doi: https://doi.org/10.36040/jati.v10i2.17898.

[8] M. C. Saputra, S. A. Wicaksono, S. H. Wijoyo, P. N. Rahmandita, and B. T. Hanggara, “Quality Analysis of an Interactive Programming Learning Platform Based on ISO/IEC 25010 Using a String-Matching Approach on User Reviews,” J-INTECH (Journal of Information and Technology), vol. 13, no. 1, pp. 192–202, 2025, doi: https://doi.org/10.32664/j-intech.v13i01.2003.

[9] U. Arshad, T. Yasir, and T. Shakeel, “Web Usability and User Experience for Pakistani E-commerce websites,” International Conference on Innovative Computing (ICIC), pp. 1–7, Nov. 2021.

[10] A. Ashraf, A. H. Mohammad, and S. Aqeel, “A Usability Evaluation of M-commerce Apps,” University of Sindh Journal of Information and Communication Technology, vol. 5, no. 4, pp. 184–207, 2025, Accessed: Jul. 29, 2026. [Online]. Available: https://sujo.usindh.edu.pk/index.php/USJICT/article/view/4072

[11] Daniel. Galin, Software Quality: Concepts and Practice. Wiley-IEEE Computer Society Press, 2018. doi: https://doi.org/10.1002/9781119134527.

[12] C. Wijaya and J. Parhusip, “Analisis Kualitas Aplikasi Google Classroom Menggunakan Model ISO/IEC 25010 Berdasarkan Persepsi Pengguna,” Jurnal Mahasiswa Teknik Informatika, vol. 10, no. 1, pp. 116–122, Feb. 2026, doi: 10.36040/jati.v10i1.16643.

[13] A. Stefani, E. Vamvatsikou, and B. Vassiliadis, “Insights into B2C E-Commerce Quality Using ISO 25010,” Journal of Software Engineering and Applications, vol. 16, no. 11, pp. 622–639, 2023, doi: https://doi.org/10.4236/jsea.2023.1611032.

[14] K. Moumane, A. Idri, F. El Aouni, J. Laghnimi, N. C. Benabdellah, and O. Hamal, “ISO/IEC 25010-based Quality Evaluation of Three Mobile Applications for Reproductive Health Services in Morocco,” Clin. Exp. Obstet. Gynecol., vol. 51, no. 4, p. 88, Apr. 2024, doi: 10.31083/j.ceog5104088.

[15] Sugiyono, Metode Penelitian Kuantitatif, Kualitatif, dan R&D. Bandung: Alfabeta, 2021. Accessed: Apr. 27, 2026. [Online]. Available: https://archive.org/details/buku-metode-penelitian-sugiyono/mode/2up

[16] P. Dellia, S. D. Saputro, R. Faisal, L. Rosidah, and N. W. Hidayatulloh, “Kualitas Perpustakaan Digital Berdasarkan ISO 25010,” Jurnal Teknologi dan Informasi, vol. 15, no. 1, pp. 54–65, Mar. 2025, doi: https://doi.org/10.34010/jati.v15i1.15092.

[17] D. Hariadi and D. Trisnawarman, “Komparasi Algoritma Clustering Untuk Analisis Data Kuisioner Perguruan Tinggi X,” Jurnal Ilmu Komputer dan Sistem Informasi, vol. 14, no. 1, Jan. 2026, doi: 10.24912/fpsvtj38.

[18] A. Z. Falani, “Evaluating the Usability of a University Website Using the System Usability Scale (SUS),” Reputasi: Jurnal Rekayasa Perangkat Lunak, vol. 7, no. 1, pp. 33–37, 2026, doi: https://doi.org/10.31294/reputasi.v7i1.12592.

[19] D. Islamiwati and A. Nasukha, “Perancangan Sistem Informasi Posyandu Berbasis Website di Desa Rambutan Masam,” RIGGS: Journal of Artificial Intelligence and Digital Business, vol. 5, no. 1, pp. 7200–7208, Mar. 2026, doi: 10.31004/riggs.v5i1.7039.

[20] G. Tyas, D. Purnamasari, and A. Suroso, “Analisis Kualitas Aplikasi E-Exam Menggunakan Standar ISO 25010,” Jurnal Informatika: Jurnal pengembangan IT (JPIT), vol. 6, no. 2, pp. 126–132, May 2018, doi: 10.30591/jpit.v6i2.499.

[21] D. K. Sari, D. Rosana, S. Supahar, P. A. C. Dinata, and A. Reski, “Measures Teachers’ Perceptions of Differentiated Instruction : A Combination of Guttman Scale and Item Response Theory,” Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran, vol. 10, no. 3, pp. 837–846, Sep. 2024, doi: 10.33394/jk.v10i3.11841.

[22] V. S. Barletta, D. Caivano, L. Colizzi, G. Dimauro, and M. Piattini, “Clinical-chatbot AHP evaluation based on ‘quality in use’ of ISO/IEC 25010,” Int. J. Med. Inform., vol. 170, p. 104951, Feb. 2023, doi: https://doi.org/10.1016/j.ijmedinf.2022.104951.

[23] A. Anhar, M. Firdaus, D. R. A. Pangestu, S. Salpiana, and J. A. Putri, “Analisis dan Pengembangan Quality of Experience Website E-Commerce Menggunakan GTMetrix,” Jurnal Ilmiah Informatika, vol. 8, no. 1, pp. 65–73, Jun. 2023, doi: 10.35316/jimi.v8i1.65-73.

Downloads

Published

2026-09-26