Demystifying Educational Demands: Analyzing the Needs for the Online Comprehensive Test Application at Islamic University
DOI:
https://doi.org/10.25217/ji.v8i1.2730Keywords:
Need Analysis, Online Comprehensive Test, Online-Based AssessmentAbstract
This study aims to identify the needs for developing an online comprehensive test application at one of the Islamic universities in Indonesia. The needs assessment includes target situation analysis, user needs analysis, reality analysis, and gap analysis. This is a descriptive quantitative research involving 135 examiners and students who are taking comprehensive examinations from all four faculties at IAIN Bone as samples. Sampling technique used a stratified random sampling. Questionnaires and interview techniques were utilized for data collection, followed by a descriptive analysis. The findings reveal several weaknesses in the comprehensive test system. These include the lack of integration among all faculties, partial implementation, a highly flexible exam schedule, a paper-based test administration method, a lack of standardized instrument development, and suboptimal utilization of comprehensive test results for mapping student competencies. To conclude, it is necessary to develop an online comprehensive test application which is expected to be able to make the implementation of the comprehensive test at IAIN Bone more integrated, programmed, and effective.
Keywords: Need Analysis, Online Comprehensive Test, Online-Based Assessment
References
Afriansyah, R., & Pratama, M. S. (2020). Implementasi sistem ujian berbasis komputer di SMP Negeri 1 Sungailiat. KACANEGARA Jurnal Pengabdian Pada Masyarakat, 3(2). https://doi.org/10.28989/kacanegara.v3i2.681
Alfian, A. (2019). Students’ Voice: A Need Analysis on Teaching and Learning English at Islamic University. Indonesian Journal of English Teaching, 8(2). https://doi.org/10.15642/ijet2.2019.8.2.63-72
Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and challenges of using e-assessment. International Journal of Information and Education Technology, 8(1), 34–37.
Azwar, S. (2016). Konstruksi Tes Kemampuan Kognitif (2nd ed.). Pustaka Pelajar. https://doi.org/10.18178/ijiet.2018.8.1.1008
Cham, K. M., & Cochrane, A. L. (2020). A digital resource to assess clinical competency. The Clinical Teacher, 17(2), 153–158. https://doi.org/10.1111/tct.13030
Clark, T. M., Callam, C. S., Paul, N. M., Stoltzfus, M. W., & Turner, D. (2020). Testing in the time of covid-19: a sudden transition to unproctored online exams. Journal of Chemical Education, 97(9), 3413–3417. https://doi.org/10.1021/acs.jchemed.0c00546
Cohen, L., Manion, L., & Morrison, K. (2017). Validity and Reliability. In Research Methods in Education (8th ed., p. 40). Routledge.
Devisakti, A., & Muftahu, M. (2022). Does online assessments support of students in higher education? The moderating role of IT experience. The International Journal of Information and Learning Technology, 39(4), 305–318. https://doi.org/10.1108/IJILT-12-2021-0186
Diana, S., & Mansur, M. (2018). Need analysis on English teaching materials for ICT students. ETERNAL (English, Teaching, Learning, and Research Journal), 4(2), 209–218.
Dogan, N., Uysal, K. N., Kelecioglu, H., & Hambleton, R. K. (2020). An overview of e-assessment. Hacettepe University Journal of Education, 1–5. https://doi.org/10.16986/HUJE.2020063669
Ganefri, Hidayat, H., Kusumaningrum, I., & Mardin, A. (2017). Needs analysis of entrepreneurships pedagogy of technology and vocational education with production based learning approach in higher education. International Journal on Advanced Science, Engineering and Information Technology, 7(5), 1701. https://doi.org/10.18517/ijaseit.7.5.1510
Golden, J., & Kohlbeck, M. (2020). Addressing cheating when using test bank questions in online Classes. Journal of Accounting Education, 52, 100671. https://doi.org/10.1016/j.jaccedu.2020.100671
Halamish, V., & Elias, D. (2022). Digital versus paper-based foreign-language vocabulary learning and testing: A study-test medium congruency effect. Computers & Education, 190, 104606. https://doi.org/10.1016/j.compedu.2022.104606
Huberman, A. M., & Miles, J. S. M. B. (2019). Qualitative data analysis: A methods sourcebook.
Huda, S. S. M., Kabir, M. D., & Siddiq, T. (2020). E-Assessment in Higher Education: Students’ Perspective. International Journal of Education and Development Using Information and Communication Technology, 16(2), 250–258.
Indra, E., Sitanggang, A. L., & Loi, M. H. (2019). Rancang bangun aplikasi sistem ujian saringan masuk SMA berbasis android (studi kasus SMA Amir Hamzah Medan). Jurnal Sistem Informasi Dan Ilmu Komputer Prima(JUSIKOM PRIMA), 2(2), 8–16. https://doi.org/10.34012/jusikom.v2i2.439
Joshi, A., Virk, A., Saiyad, S., Mahajan, R., & Singh, T. (2020). Online assessment: concept and applications. Journal of Research in Medical Education & Ethics, 10(2), 49. https://doi.org/10.5958/2231-6728.2020.00015.3
Kher, N., Juneau, G., & Molstad, S. (2002). Test Feedback Class Sessions: Creating a Positive Learning Experience. College Teaching, 50(4), 148–150. https://doi.org/10.1080/87567550209595896
Mardapi, D. (2008). Teknik Penyusunan Instrumen Tes dan Nontes. Mitra Cendikia.
Miyake, M., & Tremarco, J. (2005). Needs Analysis for Nursing Students Utilizing Qestionnaires and Interviews. Kawasaki Journal of Medical Welfare, 1, 23–34.
Nicol, D. (2007). E‐assessment by design: using multiple‐choice tests to good effect. Journal of Further and Higher Education, 31(1), 53–64. https://doi.org/10.1080/03098770601167922
Nurjannah, N. (2018). Analisa Kebutuhan Sebagai Konsep Dasar Dalam Pengembangan Kurikulum Bahasa Arab di MAN Curup. Arabiyatuna : Jurnal Bahasa Arab, 2(1), 51–71. https://doi.org/10.29240/jba.v2i1.409
Osabutey, E. L. C., Senyo, P. K., & Bempong, B. F. (2022). Evaluating the potential impact of online assessment on students’ academic performance. Information Technology & People. https://doi.org/10.1108/ITP-05-2021-0377
Pamungkas, P. D. A. (2017). Computer Based Test (CBT) pada Sekolah Tinggi Tarakanita Jakarta Menggunakan Metode Computerized Fixed-Form Test (CFT). JITTER Jurnal Ilmiah Teknologi Informasi Terapan, IV(1), 54–61.
Retnawati, H. (2016). Analisis Kuantitatif Instrumen Penelitian (Panduan Peneliti, Mahasiswa, dan Psikometrian). Parama Publishing.
Saragih, E. (2014). Designing ESP Materials for Nursing Students Based On Needs Analysis. International Journal of Linguistics, 6(4), 59. https://doi.org/10.5296/ijl.v6i4.5983
Sava, S. (2012). Needs Analysis and Programme Planning in Adult Education (1st ed.). Verlag Barbara Budrich. https://doi.org/10.2307/j.ctvbkjvs2
Sharma, A., Konar, K., Sanghvi, K., Churi, P., & Rao, N. T. (2021). Perception of students in online test in engineering: case of NMIMS University. 2021 International Conference on Communication Information and Computing Technology (ICCICT), 1–7. https://doi.org/10.1109/ICCICT50803.2021.9510072
Shraim, K. (2019). Online examination practices in higher education institutions: learners’ perspectives. Turkish Online Journal of Distance Education, 20(4), 185–196. https://doi.org/10.17718/tojde.640588
Si, J., Kong, H.-H., & Lee, S.-H. (2021). Exploring medical educators’ readiness and the priority of their educational needs for online teaching. Korean Journal of Medical Education, 33(1), 37–44. https://doi.org/10.3946/kjme.2021.185
Sundari, E., & Izzati, N. (2020). Pengembangan instrumen tes berbasis android pada materi rumus trigonomentri kelas X. BAREKENG: Jurnal Ilmu Matematika Dan Terapan, 14(2), 239–248. https://doi.org/10.30598/barekengvol14iss2pp239-248
Susilowati, S. , & Hidayat, T. (2018). Rancang bangun sistem informasi ujian online. Jurnal Teknik Komputer, 4(1).
Suwarna, I. P. (2017). Mengembangkan instrumen ujian komprehensif pada program studi pendidikan fisika melalui computer based test (CBT).
Taherdoost, H. (2016). Validity and reliability of the research instrument; how to test the validation of a questionnaire/survey in a research. How to Test the Validation of a Questionnaire/Survey in a Research . https://doi.org/10.2139/ssrn.3205040
Utami, K., Akhyar, M., & Sudiyanto, S. (2023). Potential implementation of android-based interactive multimedia for student learning activities. AL-ISHLAH: Jurnal Pendidikan, 15(1), 507–518. https://doi.org/10.35445/alishlah.v15i1.2641
Wardhana, I. P. S. P., Darmawiguna, I. G. M., & Sunarya, I. M. G. (2015). Pengembangan aplikasi instrumen gamelan gong kebyar berbasis android. Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI), 4(2), 58. https://doi.org/10.23887/janapati.v4i2.9775
Wong, A. S. C., Lee, J. Y. V., Mosikon, J., Willibrord, O., & Olaybal, D. (2022). Online writing assessment in the wake of covid-19: insights from the digital classroom. Malaysian Journal of ELT Research, 79–96. https://doi.org/10.52696/UZYV6342
Yunita, L., Nurjayadi, M., & Hariwibowo, H. (2021). Developing the Computer-Based Test (CBT) on the basic chemistry throughout a web-based application. Journal of Physics: Conference Series, 1869(1), 012026. https://doi.org/10.1088/1742-6596/1869/1/012026
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Andi Harpeni Dewantara, Muh. Syahrul Sarea
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
