An Analysis of Respiratory System Test Subjects: A Complete and Structured Guide
DOI:
https://doi.org/10.25217/ji.v10i2.6182Keywords:
Validity, Reliability, Level of Difficulty, Distinguishing Power, Quality of CheckersAbstract
This study aims to evaluate the quality of 20 biology summative assessment items on respiratory system material for class XII in nine high schools spread across Sumatra and Sulawesi during the odd semester of the 2024/2025 academic year. The research subjects involved 130 students, and data were collected through Google Form. The analysis was conducted using Anates software version 4.0.9, including the validity, reliability, difficulty level, differentiating power, and quality of item triggers. The results showed that 75% of the questions had good validity, while the other 25% required revision. The reliability value of 0.82 indicates high consistency. Most of the questions had a moderate level of difficulty (75%), while some questions needed to be adjusted to reach the ideal proportion. In terms of differentiating power, the majority of questions were able to differentiate between high and low ability learners effectively, although some questions required improvement. Excerpts analysis showed that most of the options functioned well, but the less effective exterminators needed revision. This study concludes that the items have good overall quality, but still require some improvement to increase accuracy and effectiveness as an evaluation instrument for biology learning.
References
Acosta-Banda, A., Aguilar-Esteva, V., Ortiz, M. P., & Ortiz, J. P. (2021). Construction and validity of an instrument to evaluate renewable energies and energy sustainability perceptions for social consciousness. Sustainability (Switzerland), 13(4), 1–13. https://doi.org/10.3390/su13042333
Aginako, Z., Peña-Lang, M. B., Bedialauneta, M. T., & Guraya, T. (2021). Analysis of the validity and reliability of a questionnaire to measure students’ perception of inclusion of sustainability in engineering degrees. International Journal of Sustainability in Higher Education, 22(6), 1402–1420. https://doi.org/10.1108/IJSHE-09-2020-0355
Aji Saputra, M. R., & Sayono, J. (2022). Analisis Butir Soal Ujian Mapel Sejarah (Peminatan) Kelas Xii Di Man Sumenep Tahun Ajaran 2021/2022. Jurnal Pendidikan Sejarah Indonesia, 5(2), 171. https://doi.org/10.17977/um0330v5i2p171-190
Aliman, M. (2020). Pengembangan Instrumen Tes Kemampuan Berpikir Spasial Bagi Siswa SMA. Geodika: Jurnal Kajian Ilmu Dan Pendidikan Geografi, 4(1), 1–10. https://doi.org/10.29408/geodika.v4i1.1823
Angriani, A. D., Mania, S., Alam, S., Rasyid, M. R., & Kusumayanti, A. (2021). Analisis Soal Ujian Akhir Semester Matematika SMP. Alauddin Journal of Mathematics Education, 3(1), 1. https://doi.org/10.24252/ajme.v3i1.20071
Azizah, Z. N., & Budijastuti, W. (2021). Pengembangan Instrumen Penilaian Untuk Mengukur Keterampilan Literasi Sains Pada Submateri Sistem Peredaran Darah Manusia. Berkala Ilmiah Pendidikan Biologi (Bioedu), 11(1), 89–97. https://doi.org/10.26740/bioedu.v11n1.p89-97
Beck, K. (2020). Ensuring content validity of psychological and educational tests – The role of experts. Frontline Learning Research, 8(6), 1–37. https://doi.org/10.14786/flr.v8i6.517
Brown, N., & Doshi, M. (2006). Assessing professional and clinical competence: The way forward. Advances in Psychiatric Treatment, 12(2), 81–89. https://doi.org/10.1192/apt.12.2.81
Cravens, M. D. (2020). Measuring the strength of voter turnout habits. Electoral Studies, 64. https://doi.org/10.1016/j.electstud.2020.102117
Czahajda, R., & Černko, M. (2021). Perceived Session Quality Scale: What contributes to the quality of synchronous online education? International Journal of Training and Development, 25(3), 217–243. https://doi.org/10.1111/ijtd.12216
Dahlan, J. A., & Wibisono, Y. (2017). Design and Development Computer-Based E-Learning Teaching Material for Improving Mathematical Understanding Ability and Spatial Sense of Junior High School Students. Journal of Physics: Conference Series, 812(1). https://doi.org/10.1088/1742-6596/812/1/012098
Doğan, F., & Yücel-Toy, B. (2020). Development of an attitude scale towards asking questions for elementary education students. Elementary Education Online, 19(4), 2237–2248. https://doi.org/10.17051/ilkonline.2020.764049
Efendi, R., Afifa, N. Z., & Wulandari, R. A. (2021). Needs Analysis of Web-Based Performance Asessment of Network Administration Learning to Improve HOTS Competence. Journal of Physics: Conference Series, 1764(1). https://doi.org/10.1088/1742-6596/1764/1/012097
Evens, R. P., Littlefield, J. H., & Shahan, D. (1984). The reliability and utility of clinical competency assessments for drug monograph preparation by pharmacy students. Drug Intelligence and Clinical Pharmacy, 18(3), 247–252. https://doi.org/10.1177/106002808401800315
Fietri, W. A. (2021). Analisis Butir Soal Biologi Kelas VIII Madrasah Tsanawiyah Negeri 6 Kerinci Menggunakan Program Komputer Anates 4.0 For Windows. Jurnal Pendidikan Biologi Undiksha, 8(2), 50–60.
Fiska, J. M., Hidayati, Y., Qomaria, N., & Hadi, W. P. (2021). Analisis butir soal ulangan harian ipa menggunakan software anates pada pendekatan teori tes klasik. Natural Science Education Research, 4(1), 65–76. https://doi.org/10.21107/nser.v4i1.8133
Fitriani, N. (2021). Analisis tingkat kesukaran, daya pembeda, dan efektivitas pengecoh soal pelatihan kewaspadaan kegawatdaruratan maternal dan neonatal. Paedagoria : Jurnal Kajian, Penelitian Dan Pengembangan Kependidikan, 12(2), 199. https://doi.org/10.31764/paedagoria.v12i2.4956
Guarino, J. C., Ferguson, J. R., & Pakala, K. C. V. (2013). Quantitative asessment of program outcomes using longitudinal data from the FE exam. ASEE Annual Conference and Exposition, Conference Proceedings. https://www.scopus.com/inward/record.uri?eid=2-s2.0-84884311621&partnerID=40&md5=4ef76ecf637e0af11e914f53538a45eb
Hamimi, L., Zamharirah, R., & Rusydy, R. (2020). Analisis Butir Soal Ujian Matematika Kelas VII Semester Ganjil Tahun Pelajaran 2017/2018. Mathema: Jurnal Pendidikan Matematika, 2(1), 57. https://doi.org/10.33365/jm.v2i1.459
Hammahlund, E. R., Ostrom, J. R., & Kethley, A. J. (1985). The effects of drug counseling and other educational strategies on drug utilization of the elderly. Medical Care, 23(2), 165–170. https://doi.org/10.1097/00005650-198502000-00007
Harčár, I., Choma, L., Antoško, M., Jevčák, J., & Fábry, Ľ. (2020). Asessment of technical research problem of letvis training center’s communication interface. International Multidisciplinary Scientific GeoConference Surveying Geology and Mining Ecology Management, SGEM, 2020-August(2.1), 67–72. https://doi.org/10.5593/sgem2020/2.1/s07.009
Herayanti, L., Widodo, W., Susantini, E., & Gunawan, G. (2020). The effectiveness of blended learning model based on inquiry collaborative tutorial toward students’ problem-solving skills in physics. Journal for the Education of Gifted Young Scientists, 8(3), 959–972. https://doi.org/10.17478/JEGYS.675819
Hidayah, N., & Hitipeuw, I. (2020). Development study of academic resilience scale for gifted young scientists education. Journal for the Education of Gifted Young Scientists, 8(1), 342–358. https://doi.org/10.17478/jegys.664116
Hussmann, S., Covic, G., & Patel, N. (2004). Effective Teaching and Learning in Engineering Education using a Novel Web-based Tutorial and Assessment Tool for Advanced Electronics. International Journal of Engineering Education, 20(2), 161–169. https://www.scopus.com/inward/record.uri?eid=2-s2.0-1842782544&partnerID=40&md5=f4d653336d2363ba64327507a4f10e1d
Irwan, A. (2022). Pengembangan Instrumen Penilaian Kognitif Eksperimen Fisika Dasar I. Al-Khazini Jurnal Pendidikan Fisika, 2(2), 142–150. https://doi.org/10.24252/al-khazini.v2i2.31990
Iskandar, A., & Rizal, M. (2018). Analisis kualitas soal di perguruan tinggi berbasis aplikasi TAP. Jurnal Penelitian Dan Evaluasi Pendidikan, 22(1), 12–23. https://doi.org/10.21831/pep.v22i1.15609
Ismail Gani, Ilham Eryk Pratitis Robinson, Rheina Pu Tri Faylia, & Hendra Setyawan. (2022). Kualitas Empirik Soal Pilihan Ganda Pendidikan Jasmani Sekolah Dasar Di Yogyakarta. EDUKASIA: Jurnal Pendidikan Dan Pembelajaran, 3(2), 235–242. https://doi.org/10.62775/edukasia.v3i2.245
Jana, P. (2018). Analisis Kesalahan Mahasiswa Dalam Menyelesaikan Soal Matematika Pada Pokok Bahasan Vektor. Jurnal Mercumatika : Jurnal Penelitian Matematika Dan Pendidikan Matematika, 2(2), 8. https://doi.org/10.26486/jm.v2i2.398
Jeong, E., & Kim, J. (2020). The development of subjective checklist measuring change in global cognition. Audiology and Speech Research, 16(3), 254–263. https://doi.org/10.21848/asr.200043
Karl, J. A., Prado, S. M. M., Gračanin, A., Verhaeghen, P., Ramos, A., Mandal, S. P., Michalak, J., Zhang, C.-Q., Schmidt, C., Tran, U. S., Druica, E., Solem, S., Astani, A., Liu, X., Luciano, J. V, Tkalčić, M., Lilja, J. L., Dundas, I., Wong, S. Y. S., & Fischer, R. (2020). The Cross-cultural Validity of the Five-Facet Mindfulness Questionnaire Across 16 Countries. Mindfulness, 11(5), 1226–1237. https://doi.org/10.1007/s12671-020-01333-6
Khasanah, U., & Fitriyah, L. A. (2023). Analisis Kualitas Soal Kognitif Materi Sistem Pernapasan Manusia. Discovery : Jurnal Ilmu Pengetahuan, 8(2), 82–89. https://doi.org/10.33752/discovery.v8i2.5091
Kianersi, S., Luetke, M., Jules, R., & Rosenberg, M. (2020). The association between interviewer gender and responses to sensitive survey questions in a sample of Haitian women. International Journal of Social Research Methodology, 23(2), 229–239. https://doi.org/10.1080/13645579.2019.1661248
Komperda, R., Hosbein, K. N., Phillips, M. M., & Barbera, J. (2020). Investigation of evidence for the internal structure of a modified science motivation questionnaire II (mSMQ II): A failed attempt to improve instrument functioning across course, subject, and wording variants. Chemistry Education Research and Practice, 21(3), 893–907. https://doi.org/10.1039/d0rp00029a
Korkmaz, Ö., Çakır, R., & Erdoğmuş, F. U. (2020). Secondary school students’ basic stem skill levels according to their self-perceptions: A scale adaptation. Participatory Educational Research, 8(1), 423–437. https://doi.org/10.17275/per.21.25.8.1
Lee, Y.-H., Chou, Y.-T., & Sung, Y.-T. (2021). Development and Validation of a Diagnostic Assessment of Chinese Competence System. Bulletin of Educational Psychology, 53(2), 285–306. https://doi.org/10.6251/BEP.202112_53(2).0002
Lennox, N. G., Green, M., Diggens, J., & Ugoni, A. (2001). Audit and comprehensive health assessment programme in the primary healthcare of adults with intellectual disability: A pilot study. Journal of Intellectual Disability Research, 45(3), 226–232. https://doi.org/10.1046/j.1365-2788.2001.00303.x
Madsen, C. K., Smith, D. S., & Feeman, C. C. (1988). The use of music in cross-age tutoring within special education settings. Journal of Music Therapy, 25(3), 135–144. https://doi.org/10.1093/jmt/25.3.135
Mcguigan, M. R., Cormack, S., & Newton, R. U. (2009). Long-term power performance of elite Australian rules football players. Journal of Strength and Conditioning Research, 23(1), 26–32. https://doi.org/10.1519/JSC.0b013e31818753ca
Mudanta, K. A., Astawan, I. G., & Jayanta, I. N. L. (2020). Instrumen Penilaian Motivasi Belajar Dan Hasil Belajar IPA Siswa Kelas v Sekolah Dasar. Mimbar Ilmu, 25(2), 101. https://doi.org/10.23887/mi.v25i2.26611
Murphy, S. (2005). Partnerships expand the availability of ASTM training courses. Standardization News, 33(6), 24–25. https://www.scopus.com/inward/record.uri?eid=2-s2.0-21244438693&partnerID=40&md5=d416df59daf498650ff563ac0b77bfef
Muttaqin, M. Z., & Kusaeri, K. (2017). Pengembangan Instrumen Penilaian Tes Tertulis Bentuk Uraian Untuk Pembelajaran Pai Berbasis Masalah Materi Fiqh. Jurnal Tatsqif, 15(1), 1–23. https://doi.org/10.20414/j-tatsqif.v15i1.1154
Nadhifa, A. A., & Firdaus, E. F. (2023). Analisis Butir Soal Ujian Sekolah Matematika Tahun Pelajaran 2021/2022 Di Sma An-Nuriyyah Bumiayu Ditinjau Dari Kemampuan Pemecahan Masalah. Array. Jurnal Dialektika Program Studi Pendidikan Matematika, 10(1), 819–837.
Naqiyah, M., & Rosana, D. (2020). Developing instruments to measure physics problem solving ability and nationalism of high school student. International Journal of Instruction, 13(4), 921–936. https://doi.org/10.29333/iji.2020.13456a
Ndiung, S., & Jediut, M. (2020). Pengembangan instrumen tes hasil belajar matematika peserta didik sekolah dasar berorientasi pada berpikir tingkat tinggi. Premiere Educandum : Jurnal Pendidikan Dasar Dan Pembelajaran, 10(1), 94. https://doi.org/10.25273/pe.v10i1.6274
Nurhalimah, S., Hidayati, Y., Rosidi, I., & Hadi, W. P. (2022). Hubungan Antara Validitas Item Dengan Daya Pembeda Dan Tingkat Kesukaran Soal Pilihan Ganda PAS. Natural Science Education Research, 4(3), 249–257. https://doi.org/10.21107/nser.v4i3.8682
Onuminya, J. E. (2004). The role of the traditional bonesetter in primary fracture care in Nigeria. South African Medical Journal, 94(8 I), 652–658. https://www.scopus.com/inward/record.uri?eid=2-s2.0-4444364270&partnerID=40&md5=7346e78664606e4bc796c06946422bf5
Pangesti, F., Fauzan, F., & Risnawati, R. (2020). Kualitas Butir Soal Try Out Uji Pengetahuan Dalam Memprediksi Tingkat Kelulusan Mahasiswa PPG. Jurnal Pendidikan Profesi Guru, 1(2), 91–98. https://doi.org/10.22219/jppg.v1i2.13503
Papadakis, S., Vaiopoulou, J., Kalogiannakis, M., & Stamovlasis, D. (2020). Developing and exploring an evaluation tool for educational apps (E.T.E.A.) targeting kindergarten children. Sustainability (Switzerland), 12(10). https://doi.org/10.3390/su12104201
Peter, N. I., Onuma, O. C., & Chinyere, S. J. (2020). Construction And Validation Of An Instrument For Evaluating Teaching Quality In Ogun State Secondary Schools, NIGERIA. International Journal of Educational Research, 7(1). https://www.scopus.com/inward/record.uri?eid=2-s2.0-85122399172&partnerID=40&md5=3915767722639820602d723191328462
Prihatiningtyas, S., Afifah, S. N., Wulandari, K., Putra, I. A., & Pertiwi, N. A. S. (2022). Validasi Instrumen Penilaian Kognitif Berbasis Google Sites Materi Dinamika Partikel. Jurnal IPA Terpadu, 6(3), 26. https://doi.org/10.35580/ipaterpadu.v6i3.37074
Purwanti, M. (2014). Analisis Butir Soal Ujian Akhir Mata Pelajaran Akuntansi Keuangan Menggunakan Microsoft Office Excel 2010. Jurnal Pendidikan Akuntansi Indonesia, 12(2). https://doi.org/10.21831/jpai.v12i2.2710
Putri, H. E., Wahyudy, M. A., Yuliyanto, A., & Nuraeni, F. (2020). Development of instruments to measure mathematical anxiety of elementary school students. International Journal of Learning, Teaching and Educational Research, 19(6), 282–302. https://doi.org/10.26803/IJLTER.19.6.17
Rafiey, H., Alipour, F., Lebeau, R., & Salimi, Y. (2020). Development and Validation of the Antisocial Traits Scale in the General Population. Criminal Justice and Behavior, 47(3), 369–380. https://doi.org/10.1177/0093854819892896
Rahayu, R., & Djazari, M. (2016). Analisis Kualitas Soal Pra Ujian Nasional Mata Pelajaran Ekonomi Akuntansi. Jurnal Pendidikan Akuntansi Indonesia, 14(1). https://doi.org/10.21831/jpai.v14i1.11370
Ramadhan, S., Sumiharsono, R., Mardapi, D., & Prasetyo, Z. K. (2020). The quality of test instruments constructed by teachers in bima regency, Indonesia: Document analysis. International Journal of Instruction, 13(2), 507–518. https://doi.org/10.29333/iji.2020.13235a
Razi, F. (2021). Konsep Dasar Evaluasi Pendidikan. https://doi.org/10.31219/osf.io/urkd2
Reyes-Fournier, E., Cumella, E. J., Blackman, G., March, M., & Pedersen, J. (2020). Development and validation of the online teaching effectiveness scale. Online Learning Journal, 24(2), 111–127. https://doi.org/10.24059/olj.v24i2.2071
Roberts, L. R. (2020). The validation of using assessment tools and a theory to mentor doctoral students with integrity and trustworthiness. International Journal of Doctoral Studies, 15, 29–56. https://doi.org/10.28945/4475
Rudibyani, R. B., Perdana, R., & Elisanti, E. (2020). Development of problem-solving-based knowledge assessment instrument in electrochemistry. International Journal of Instruction, 13(4), 957–974. https://doi.org/10.29333/iji.2020.13458a
Samsudin, A., Cahyani, P. B., Rusdiana, D., Efendi, R., Aminudin, A. H., & Coştu, B. (2021). Development of a multitier open-ended work and energy instrument (MOWEI) using Rasch analysis to identify students’ misconceptions. Cypriot Journal of Educational Sciences, 16(1), 16–31. https://doi.org/10.18844/cjes.v16i1.5504
Sellu, D. H., Davis, R. E., & Vincent, C. A. (2012). Assessment of blood administration competencies using objective structured clinical examination. Transfusion Medicine, 22(6), 409–417. https://doi.org/10.1111/j.1365-3148.2012.01192.x
Setiawan, J., Sudrajat, A., & Kumalasari, D. (2021). Development of higher order thinking skill assessment instruments in learning Indonesian history. International Journal of Evaluation and Research in Education, 10(2), 545–552. https://doi.org/10.11591/ijere.v10i2.20796
Shaban, S., Regmi, D., AlMahmoud, T., ElZubeir, M., Branicki, F., & Govender, R. (2020). Using an Enhancement-Focused Framework Model to Improve the Quality of High-Stakes Assessments. International Journal of Assessment and Evaluation, 27(1), 27–43. https://doi.org/10.18848/2327-7920/CGP/v27i01/27-43
Shahzad Ahmad, S. J. (2023). Development and Application of Structural Communication Grid Tests for Diagnosing Students’ Misconceptions in the Subj. JCTE, 4. https://doi.org/10.58444/jcte.v4i.212
Silverman, G. S., & Wally, M. K. (2016). Preparation of environmental studies and sciences students to participate in the environmental risk dialogue. Journal of Environmental Studies and Sciences, 6(3), 580–588. https://doi.org/10.1007/s13412-015-0331-z
Suhendi, H. Y., Ramdhani, M. A., & Irwansyah, F. S. (2018). Verification concept of assesment for physics education student learning outcome. International Journal of Engineering and Technology(UAE), 7(3.21 Special Issue 21), 321–325. https://doi.org/10.14419/ijet.v7i2.29.13646
Supiyansyah, H., Kusumah, I. H., & Berman, E. T. (2017). Analisis Kualitas Soal Ulangan Akhir Semester Genap pada Mata Pelajaran Produktif Program Keahlian Teknik Kendaraan Ringan. Journal of Mechanical Engineering Education, 4(1), 52. https://doi.org/10.17509/jmee.v4i1.7441
Suprapto, E., Saryanto, S., Sumiharsono, R., & Ramadhan, S. (2020). The Analysis of Instrument Quality to Measure the Students’ Higher Order Thinking Skill in Physics Learning. Journal of Turkish Science Education, 17(4), 520–527. https://doi.org/10.36681/tused.2020.42
Surjono, H. D., & Slamet, P. H. (2020). The effectiveness of the zipgrade-assisted learning outcomes assessment analysis in promoting Indonesian vocational teachers’ competence. International Journal of Innovation, Creativity and Change, 11(5), 701–719. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85086512302&partnerID=40&md5=c54d315e3317ec472d632b30d377bc1a
Toifur, I., & Setyowati, E. (2022). Analisis Butir Soal Simulasi Ujian Sekolah Mata Pelajaran Matematika SMA Negeri 1 Salaman. MATH LOCUS: Jurnal Riset Dan Inovasi Pendidikan Matematika, 3(1), 28–39. https://doi.org/10.31002/mathlocus.v3i1.2341
Tok, S. Y., Kaplan, I., & Taneli, Y. (2010). Photography in architectural education: A tool for assessing social aspects of the built environment. Procedia - Social and Behavioral Sciences, 2(2), 2583–2588. https://doi.org/10.1016/j.sbspro.2010.03.377
Tourangeau, R., Sun, H., & Yan, T. (2021). Comparing methods for assessing reliability. Journal of Survey Statistics and Methodology, 9(4), 651–673. https://doi.org/10.1093/jssam/smaa018
Utami, B., Saputro, S., & Masykuri, M. (2021). Performance asessment to measure students’ explanations in chemistry learning. Journal of Physics: Conference Series, 1842(1). https://doi.org/10.1088/1742-6596/1842/1/012028
Warju, W., Ariyanto, S. R., Soeryanto, S., & Trisna, R. A. (2020). Analisis Kualitas Butir Soal Tipe Hots Pada Kompetensi Sistem Rem Di Sekolah Menengah Kejuruan. Jurnal Pendidikan Teknologi Dan Kejuruan, 17(1), 95. https://doi.org/10.23887/jptk-undiksha.v17i1.22914
Wibawa, E. A. (2019). KARAKTERISTIK BUTIR SOAL TES UJIAN AKHIR SEMESTER HUKUM BISNIS. Jurnal Pendidikan Akuntansi Indonesia, 17(1), 86–96. https://doi.org/10.21831/jpai.v17i1.26339
Yang, H., Su, J., & Bradley, K. D. (2020). Applying the rasch model to evaluate the self-directed online learning scale (SDOLS) for graduate students. International Review of Research in Open and Distributed Learning, 21(3), 99–120. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85090928468&partnerID=40&md5=8a2af6a15d034cbb4a94b4df09bcbcc6
Yunita, L., & Bahriah, E. S. (2020). The development of asessment higher order thinking skills (HOTS) through online based application. Journal of Physics: Conference Series, 1511(1). https://doi.org/10.1088/1742-6596/1511/1/012035
Yusnaeni, Fransiska S. Herin Samon, Mario J. Santrum, & Sudirman. (2023). Analisis Kualitatif dan Kuantitatif Asesmen Sumatif Biologi SMA. Diklabio: Jurnal Pendidikan Dan Pembelajaran Biologi, 65–72. https://doi.org/10.33369/diklabio.7.1.65-72
YUSUF, F. W. (2024). Analisis butir soal asesmen sumatif biologi materi perubahan lingkungan dengan menggunakan anates pada kelas x sma. Learning : Jurnal Inovasi Penelitian Pendidikan Dan Pembelajaran, 4(1), 126–135. https://doi.org/10.51878/learning.v4i1.2777
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2025 Cici Nur Azizah, Ridwan Ridwan, Lia Zaradiva, Diki Koerniadi, Sunarto Arif Sura
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
