Item Analysis of a Physics Technological Literacy Test on Work and Energy
DOI:
https://doi.org/10.65046/msn.v8i1.41Keywords:
Technological Literacy, Physics Education, Work and Energy, Test Instrument DevelopmentAbstract
This study aimed to develop and analyze a physics technological literacy test instrument on the topic of work and energy for senior high school students. This study addresses the limited availability of technological literacy assessment instruments specifically designed for the topic of work and energy in physics education. The research used a Research and Development (R&D) approach with the ADDIE development model, consisting of analysis, design, development, implementation, and evaluation stages. The instrument was developed based on three dimensions of technological literacy: knowledge, capabilities, and critical thinking and decision making. The study involved 200 students from several senior high schools in Binjai City, Indonesia. Data were analyzed using validity, reliability, and Rasch model analyses to evaluate the quality of the instrument. The results showed that the instrument was highly feasible, with evaluation expert validation of 92,13% and material expert validation of 90,4%. Practicality testing also indicated that the instrument was practical and easy to use. All items were categorized as valid and reliable, with a Cronbach’s Alpha coefficient of 0.935. The Rasch analysis demonstrated that the instrument could accurately measure students’ technological literacy abilities across various ability levels. The findings indicate that the developed instrument is valid, reliable, practical, and effective for measuring students’ technological literacy in physics learning, and it can serve as an assessment tool for teachers to evaluate and improve students’ technological literacy skills.
References
Arends, Richard I. 2012. Learning to Teach. New York: McGraw-Hil.
Aswar, Nurul Fadilah, M Ikhwan Maulana Haeruddin, and Ilma Wulansari Hasdiansa. 2023. “Pengaruh Inovasi Dan Entrepreneurial Orientation Terhadap Keunggulan Bersaing UMKM Di Kota Makasar.” Jurnal Ilmiah Bisnis & Kewirausahaan 12 (1): 61–68.
Avsec, Stanislav, and Janez Jamšek. 2015. “Technological Literacy for Students Aged 6–18: A New Method for Holistic Measuring of Knowledge, Capabilities, Critical Thinking and Decision-Making.” International Journal of Technology and Design Education 26 (1): 43–60. https://doi.org/10.1007/s10798-015-9299-y.
Avsec, Stanislav, and Slavko Kocijancic. 2014. “The Effect of The Use of an Inquiry-Based Approach in an Open Learning Middle School Hydraulic Turbine Optimisation Course.” World Transactions on Engineering and Technology Education 12 (3): 329–37.
Baharum, Hafidza, Aniza Ismail, Zainudin Awang, Lisa McKenna, Roszita Ibrahim, Zainah Mohamed, and Nor Haty Hassan. 2023. “The Study Adapted Instruments Based on Confirmatory Factor Analysis (CFA) to Validate Measurement Models of Latent Constructs.” International Journal of Environmental Research and Public Health 20 (4): 2860.
Bahri, Syamsul, Mitra Rahayu, Desy Kumala Sari, and Merta Simbolon. 2020. “Analysis of Iinformation and Communication Technology Literacy Capabilities to The High School Physics Teacher in Merauke.” Gravity : Jurnal Ilmiah Penelitian Dan Pembelajaran Fisika 6 (1): 47–53. https://doi.org/10.30870/gravity.v6i1.6365.
Bao, Lei, and Kathleen Koenig. 2019. “Physics Education Research for 21st Century Learning.” Disciplinary and Interdisciplinary Science Education Research 1 (1): 1–12. https://doi.org/10.1186/s43031-019-0007-8.
Begen, Nazire, and Hilal Atasoy. 2024. “Technological Literacy and Employment: An Inquiry into the Adoption of Learning Technologies.” Telecommunications Policy 48 (10): 1–23. https://doi.org/10.1016/j.telpol.2024.102864.
Branch, Robert Maribe. 2009. Instructional Design: The ADDIE Approach. New York: Springer.
Davies, Randall S. 2011. “Understanding Technology Literacy: A Framework for Evaluating Educational Technology Integration.” TechTrends 44: 45–52.
Dewey, John. 1933. How We Think. Boston: D.C. Health.
Fahrurrozi, Muh, and Siti Nur Laili Rahmawati. 2021. “Pengembangan Model Instrumen Evaluasi Menggunakan Aplikasi Kahoot Pada Pembelajaran Ekonomi.” Jurnal PROFIT Kajian Pendidikan Ekonomi Dan Ilmu Ekonomi 8 (1): 1–10. https://doi.org/10.36706/jp.v8i1.13090.
Farhodovna, Atoeva Mehriniso, Arabov Jasur Olimboevich, and Kobilov Bakhtiyor Badriddinovich. 2020. “Innovative Pedogogical Technologies For Training The Course Of Physics.” The American Journal of Interdisciplinary Innovations and Research 2 (12): 82–91. https://doi.org/10.37547/tajiir/volume02issue12-12.
Gani, Abdul Rafid Fakhrun, and Sabani. 2024. “Analisis Kebutuhan Penilaian Berbasis Literasi Teknologi Pada Materi Fluida.” Jurnal Pendidikan MIPA 14 (1): 276–81.
Gu, Jianjun, Meidan Xu, and Jonchao Hong. 2019. “Development and Validation of a Technological Literacy Survey.” International Journal of Science and Mathematics Education 17 (1): S109–24. https://doi.org/10.1007/s10763-019-09971-6.
Güvendir, Meltem Acar, and Yeşim Özer Özkan. 2022. “Item Removal Strategies Conducted in Exploratory Factor Analysis: A Comparative Study.” International Journal of Assessment Tools in Education 9 (1): 165–80.
Hamidah, Miske Hayunia, and Siti Sri Wulandari. 2021. “Pengembangan Instrumen Penilaian Berbasis Hots Menggunakan Aplikasi ‘Quizizz.’” Efisiensi : Kajian Ilmu Administrasi 18 (1): 105–24. https://doi.org/10.21831/efisiensi.v18i1.36997.
Heywood, John. 2023. “Lessons for Education, Engineering and Technological Literacy from the Experience of Britain’s Vaccine Task Force (VTF).” In ASEE Annual Conference and Exposition, Conference Proceedings. https://doi.org/10.18260/1-2--43418.
ITEA. 2007. Standards for Technological Literacy: Content for the Study of Technology. Reston: International Technology Education Association.
Korkeaniemi, Arttu, Eila Lindfors, and Leena Kiviranta. 2025. “Teaching Technology to Young Learners: Teachers’ Individual Competencies.” International Journal of Technology and Design Education, 1–21. https://doi.org/10.1007/s10798-025-09973-2.
Kumar, Vishal, Sanjiv Kumar Choudhary, and Rajni Singh. 2024. “Environmental Socio-Scientific Issues as Contexts in Developing Scientific Literacy in Science Education: A Systematic Literature Review.” Social Sciences and Humanities Open 9 (December 2023): 100765. https://doi.org/10.1016/j.ssaho.2023.100765.
Leedy, Paul D, and Jeanne Ellis Ormrod. 2015. Practical Research. Pearson Education Limited.
Lestari, Weni, Indah Wigati, Moh Ismail Sholeh, and Desi Pramita. 2022. “Instrumen Literasi Digital Guru Menggunakan Model Rasch.” Orbital: Jurnal Pendidikan Kimia 6 (2): 104–13.
Maulana, Slamet, Ani Rusilowati, Sunyoto Eko Nugroho, and Endang Susilaningsih. 2023. “Implementasi Rasch Model Dalam Pengembangan Instrumen Tes Diagnostik.” In Prosiding Seminar Nasional Pascasarjana, 6:748–57.
Nikat, Rikardus Feribertus. 2020. “Analisis Kemampuan Literasi Teknologi Calon Guru Fisika Melalui Online Formative Assessment.” Quantum: Jurnal Inovasi Pendidikan Sains 11 (2): 112–22. https://doi.org/10.20527/quantum.v11i2.8739.
Nuraeni, Rini, Petrus Jacob Pattiasina, and Anisah Ulfah. 2022. “Peran Literasi Teknologi Dalam Dunia Pendidikan.” Al-Madrasah: Jurnal Pendidikan Madrasah Ibtidaiyah 6 (3): 659–66. https://doi.org/10.35931/am.v6i3.1045.
Ocy, Dwi Rismi, Wardani Rahayu, and Makmuri Makmuri. 2023. “Rasch Model Analysis: Development of Hots-Based Mathematical Abstraction Ability Instrument According to Riau Islands Culture.” AKSIOMA: Jurnal Program Studi Pendidikan Matematika 12 (4): 3542–60.
Okpatrioka. 2023. “Research and Development (R&D) Penelitian Yang Inovatif Dalam Pendidikan.” Dharma Acariya Nusantara: Jurnal Pendidikan, Bahasa Dan Budaya 1 (1): 86–100.
Pearson, Greg, and Elsa Garmire. 2006. Tech Tally: Approaches to Assessing Technological Literacy. National Academies Press.
Ramdhan, Muhammad. 2021. Metode Penelitian. Jakarta: Cipta Media Nusantara.
Rupnik, Denis, and Stanislav Avsec. 2020. “Effects of a Transdisciplinary Educational Approach on Students’ Technological Literacy.” Journal of Baltic Science Education 19 (1): 121–41. https://doi.org/10.33225/jbse/20.19.121.
Salsabila, Fadiya, Juntika Nurihsan, and Yaya Sunarya. 2023. “Pengujian Validitas Dan Reliabilitas Instrumen Manajemen Diri Remaja: Rasch Model Analysis.” Jurnal Bimbingan Dan Konseling Terapan 7 (1): 15.
Sani, Ridwan Abdullah. 2022. Metodologi Penelitian Pendidikan. Jakarta: Kencana.
Santyadiputra, Gede Saindra, and Djoko Kustono. 2023. “Prinsip-Prinsip Pembelajaran Menuju Peningkatan Kemampuan Literasi Teknologi : Sebuah Kajian Literatur.” Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika 12 (1): 1–6.
Tan, Oon Seng. 2003. Problem-Based Learning Innovation: Using Problems to Power Learning in the 21st Century. Gale Cengage Learning.
Tarigan, Elsa Febrina, Suriati Nilmarito, Khairani Islamiyah, Ayi Darmana, and Retno Dwi Suyanti. 2022. “Analisis Instrumen Tes Menggunakan Rasch Model Dan Software SPSS 22.0.” Jurnal Inovasi Pendidikan Kimia 16 (2): 92–96.
Ummah, Khoerul, Julia Mardhiya, and Sri Mulyanti. 2022. “Pengembangan Instrumen Tes Penguasaan Konsep Representasi Kimia Pada Lima Indikator Asam Basa Dari Alam: Analisis Dengan Rasch Model.” Jurnal Tarbiyah 29 (2): 212–25.
Whitman, Lawrence E., Mandy C. Phelps, Karen V. Reynolds, and Barbara S. Chaparro. 2012. “Assessing Technological Literacy of Middle School Students.” ASEE Annual Conference and Exposition, Conference Proceedings. https://doi.org/10.18260/1-2--20976.
Zam, Embung Megasari. 2021. “Peran Literasi Teknologi Informasi Dan Komunikasi Pada Pembelajaran Jarak Jauh Di Masa Pandemi Covid-19.” EDUTECH : Jurnal Inovasi Pendidikan Berbantuan Teknologi 1 (1): 9–18.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Al-Musannif
This work is licensed under a Creative Commons Attribution 4.0 International License.
