- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution-ShareAlike 4.0 International License that allows others to share the work with an acknowledgement of the works authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journals published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
The Effectiveness of the CIPP Evaluation Model in Science Learning in the Era of the Industrial Revolution 4.0
DOI:
https://doi.org/10.31004/obsesi.v8i6.6227Keywords:
Evaluation, CIPP Model, Science Learning, Meta-analysisAbstract
This study aims to determine the effectiveness of the CIPP model in evaluating science learning in students in the 4.0 revolution era. This research is a type of quantitative research with a meta-analysis approach. The inclusion criteria in this study are 1) the research was published in 2022-2024; 2) research must be indexed by the Science Technology Index (SINTA) or Scopus; 3) research was obtained through the Google Scholar, Mendeley, and ERIC databases; 4) The research must be relevant and report complete data to calculate the effect size value—data analysis through statistical analysis with the help of JSAP applications. The analysis results of 20 publications obtained a summary effect size value ( d = 0.861; p < 0.001). Effect size is included in the category of very high effect size. These findings conclude that using the CIPP model has a positive effect on the evaluation of science learning in students compared to other evaluation models. No publication bias was found in this meta-analysis study, so it can be scientifically accounted for.
Downloads
References
Abdullah, A., Wijayanti, A., Suryono, W., Ika, M., Sarnoto, A. Z., Hiola, S. F., Ruchiat, A., Sari, W. D., & Santosa, T. A. (2024). Qualitative Study : Comparison of Implementation of The Effectiveness of the Ethno-Religious-Based SAVI Model in Improving Problem-Solving Skills in PAI Learning. Jurnal Obsesi: Jurnal Pendidikan Anak Usia Dini, 8(5), 1245–1256. https://doi.org/10.31004/obsesi.v8i5.6192
Adedokun-Shittu, N. A., & Shittu, A. J. K. (2013). ICT impact Assessment Model: An Extension of the CIPP and the Kirkpatrick Models. International HETL Review, 3(12), 1–18.
Adnan, G., Zulfikar, T., Armia, M. S., Gade, S., & Walidin, W. (2021). Impacts of inquiry learning model on students’ cognitive and critical thinking ability. Cypriot Journal of Educational Sciences, 16(3), 1290–1299. https://doi.org/10.18844/CJES.V16I3.5851
Agustina, N. Q., & Mukhtaruddin, F. (2019). The Cipp Model-Based Evaluation on Integrated English Learning (IEL) Program at Language Center. English Language Teaching Educational Journal, 2(1), 22. https://doi.org/10.12928/eltej.v2i1.1043
Ali, M., Nurhayati, R., Wantu, H. M., Amri, M., & Santosa, T. A. (2024). The Effectiveness of Jigsaw Model Based on Flipped Classroom to Improve Students ’ Critical Thinking Ability in Islamic Religious Education Learning. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 8(5), 1069–1078. https://doi.org/10.31004/obsesi.v8i5.6190
Asnur, L., Jalinus, N., Faridah, A., Apra, T., Ambiyar, R. D., & Utami, F. (2024). Video-blogs ( Vlogs ) -based Project : A Meta Analysis. 14(5), 1553–1557.
Aziz, S., Mahmood, M., & Rehman, Z. (2018). Implementation of CIPP Model for Quality Evaluation at School Level: A Case Study. Journal of Education and Educational Development, 5(1), 189. https://doi.org/10.22555/joeed.v5i1.1553
Badawi et al. (2023). Integration of Blended Learning and Project-Based Learning (BPjBL) on Achievement of Students’ learning goals: A Meta-analysis study. Pegem Journal of Education and Instruction, 13(4). https://doi.org/10.47750/pegegog.13.04.32
Basaran, M., Dursun, B., Gur Dortok, H. D., & Yilmaz, G. (2021). Evaluation of Preschool Education Program According to CIPP Model. Pedagogical Research, 6(2), em0091. https://doi.org/10.29333/pr/9701
Bilan, N., Negahdari, R., Hazrati, H., & Moghaddam, S. F. (2021). Examining the quality of the competency-based evaluation program for dentistry based on the cipp model: A mixed-method study. Journal of Dental Research, Dental Clinics, Dental Prospects, 15(3), 203–210. https://doi.org/10.34172/JODDD.2021.034
Borenstein, M., Hedges, L., & Rothstein, H. (2007). Introduction to Meta-Analysis. www.Meta-Analysis.com
Chen, W., & Ruannakarn, P. (2024). Based on the CIPP Theory Perspective: The Application of Information Technology Integration in Physical Education Course Evaluation - A Case Study of Software Engineering Institute of Guangzhou. Higher Education Studies, 14(2), 44. https://doi.org/10.5539/hes.v14n2p44
Darma, I. K. (2019). The effectiveness of teaching program of CIPP evaluation model. International Research Journal of Engineering, IT & Scientific Research, 5(3), 1–13. https://doi.org/10.21744/irjeis.v5n3.619
Divayana, D. G. H., Sanjaya, D. B., Marhaeni, A. A. I. N., & Sudirtha, I. G. (2017). CIPP evaluation model based on mobile phone in evaluating the use of blended learning platforms at vocational schools in bali. Journal of Theoretical and Applied Information Technology, 95(9), 1983–1995.
Dzo’ul Milal, A., Rohmah, Z., Kusumajanti, W., Basthomi, Y., Sholihah, D. N., & Susilowati, M. (2020). Integrating character education in the english teaching at islamic junior high schools in Indonesia. Teflin Journal, 31(1), 88–107. https://doi.org/10.15639/teflinjournal.v31i1/88-107
Ekiz, M. A. (2022). Evaluation of Teaching Practice Course According to The Opinions of Teaching Staff, Practice Teachers and Pre-Service Teachers. Education Quarterly Reviews, 5(2). https://doi.org/10.31014/aior.1993.05.02.512
Görkem Erdogan, & Mede, E. (2021). The Evaluation of an English Preparatory Program Using CIPP Model and Exploring A1 Level Students’ Motivational Beliefs. Journal of Education and Educational Development, 8(1), 53–76. https://doi.org/10.22555/joeed.v8i1.109
Harding, L. (2012). Pronunciation Assessment. The Encyclopedia of Applied Linguistics, 15(4), 57–84. https://doi.org/10.1002/9781405198431.wbeal0966
Ichsan, I., Suharyat, Y., Santosa, T. A., & Satria, E. (2023). Effectiveness of STEM-Based Learning in Teaching 21 st Century Skills in Generation Z Student in Science Learning: A Meta-Analysis. Jurnal Penelitian Pendidikan IPA, 9(1), 150–166. https://doi.org/10.29303/jppipa.v9i1.2517
Iqbal, Z., Khan, R., & Wadood, A. (2022). Evaluation of the Effectiveness of the Process of Undergraduate Health and Physical Education Program by the CIPP Model. Global Educational Studies Review, VII(II), 285–295. https://doi.org/10.31703/gesr.2022(vii-ii).27
Kahraman, E. (2023). Bibliometric and content analysis of meta-analysis studies in the field of STEM education. International Journal of Modern Education Studies, 7(2), 511–544. https://doi.org/10.51383/ijonmes.2023.337
Kang, K. (2020). Analysis of the Effectiveness of the University Convergence Curriculum using the CIPP model. Journal of the Korea Convergence Society, 11(9), 135–142.
Keskin, I., & Yazar, T. (2020). Evaluation of the curriculum of high school mathematics according to CIPP model. Bulletin of Education and Research, 42(3), 183–214. http://pu.edu.pk/images/journal/ier/PDF-FILES/10_42_3_20.pdf
Khaksar, M., Kiany, G. R., & ShayesteFar, P. (2023). Using a CIPP-Based Model for Evaluation of Teacher Training Programs in a Private-sector EFL Institutes. Language Teaching Research Quarterly, 38, 65–91. https://doi.org/10.32038/ltrq.2023.38.04
Khalid, M., Saad, S., Abdul Hamid, S. R., Ridhuan Abdullah, M., Ibrahim, H., & Shahrill, M. (2020). Enhancing creativity and problem solving skills through creative problem solving in teaching mathematics. Creativity Studies, 13(2), 270–291. https://doi.org/10.3846/cs.2020.11027
Li, Y., & Hu, C. (2022). The Evaluation Index System of Teaching Quality in Colleges and Universities: Based on the CIPP Model. Mathematical Problems in Engineering, 2022. https://doi.org/10.1155/2022/3694744
Noh, M. A. C., Tamuri, A. H., Razak, K. A., & Suhid, A. (2014). The study of quranic teaching and learning: United Kingdom experience. Mediterranean Journal of Social Sciences, 5(16), 313–317. https://doi.org/10.5901/mjss.2014.v5n16p313
Nurhayati, R., Aw, S., Dwiningrum, S. I. A., Hajaroh, M., & Herwin, H. (2024). Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis. International Journal of Educational Methodology, volume-10-(volume-10-issue-1-february-2024), 165–177. https://doi.org/10.12973/ijem.10.1.965
Oflaz, M., Coşkun, Y. D., & Bolat, Ö. (2022). The effects of the technology-integrated writing lessons: CIPP model of evaluation. Turkish Online Journal of Educational Technology - TOJET, 21(1), 157–179. https://orcid.org/0000-0002-5133-6482,
Ofosu-Ampong, K. (2020). The Shift to Gamification in Education: A Review on Dominant Issues. Journal of Educational Technology Systems, 49(1), 113–137. https://doi.org/10.1177/0047239520917629
Putro, H. Y. S., Babiera, R. M., Takwin, M., Rachman, A., & Ariliani, T. (2024). Evaluating the Impact of the Inspiring School Program in High Schools. International Journal of Asian Education, 5(1), 34–42. https://doi.org/10.46966/ijae.v5i1.373
Ratnaya, G., Indriaswuri, R., Widayanthi, D. G. C., Atmaja, I. M. P. D., & Dalem, A. A. G. P. K. P. (2022). CIPP Evaluation Model for Vocational Education: A Critical Review. Education Quarterly Reviews, 5(3), 1–8. https://doi.org/10.31014/aior.1993.05.03.519
Rezaee, R., & Shokrpour, N. (2011). Performance assessment of academic departments: CIPP model. European Journal of Social Sciences, 23(2), 227–236.
Santiyadnya, N. (2021). The effectiveness of CIPP model’s implementation in secondary school. Journal of Physics: Conference Series, 1810(1). https://doi.org/10.1088/1742-6596/1810/1/012071
Setiawan, M. A., Sari, N. P., Makaria, E. C., Dinanty, N. S., & Rahman, G. (2024). Enhancing Quality of Guidance and Counseling in Vocational Schools: Testing the Effectiveness of Evaluation Instruments Based on the CIPP Model. Paedagogia, 27(1), 73. https://doi.org/10.20961/paedagogia.v27i1.84673
Sopha, S., & Nanni, A. (2019). The cipp model: Applications in language program evaluation. Journal of Asia TEFL, 16(4), 1360–1367. https://doi.org/10.18823/asiatefl.2019.16.4.19.1360
Tamur, M., Juandi, D., & Kusumah, Y. S. (2020). The effectiveness of the application of mathematical software in indonesia; a meta-analysis study. International Journal of Instruction, 13(4), 867–884. https://doi.org/10.29333/iji.2020.13453a
Wantu, H. M., Muis, A., Zain, A., Hiola, S. F., Agustina, I., Santosa, T. A., Yastanti, U., & Nugraha, A. R. (2024). Effectiveness of Think-Pair-Share and STEM Models on Critical Thinking in Early Childhood Education. Jurnal Obsesi: Jurnal Pendidikan Anak Usia Dini, 8(5), 1320–1330. https://doi.org/10.31004/obsesi.v8i5.6202
Youna Chatrine Bachtiar, Mohammad Edy Nurtamam, Tomi Apra Santosa, Unan Yasmaniar Oktiawati, & Abdul Rahman. (2023). the Effect of Problem Based Learning Model Based on React Approach on Students’ 21St Century Skills: Meta-Analysis. International Journal of Educational Review, Law And Social Sciences (IJERLAS), 3(5), 1576–1589. https://doi.org/10.54443/ijerlas.v3i5.1047
Zulfadhli, M., & Kamarudin, B. I. N. (2024). Digital Inquiry-Based Science Learning In Rural Primary School.
Zulkifli, Z., Satria, E., Supriyadi, A., & Santosa, T. A. (2022). Meta-analysis: The effectiveness of the integrated STEM technology pedagogical content knowledge learning model on the 21st century skills of high school students in the science department. Psychology, Evaluation, and Technology in Educational Research, 5(1), 32–42. https://doi.org/10.33292/petier.v5i1.144