The Effectiveness of the CIPP Evaluation Model in Science Learning in the Era of the Industrial Revolution 4.0

Authors

  • Fitri Hilmiyati Universitas Sultan Maulana Hasanudin Banten, Indonesia
  • Tongam E Panggabean Universitas Budi Darma, Indonesia
  • Riza Noviana Khoirunnisa Universitas Negeri Surabaya, Indonesia
  • Dewanto Dewanto Universitas Negeri Surabaya, Indonesia
  • Muhammad Sapril Siregar Politeknik Pelayaran Malahayati, Indonesia
  • Tomi Apra Santosa Akademi Teknik Adikarya, Indonesia

DOI:

https://doi.org/10.31004/obsesi.v8i6.6227

Keywords:

Evaluation, CIPP Model, Science Learning, Meta-analysis

Abstract

This study aims to determine the effectiveness of the CIPP model in evaluating science learning in students in the 4.0 revolution era. This research is a type of quantitative research with a meta-analysis approach. The inclusion criteria in this study are 1) the research was published in 2022-2024; 2) research must be indexed by the Science Technology Index (SINTA) or Scopus; 3) research was obtained through the Google Scholar, Mendeley, and ERIC databases; 4) The research must be relevant and report complete data to calculate the effect size value—data analysis through statistical analysis with the help of JSAP applications. The analysis results of 20 publications obtained a summary effect size value ( d = 0.861; p < 0.001). Effect size is included in the category of very high effect size.  These findings conclude that using the CIPP model has a positive effect on the evaluation of science learning in students compared to other evaluation models. No publication bias was found in this meta-analysis study, so it can be scientifically accounted for.

Downloads

Download data is not yet available.

References

Abdullah, A., Wijayanti, A., Suryono, W., Ika, M., Sarnoto, A. Z., Hiola, S. F., Ruchiat, A., Sari, W. D., & Santosa, T. A. (2024). Qualitative Study : Comparison of Implementation of The Effectiveness of the Ethno-Religious-Based SAVI Model in Improving Problem-Solving Skills in PAI Learning. Jurnal Obsesi: Jurnal Pendidikan Anak Usia Dini, 8(5), 1245–1256. https://doi.org/10.31004/obsesi.v8i5.6192

Adedokun-Shittu, N. A., & Shittu, A. J. K. (2013). ICT impact Assessment Model: An Extension of the CIPP and the Kirkpatrick Models. International HETL Review, 3(12), 1–18.

Adnan, G., Zulfikar, T., Armia, M. S., Gade, S., & Walidin, W. (2021). Impacts of inquiry learning model on students’ cognitive and critical thinking ability. Cypriot Journal of Educational Sciences, 16(3), 1290–1299. https://doi.org/10.18844/CJES.V16I3.5851

Agustina, N. Q., & Mukhtaruddin, F. (2019). The Cipp Model-Based Evaluation on Integrated English Learning (IEL) Program at Language Center. English Language Teaching Educational Journal, 2(1), 22. https://doi.org/10.12928/eltej.v2i1.1043

Ali, M., Nurhayati, R., Wantu, H. M., Amri, M., & Santosa, T. A. (2024). The Effectiveness of Jigsaw Model Based on Flipped Classroom to Improve Students ’ Critical Thinking Ability in Islamic Religious Education Learning. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 8(5), 1069–1078. https://doi.org/10.31004/obsesi.v8i5.6190

Asnur, L., Jalinus, N., Faridah, A., Apra, T., Ambiyar, R. D., & Utami, F. (2024). Video-blogs ( Vlogs ) -based Project : A Meta Analysis. 14(5), 1553–1557.

Aziz, S., Mahmood, M., & Rehman, Z. (2018). Implementation of CIPP Model for Quality Evaluation at School Level: A Case Study. Journal of Education and Educational Development, 5(1), 189. https://doi.org/10.22555/joeed.v5i1.1553

Badawi et al. (2023). Integration of Blended Learning and Project-Based Learning (BPjBL) on Achievement of Students’ learning goals: A Meta-analysis study. Pegem Journal of Education and Instruction, 13(4). https://doi.org/10.47750/pegegog.13.04.32

Basaran, M., Dursun, B., Gur Dortok, H. D., & Yilmaz, G. (2021). Evaluation of Preschool Education Program According to CIPP Model. Pedagogical Research, 6(2), em0091. https://doi.org/10.29333/pr/9701

Bilan, N., Negahdari, R., Hazrati, H., & Moghaddam, S. F. (2021). Examining the quality of the competency-based evaluation program for dentistry based on the cipp model: A mixed-method study. Journal of Dental Research, Dental Clinics, Dental Prospects, 15(3), 203–210. https://doi.org/10.34172/JODDD.2021.034

Borenstein, M., Hedges, L., & Rothstein, H. (2007). Introduction to Meta-Analysis. www.Meta-Analysis.com

Chen, W., & Ruannakarn, P. (2024). Based on the CIPP Theory Perspective: The Application of Information Technology Integration in Physical Education Course Evaluation - A Case Study of Software Engineering Institute of Guangzhou. Higher Education Studies, 14(2), 44. https://doi.org/10.5539/hes.v14n2p44

Darma, I. K. (2019). The effectiveness of teaching program of CIPP evaluation model. International Research Journal of Engineering, IT & Scientific Research, 5(3), 1–13. https://doi.org/10.21744/irjeis.v5n3.619

Divayana, D. G. H., Sanjaya, D. B., Marhaeni, A. A. I. N., & Sudirtha, I. G. (2017). CIPP evaluation model based on mobile phone in evaluating the use of blended learning platforms at vocational schools in bali. Journal of Theoretical and Applied Information Technology, 95(9), 1983–1995.

Dzo’ul Milal, A., Rohmah, Z., Kusumajanti, W., Basthomi, Y., Sholihah, D. N., & Susilowati, M. (2020). Integrating character education in the english teaching at islamic junior high schools in Indonesia. Teflin Journal, 31(1), 88–107. https://doi.org/10.15639/teflinjournal.v31i1/88-107

Ekiz, M. A. (2022). Evaluation of Teaching Practice Course According to The Opinions of Teaching Staff, Practice Teachers and Pre-Service Teachers. Education Quarterly Reviews, 5(2). https://doi.org/10.31014/aior.1993.05.02.512

Görkem Erdogan, & Mede, E. (2021). The Evaluation of an English Preparatory Program Using CIPP Model and Exploring A1 Level Students’ Motivational Beliefs. Journal of Education and Educational Development, 8(1), 53–76. https://doi.org/10.22555/joeed.v8i1.109

Harding, L. (2012). Pronunciation Assessment. The Encyclopedia of Applied Linguistics, 15(4), 57–84. https://doi.org/10.1002/9781405198431.wbeal0966

Ichsan, I., Suharyat, Y., Santosa, T. A., & Satria, E. (2023). Effectiveness of STEM-Based Learning in Teaching 21 st Century Skills in Generation Z Student in Science Learning: A Meta-Analysis. Jurnal Penelitian Pendidikan IPA, 9(1), 150–166. https://doi.org/10.29303/jppipa.v9i1.2517

Iqbal, Z., Khan, R., & Wadood, A. (2022). Evaluation of the Effectiveness of the Process of Undergraduate Health and Physical Education Program by the CIPP Model. Global Educational Studies Review, VII(II), 285–295. https://doi.org/10.31703/gesr.2022(vii-ii).27

Kahraman, E. (2023). Bibliometric and content analysis of meta-analysis studies in the field of STEM education. International Journal of Modern Education Studies, 7(2), 511–544. https://doi.org/10.51383/ijonmes.2023.337

Kang, K. (2020). Analysis of the Effectiveness of the University Convergence Curriculum using the CIPP model. Journal of the Korea Convergence Society, 11(9), 135–142.

Keskin, I., & Yazar, T. (2020). Evaluation of the curriculum of high school mathematics according to CIPP model. Bulletin of Education and Research, 42(3), 183–214. http://pu.edu.pk/images/journal/ier/PDF-FILES/10_42_3_20.pdf

Khaksar, M., Kiany, G. R., & ShayesteFar, P. (2023). Using a CIPP-Based Model for Evaluation of Teacher Training Programs in a Private-sector EFL Institutes. Language Teaching Research Quarterly, 38, 65–91. https://doi.org/10.32038/ltrq.2023.38.04

Khalid, M., Saad, S., Abdul Hamid, S. R., Ridhuan Abdullah, M., Ibrahim, H., & Shahrill, M. (2020). Enhancing creativity and problem solving skills through creative problem solving in teaching mathematics. Creativity Studies, 13(2), 270–291. https://doi.org/10.3846/cs.2020.11027

Li, Y., & Hu, C. (2022). The Evaluation Index System of Teaching Quality in Colleges and Universities: Based on the CIPP Model. Mathematical Problems in Engineering, 2022. https://doi.org/10.1155/2022/3694744

Noh, M. A. C., Tamuri, A. H., Razak, K. A., & Suhid, A. (2014). The study of quranic teaching and learning: United Kingdom experience. Mediterranean Journal of Social Sciences, 5(16), 313–317. https://doi.org/10.5901/mjss.2014.v5n16p313

Nurhayati, R., Aw, S., Dwiningrum, S. I. A., Hajaroh, M., & Herwin, H. (2024). Validity and Reliability of Child-Friendly School Policy Evaluation Instruments in Primary Schools: Confirmatory Factor Analysis. International Journal of Educational Methodology, volume-10-(volume-10-issue-1-february-2024), 165–177. https://doi.org/10.12973/ijem.10.1.965

Oflaz, M., Coşkun, Y. D., & Bolat, Ö. (2022). The effects of the technology-integrated writing lessons: CIPP model of evaluation. Turkish Online Journal of Educational Technology - TOJET, 21(1), 157–179. https://orcid.org/0000-0002-5133-6482,

Ofosu-Ampong, K. (2020). The Shift to Gamification in Education: A Review on Dominant Issues. Journal of Educational Technology Systems, 49(1), 113–137. https://doi.org/10.1177/0047239520917629

Putro, H. Y. S., Babiera, R. M., Takwin, M., Rachman, A., & Ariliani, T. (2024). Evaluating the Impact of the Inspiring School Program in High Schools. International Journal of Asian Education, 5(1), 34–42. https://doi.org/10.46966/ijae.v5i1.373

Ratnaya, G., Indriaswuri, R., Widayanthi, D. G. C., Atmaja, I. M. P. D., & Dalem, A. A. G. P. K. P. (2022). CIPP Evaluation Model for Vocational Education: A Critical Review. Education Quarterly Reviews, 5(3), 1–8. https://doi.org/10.31014/aior.1993.05.03.519

Rezaee, R., & Shokrpour, N. (2011). Performance assessment of academic departments: CIPP model. European Journal of Social Sciences, 23(2), 227–236.

Santiyadnya, N. (2021). The effectiveness of CIPP model’s implementation in secondary school. Journal of Physics: Conference Series, 1810(1). https://doi.org/10.1088/1742-6596/1810/1/012071

Setiawan, M. A., Sari, N. P., Makaria, E. C., Dinanty, N. S., & Rahman, G. (2024). Enhancing Quality of Guidance and Counseling in Vocational Schools: Testing the Effectiveness of Evaluation Instruments Based on the CIPP Model. Paedagogia, 27(1), 73. https://doi.org/10.20961/paedagogia.v27i1.84673

Sopha, S., & Nanni, A. (2019). The cipp model: Applications in language program evaluation. Journal of Asia TEFL, 16(4), 1360–1367. https://doi.org/10.18823/asiatefl.2019.16.4.19.1360

Tamur, M., Juandi, D., & Kusumah, Y. S. (2020). The effectiveness of the application of mathematical software in indonesia; a meta-analysis study. International Journal of Instruction, 13(4), 867–884. https://doi.org/10.29333/iji.2020.13453a

Wantu, H. M., Muis, A., Zain, A., Hiola, S. F., Agustina, I., Santosa, T. A., Yastanti, U., & Nugraha, A. R. (2024). Effectiveness of Think-Pair-Share and STEM Models on Critical Thinking in Early Childhood Education. Jurnal Obsesi: Jurnal Pendidikan Anak Usia Dini, 8(5), 1320–1330. https://doi.org/10.31004/obsesi.v8i5.6202

Youna Chatrine Bachtiar, Mohammad Edy Nurtamam, Tomi Apra Santosa, Unan Yasmaniar Oktiawati, & Abdul Rahman. (2023). the Effect of Problem Based Learning Model Based on React Approach on Students’ 21St Century Skills: Meta-Analysis. International Journal of Educational Review, Law And Social Sciences (IJERLAS), 3(5), 1576–1589. https://doi.org/10.54443/ijerlas.v3i5.1047

Zulfadhli, M., & Kamarudin, B. I. N. (2024). Digital Inquiry-Based Science Learning In Rural Primary School.

Zulkifli, Z., Satria, E., Supriyadi, A., & Santosa, T. A. (2022). Meta-analysis: The effectiveness of the integrated STEM technology pedagogical content knowledge learning model on the 21st century skills of high school students in the science department. Psychology, Evaluation, and Technology in Educational Research, 5(1), 32–42. https://doi.org/10.33292/petier.v5i1.144

Downloads

Published

03-11-2024

How to Cite

Hilmiyati, F., Panggabean, T. E., Khoirunnisa, R. N., Dewanto, D., Siregar, M. S., & Santosa, T. A. (2024). The Effectiveness of the CIPP Evaluation Model in Science Learning in the Era of the Industrial Revolution 4.0. Jurnal Obsesi : Jurnal Pendidikan Anak Usia Dini, 8(6), 1375–1384. https://doi.org/10.31004/obsesi.v8i6.6227

Issue

Section

Articles