مدیریت نوآوری

مدیریت نوآوری

واکاوی ارزیابی آموزش مبتنی بر هوش مصنوعی در چارچوب الگوی سیپ در آموزش عالی

نوع مقاله : مقاله پژوهشی

نویسندگان
1 دانشیار گروه علوم تربیتی، دانشگاه سیستان و بلوچستان، زاهدان، ایران،(نویسنده مسئول)، رایانامه: r_bagherimajd@ped.usb.ac.ir
2 استادیار گروه علوم تربیتی، دانشگاه سیستان و بلوچستان، زاهدان، ایران
3 دانشجوی دکتری مدیریت آموزشی، دانشگاه فردوسی مشهد، مشهد، ایران.
4 کارشناسی ارشد مدیریت آموزشی، ، دانشگاه سیستان و بلوچستان، زاهدان، ایران.
10.22034/imj.2026.549317.2938
چکیده
ارزیابی آموزشی منبع مهم برای کیفیت بخشی در جهت شفافیت، اطلاع رسانی و پاسخگویی به ذینفعان آموزش عالی تحت تاثیر ابزارهای مهم هوش مصنوعی در جهان امروز قرار گرفته است. به این جهت هدف تحقیق واکاوی ارزیابی آموزش مبتنی بر هوش مصنوعی در چارچوب الگوی سیپ در آموزش عالی بوده است. روش تحقیق طرح تک شیوه­ای با فاز چندگانه ترتیبی کیفی و کیفی بوده است. که در مرحله اول از روش فراترکیب سیستماتیک مقالات(2002-2024) با جستجو در پایگاه­های گوگل اسکولار، اشپرینگر، امرالد، الزویر و نورمگز ، با بررسی اولیه 167 و بررسی نهایی 31 مقاله به همراه نظرات گروه کانونی(مرحله دوم، 7 عضو هیات علمی) انجام شد و تحلیل براساس کدگذاری باز، محوری و انتخابی با استفاده از نرم­افزار مکس­کیودا انجام گرفت. یافته­ها مطابق با الگوی سیپ در چهار بخش زمینه، درون­داد، فرایند و برونداد نشان داده شد. در زمینه به مضامین اصلی در سه بعد علمی_فرهنگی، اجتماعی و اقتصادی اشاره شد. در درون­داد­ها، مضامین اصلی در پنج بعد قوانین و مقررات، برنامه درسی، منابع مالی، منابع انسانی، امکانات و تجهیزات بیان شد. از طرف دیگر در فرایند مضامین در پنج بعد ابزار، محتوا، روش تدریس، اساتید و دانشجویان بیان گردید. همچنین در برونداد­ها مضامین در سه بعد مسئولیت­پذیری، بازخورد و نتایج و ابتکارات اشاره شده است. می­توان گفت ارزیابی در سیستم اموزش عالی از طریق هوش مصنوعی تحت تاثیر زمینه یا اهداف، درون داد، فرایند و برونداد­ها می­باشد و توجه این مضامین الگوی سیپ می­تواند در شکاف­های ایجاد کننده ابزرهای هوش مصنوعی در ارزیابی اموزش عالی کمک­کننده باشد.
کلیدواژه‌ها
موضوعات

عنوان مقاله English

Exploring the Education evaluation based on Artificial Intelligence within the framework of the CIPP in Higher Education

نویسندگان English

kamran bagherimajd 1
faramarz sabeghi 2
kosar khajedad 3
mahbube nazarikhah 4
1 associate professor in department of educational sciences, university of sistan and baluchestan, zahedan, iran, (Corresponding Author) , E-mail ; r_bagherimajd@ped.usb.ac.ir
2 assistant professor in department of educational sciences, university of sistan and baluchestan, zahedan
3 PHD student in educational administration, university of ferdosi, mashhad, iran
4 MA student in educational administration, university of sistan and baluchestan, zahedan, iran
چکیده English

the aim of the research was to Exploring the Education evaluation based on Artificial Intelligence within the framework of the CIPP in Higher Education. The research method was a monomethod designs with a Sequential Multistrand Designs qualitative_ qualitative. which is qualitatively the first part of the meta-synthesis approach according to the findings of national and international journals from 2002 to 2024. 167 articles were reviewed and 31 articles were analyzed. And then, using the focus group method, in order to investigate and discover the gaps in the findings, the opinions of 7 members of the educational science and information technology faculty were analyzed in a purposive manner. The analysis method was based on open, axial and selective coding using MAXQDA software. In accordance with the CIPP model, it was shown in four parts: context, input, process and output. Opportunities and challenges were pointed out in the context in three scientific-cultural, social and economic dimensions. In the inputs, opportunities and challenges were expressed in the five dimensions of laws and regulations, curriculum, financial resources, human resources, facilities and equipment. On the other hand, process opportunities and challenges were expressed in the five dimensions of tools, content, teaching method, professors and students. Also, in opportunities and challenges, outputs in three dimensions of responsibility, feedback, results and initiatives are mentioned.

کلیدواژه‌ها English

evaluation
Education evaluation
artificial intelligence
CIPP model
higher education
ظفری، مصطفی، اسماعیلی، علی، و صادقی­نیارکی، ابولقاسم(1400). مروری بر کاربردهای هوش مصنوعی و واقعیت مجازی در اموزش. مطالعات اندازه گیری و ارزشیابی اموزشی، 11(36)، 89-116. 10.22034/emes.2021.251559
عیوض­زاده، الهام؛ سعدآبادی علی­اصغر؛ شاکری، آرنوش(1403). فراترکیب تبیین نقش راهبردی هوش مصنوعی در توانمندسازی نوآوری اجتماعی جهت مقابله با فقر چندبعدی. نشریه علمی مدیریت نواوری، 13(4)، 139-182.https://dor.isc.ac/dor/20.1001.1.23225386.1399.9.4.4.8
کریمی­مونقی، حسین، و رافع، سمانه(1401). الگوی سیپ مدلی برای ارزشیابی. نوید نو، 25(82)، 91-101. https://doi.org/10.22038/nnj.2023.64789.1347
مطلبی­نژاد، علیرضا، شاهورانی، مصطفی، و شاهورانی، سودابه(1404). بررسی تحلیلی نظام­مند از کاربرد هوش مصنوعی در آموزش عالی. نامه اموزش عالی، 18(69)، 85-106. https://doi.org/10.22034/hel.2024.2011755.1909
Acar, A. S. (2023). Genre pedagogy: A writing pedagogy to help L2 writing instructors enact their classroom writing assessment literacy and feedback literacy. Assessing Writing, 56, 100717. https://doi.org/10.1016/j.asw.2023.100717.
Akinwalere, S. N., & Ivanov, V. (2022). Artificial intelligence in higher education: Challenges and opportunities. Border Crossing, 12(1), 1. https://www.ceeol.com/Search/Article-Detail?Id=1059714.
Alhwaiti, M. (2023). Acceptance of Artificial Intelligence Application in the Post-Covid Era and Its Impact on Faculty Members’ Occupational Well-being and Teaching Self Efficacy: A Path Analysis Using the UTAUT 2 Model. Applied Artificial Intelligence, 37(1), 2175110. https://doi.org/10.1080/08839514.2023.2175110.
Aljohani, N. R., Aslam, A., Khadidos, A. O., & Hassan, S. U. (2022). Bridging the skill gap between the acquired university curriculum and the requirements of the job market: A data-driven analysis of scientific literature. Journal of Innovation & Knowledge, 7(3), 100190. https://doi.org/10.1016/j.jik.2022.100190.
Alqahtani, T., Badreldin, H. A., Alrashed, M., Alshaya, A. I., Alghamdi, S. S., Bin Saleh, K., ... & Albekairy, A. M. (2023). The emergent role of artificial intelligence, natural learning processing, and large language models in higher education and research. Research in social and administrative pharmacy, 19(8), 1236-1242. https://doi.org/10.1016/j.sapharm.2023.05.016.
Angelidou, M., Politis, C., Roma-Athanasiadou, E., & Premyanov, N. (2023). Methodology to design and set up a framework to monitor and evaluate a Citizen Science Hub’s performance and impact. Societal Impacts, 100031. https://doi.org/10.1016/j.socimp.2023.100031.
 Ardito, C. G. (2023). Contra generative AI detection in higher education assessments. arXiv preprint arXiv:2312.05241. https://doi.org/10.48550/arXiv.2312.05241.
Baars, M., Khare, S., & Ridderstap, L. (2022). Exploring students’ use of a mobile application to support their self-regulated learning processes. Frontiers in Psychology, 13, 793002. https://doi.org/10.3389/fpsyg.2022.793002.
Bagherimajd, K., & Khajedad, K. (2025). Designing a model of sustainable education based on artificial intelligence in higher education. Computers and Education: Artificial Intelligence, 9, 100439. https://doi.org/10.1016/j.caeai.2025.100439.
Baker, T., Smith, L., & Anissa, N. (2019). Exploring the Future of Artificial Intelligence in Schools and Colleges. Retrieved from Nesta Foundation website: https://media.nesta.org.uk/documents/Future_of_AI_and_education_v5_WEB.pdf
Bekken, G. (2019). The algorithmic governance of data driven-processing employment: Evidence-based management practices, artificial intelligence recruiting software, and automated hiring decisions. Psychosociological Issues in Human Resource Management, 7(2), 25-30. https://www.ceeol.com/search/article-detail?id=809358.       
Boninger, F., & Molnar, A. (2020). Issues to Consider before Adopting a Digital Platform or Learning Program. National Education Policy Center. Retrieved from http://nepc.colorado.edu/publication/virtual-learning. 
Burrows, S., Gurevych, I., & Stein, B. (2015). The eras and trends of automatic short answer    grading. International journal of artificial intelligence in education, 25, 60-117. https://doi.org/10.1007/s40593-014-0026-8.
Cappon, D., den Boer, T., Yu, W., LaGanke, N., Fox, R., Brozgol, M., ... & Pascual-Leone, A. (2023). An Educational Program for Remote Training and Supervision of Home-Based Transcranial Electrical Stimulation: Feasibility and Preliminary Effectiveness. Neuromodulation: Technology at the Neural Interface. https://doi.org/10.1016/j.neurom.2023.04.477.
Celik, I., Dindar, M., Muukkonen, H., & Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616-630. https://doi.org/10.1007/s11528-022-00715-y.
Chassignol, M., Khoroshavin, A., Klimova, A., & Bilyatdinova, A. (2018). Artificial Intelligence trends in education: a narrative overview. Procedia Computer Science, 136, 16-24. https://doi.org/10.1016/j.procs.2018.08.233.
Chen, L., Chen, P., & Lin, Z. (2020). Artificial intelligence in education: A review. Ieee Access, 8, 75264-75278. https://doi.org/10.1109/ACCESS.2020.2988510.
Cheng, F., Zhang, H., Fan, W., & Harris, B. (2018). Image recognition technology based on deep learning. Wireless Personal Communications, 102, 1917-1933. https://doi.org/10.1007/s11277-018-5246-z.
Chui, M. (2017). Artificial intelligence the next digital frontier. McKinsey and Company Global Institute, 47(3.6). www.mckinsey.com/mgi.
Corbin, J., Strauss, A., 2015. Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, 4th ed. Sage publications Inc., Los Angeles. https://www.google.com/books/edition/Basics_of_Qualitative_Research/hZ6kBQAAQBAJ?hl=en.
Cotton, D. R., Cotton, P. A., & Shipway, J. R. (2024). Chatting and cheating: Ensuring academic integrity in the era of ChatGPT. Innovations in education and teaching international, 61(2), 228-239. https://doi.org/10.1080/14703297.2023.2190148. 
Crompton, H., & Burke, D. (2023). Artifcial intelligence in higher education: the state of the feld. International Journal of Educational Technology in Higher Education, (20), 8. https://dialnet.unirioja.es/servlet/articulo?codigo=8947356.
de la Fuente, M. F., & Farhadian, G. (2025). Systematic Review of the Impact of Artificial Intelligence in Higher Education. Journal of Teaching and Learning, 19(4), 72-96. https://files.eric.ed.gov/fulltext/EJ1487155.pdf.
Dhawan, S., & Batra, G. (2020). Artificial intelligence in higher education: Promises, perils, and perspective. Expanding Knowledge Horizon. OJAS, 11, 11-22.
DiCerbo, K. (2020). Assessment for learning with diverse learners in a digital world. Educational Measurement: Issues and Practice, 39(3), 90-93. https://doi.org/10.1111/emip.12374.
Dillenbourg, P. (2013). Design for classroom orchestration. Computers & education, 69, 485-492. https://doi.org/10.1016/j.compedu.2013.04.013.
Eyvazzadeh, E., Sadabadi, A. A., & Shakeri, A. (2024). A Meta-Synthesis of the Strategic Role of Artificial Intelligence in Empowering Social Innovation to Combat Multidimensional Poverty. Innovation Management Journal, 13(4), 139-182. https://dor.isc.ac/dor/20.1001.1.23225386.1399.9.4.4.8. (in Persian)
Haefner, N., Wincent, J., Parida, V., & Gassmann, O. (2021). Artificial intelligence and innovation management: A review, framework, and research agenda. Technological Forecasting and Social Change, 162, 120392. https://doi.org/10.1016/j.techfore.2020.120392.
Halagatti, M., Gadag, S., Mahantshetti, S., Hiremath, C. V., Tharkude, D., & Banakar, V. (2023). Artificial Intelligence: The New Tool of Disruption in Educational Performance Assessment. In Smart Analytics, Artificial Intelligence and Sustainable Performance Management in a Global Digitalised Economy (pp. 261-287). Emerald Publishing Limited. https://doi.org/10.1108/S1569-37592023000110A014.
Hattie, J. A., & Brown, G. T. (2010). Assessment and evaluation. In Educational psychology: Concepts, research and challenges (pp. 116-131). Routledge.
Holmes, W., & Porayska-Pomsta, K. (Eds.). (2022). The Ethics of Artificial Intelligence in education: Practices, challenges, and debates. Taylor & Francis. file:///C:/Users/sa/Downloads/10.4324_9780429329067_previewpdf.pdf.
Holstein, K., & Doroudi, S. (2021). Equity and Artificial Intelligence in Education: Will" AIEd" Amplify or Alleviate Inequities in Education?. arXiv preprint arXiv:2104.12920. https://doi.org/10.48550/arXiv.2104.12920.
Huang, M. H., & Rust, R. T. (2018). Artificial intelligence in service. Journal of service research, 21(2), 155-172. https://doi.org/10.1177/1094670517752459.
Ilkka, T. (2018). The impact of artificial intelligence on learning, teaching, and education. European Union. https://hdl.handle.net/20.500.12799/6021.
ITU. (2018). Artificial Intelligence (AI) for Development Series Module on AI. Geneva: Ethics and Society. https://www.itu.int/en/ITU-D/Conferences/GSR/Documents/GSR2018/documents/AISeries_EthicsModule_GSR18.pdf.
Jafari, F., & Keykha, A. (2024). Identifying the opportunities and challenges of artificial intelligence in higher education: a qualitative study. Journal of Applied Research in Higher Education, 16(4), 1228-1245. https://doi.org/10.1108/JARHE-09-2023-0426.
Jia, F., Sun, D., & Looi, C. K. (2024). Artificial intelligence in science education (2013–2023): Research trends in ten years. Journal of Science Education and Technology, 33(1), 94-117. https://doi.org/10.1007/s10956-023-10077-6.
Kambur, E., & Akar, C. (2022). Human resource developments with the touch of artificial intelligence: a scale development study. International Journal of Manpower, 43(1), 168-205. https://doi.org/10.1108/IJM-04-2021-0216.
Long, P., & Siemens, G. (2011). What is learning analytics. In Proceedings of the 1st International Conference Learning Analytics and Knowledge, LAK (Vol. 11).
Luckin, R., & Holmes, W. (2016). Intelligence unleashed: An argument for AI in education. https://discovery.ucl.ac.uk/id/eprint/1475756.
Memarian, B., & Doleck, T. (2024). A review of assessment for learning with artificial intelligence. Computers in Human Behavior: Artificial Humans, 2(1), 100040. https://doi.org/10.1016/j.chbah.2023.100040.
Miller, T. (2018). The new world of human resources and employment: How artificial intelligence and process redesign is driving dramatic change. Business Expert Press.
Mpolomoka, D. L. (2025). Utilizing Artificial Intelligence for Assessment in Higher Education. Pedagogical Research, 10(3), 1-14. https://doi.org/10.29333/pr/16677.
Nagro, S. A. (2021). The Role of Artificial Intelligence Techniqies in Improving the Behavior and Practices of Faculty Members When Switching to Elearning in Light of the COVID-19 Crisis. International Journal of Education and Practice, 9(4), 687-714. doi: 10.18488/journal.61.2021.94.687.714.
Nemorin, S., Vlachidis, A., Ayerakwa, H. M., & Andriotis, P. (2023). AI hyped? A horizon scan of discourse on artificial intelligence in education (AIED) and development. Learning, Media and Technology, 48(1), 38-51. https://doi.org/10.1080/17439884.2022.2095568.
Nieminen, J. H., Moriña, A., & Biagiotti, G. (2023). Assessment as a matter of inclusion: A meta-ethnographic review of the assessment experiences of students with disabilities in higher education. Educational Research Review, 100582. https://doi.org/10.1016/j.edurev.2023.100582.
Ocen, S., Elasu, J., Aarakit, S. M., & Olupot, C. (2025, March). Artificial intelligence in higher education institutions: review of innovations, opportunities and challenges. In Frontiers in Education (Vol. 10, p. 1530247). Frontiers Media SA. https://doi.org/10.3389/feduc.2025.1530247.
Ongsulee, P. (2017, November). Artificial intelligence, machine learning and deep learning. In 2017 15th international conference on ICT and knowledge engineering (ICT&KE) (pp. 1-6). IEEE. https://doi.org/10.1109/ICTKE.2017.8259629.
Ouyang, F., Wu, M., Zheng, L., Zhang, L., & Jiao, P. (2023). Integration of artificial intelligence performance prediction and learning analytics to improve student learning in online engineering course. International Journal of Educational Technology in Higher Education, 20(1), 4. https://doi.org/10.1186/s41239-022-00372-4.
Owoc, M. L., Sawicka, A., & Weichbroth, P. (2019, August). Artificial intelligence technologies in education: benefits, challenges and strategies of implementation. In IFIP International Workshop on Artificial Intelligence for Knowledge Management (pp. 37-58). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-85001-2_4.
Parker, S. K., & Grote, G. (2022). Automation, algorithms, and beyond: Why work design matters more than ever in a digital world. Applied Psychology, 71(4), 1171-1204. https://doi.org/10.1111/apps.12241.
Ramos, T. B., Montano, M., De Melo, J. J., Souza, M. P., de Lemos, C. C., Domingues, A. R., & Polido, A. (2015). Strategic Environmental Assessment in higher education: Portuguese and Brazilian cases. Journal of Cleaner Production, 106, 222-228. https://doi.org/10.1016/j.jclepro.2014.12.088.
Rasul, T., Nair, S., Kalendra, D., Robin, M., de Oliveira Santini, F., Ladeira, W. J., ... & Heathcote, L. (2023). The role of ChatGPT in higher education: Benefits, challenges, and future research directions. Journal of Applied Learning and Teaching, 6(1), 41-56. https://doi.org/10.37074/jalt.2023.6.1.29.
Rohde, F., Wagner, J., Meyer, A., Reinhard, P., Voss, M., & Petschow, U. (2023). Broadening the perspective for sustainable AI: Comprehensive sustainability criteria and indicators for AI systems. arXiv preprint arXiv:2306.13686. https://doi.org/10.48550/arXiv.2306.13686.
Rohde, F., Wagner, J., Meyer, A., Reinhard, P., Voss, M., Petschow, U., & Mollen, A. (2024). Broadening the perspective for sustainable artificial intelligence: sustainability criteria and indicators for Artificial Intelligence systems. Current Opinion in Environmental Sustainability, 66, 101411. https://doi.org/10.1016/j.cosust.2023.101411.
Sahar, R., & Munawaroh, M. (2025). Artificial intelligence in higher education with bibliometric and content analysis for future research agenda. Discover Sustainability, 6(1), 401. https://doi.org/10.1007/s43621-025-01086-z.
Sandelowski, M., & Barroso, J. (2006). Handbook for synthesizing qualitative research. springer publishing company.
Saplacan, D., Herstad, J., & Pajalic, Z. (2018). Feedback from digital systems used in higher education: An inquiry into triggered emotions-two universal design oriented solutions for a better user experience. In Transforming our world through design, diversity and education (pp. 421-430). IOS Press. https://ebooks.iospress.nl/volumearticle/50590.
Saveliev, A., & Zhurenkov, D. (2021). Artificial intelligence and social responsibility: the case of the artificial intelligence strategies in the United States, Russia, and China. Kybernetes, 50(3), 656-675. https://doi.org/10.1108/K-01-2020-0060.
Sharma, S. K., Sengupta, A., & Panja, S. C. (2019). Grounded Theory: A Method of Research Inquiry. In Methodological Issues in Management Research: Advances, Challenges, and the Way Ahead (pp. 181-201). Emerald Publishing Limited. https://doi.org/10.1108/978-1-78973-973-220191012.
Siemens, G., & Long, P. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE review, 46(5), 30. file:///C:/Users/sa/Downloads/article_183382.pdf.
Stufflebeam, D. L. (2000). The CIPP model for evaluation. In Evaluation models: Viewpoints on educational and human services evaluation (pp. 279-317). Dordrecht: Springer Netherlands. https://doi.org/10.1007/0-306-47559-6_16.
Stufflebeam, D. L., & Zhang, G. (2017). The CIPP evaluation model: How to evaluate for improvement and accountability. Guilford Publications.
Tambe, P., Cappelli, P., & Yakubovich, V. (2019). Artificial intelligence in human resources management: Challenges and a path forward. California Management Review, 61(4), 15-42. https://doi.org/10.1177/0008125619867910.
Tao, B., Díaz, V., & Guerra, Y. (2019). Artificial intelligence and education, challenges and disadvantages for the teacher. Arctic Journal, 72(12), 30-50.
Teddlie, C., & Tashakkori, A. (2006). A general typology of research designs featuring mixed methods. Research in the Schools, 13(1), 12-28.
Truong, Y., & Papagiannidis, S. (2022). Artificial intelligence as an enabler for innovation: A review and future research agenda. Technological Forecasting and Social Change, 183, 121852. https://doi.org/10.1016/j.techfore.2022.121852.
Valtonen, T., Hoang, N., Sointu, E., Näykki, P., Virtanen, A., Pöysä-Tarhonen, J., ... & Kukkonen, J. (2021). How pre-service teachers perceive their 21st-century skills and dispositions: A longitudinal perspective. Computers in Human Behavior, 116, 106643. https://doi.org/10.1016/j.chb.2020.106643.
Varghese, R., Deshpande, A., Digholkar, G., & Kumar, D. (2023). Deciphering the role of artificial intelligence in health care, learning and development. In The adoption and effect of artificial intelligence on human resources management, part B (pp. 149-179). https://doi.org/10.1108/978-1-80455-662-720230010.
Williamson, B., & Eynon, R. (2020). Historical threads, missing links, and future directions in AI in education. Learning, Media and Technology, 45(3), 223-235. https://doi.org/10.1080/17439884.2020.1798995.
Xue, Y., & Wang, Y. (2022). Artificial intelligence for education and teaching. Wireless Communications and Mobile Computing, 1-10. https://doi.org/10.1155/2022/4750018.
Zimmer, L. (2006). Qualitative meta‐synthesis: a question of dialoguing with texts. Journal of advanced nursing, 53(3), 311-318. https://doi.org/10.1111/j.1365-2648.2006.03721.x

  • تاریخ دریافت 03 خرداد 1404
  • تاریخ بازنگری 14 مرداد 1404
  • تاریخ پذیرش 15 شهریور 1404