Investigating the Appropriateness of a Course Evaluation Model: Preservice Teachers’ Flipped Learning Experience

Abeysekera L and Dawson P (2015) Motivation and cognitive load in the flipped classroom: Definition, rationale and a call for research. Higher Education Research and Development 34: 1–14.

Abma TA and Stake RE (2001) Stake’s responsive evaluation: core ideas and evolution. New Directions for Evaluation 92: 7–20.

Adnan M (2017) Perceptions of senior-year ELT students for flipped classroom: A materials development course. Computer Assisted Language Learning 30(3-4): 204–222.

Alaswad Z (2019) A case study of game-based learning in interior design studios. Design and Technology Education: An International Journal 24(3): 1–21.

Alderman L (2015) Illuminative evaluation applied to government policy in higher education. Evaluation Journal of Australia 15(1): 4–14.

Amstelveen R (2019) Flipping a college mathematics classroom: An action research project. Education and Information Technologies 24: 13371350.

Arbour G (2020) Frameworks for program evaluation: Considerations on research, practice, and institutions. Evaluation 26(4): 422–437.

Authors (2016). Details were removed for blind peer-review.

Author (2019). Details were removed for blind peer-review.

Authors (2019). Details were removed for blind peer-review.

Authors (2021). Details were removed for blind peer-review.

Aydin U, Tunç-Pekkan Z, Taylan R D, Birgili B and Özcan M (2018) Impacts of a university–school partnership on middle school students' fractional knowledge: A quasiexperimental study. Journal of Educational Research 111(2): 151-162.

Bamkin M, Maynard S and Goulding A (2016) Grounded theory and ethnography combined: A methodology to study children's interactions on children's mobile libraries. Journal of Documentation 72(2): 214–231.

Barillo M (1979) Introduction to illuminative evaluation: Studies in higher education. In: M. Parlett M and Dearden G (eds) California: Pacific Soundings Press.

Bergmann J and Sams A (2012) Flip your classroom: Reach every student in every class every day. ISTE: International Society for Technology in Education.

Birgili, B., Kiziltepe, Z., & Seggie, F. N. (2016). Teaching method preferences of teachers: the cooperative teaching method. World Studies in Education 17(2): 37–52. https://doi.org/10.7459/wse/17.2.04

Bond M (2020) Facilitating student engagement through the flipped learning approach in K-12: A systematic review. Computers & Education 151: 1–36.

Cameron BT (2014) Using responsive evaluation in strategic management. Strategic Leadership Review 4(2): 426.

Capar G and Tarim K (2015) Efficacy of the cooperative learning method on mathematics achievement and attitude: A meta-analysis research. Educational Sciences: Theory & Practice 15(2): 553–559.

Caruso G (2019) Facing EL teachers’ burnout through motivation. Journal of Pedagogical Research 3(1): 1–14.

Castro-Calviño L, Rodríguez-Medina J, Gómez-Carrasco, CJ and López-Facal R (2020) Patrimonializarte: A heritage education program based on new technologies and local heritage. Education Sciences 10(7): 176.

CELT (2021). Center for Research and Best Practices in Learning and Teaching. https://www.mef.edu.tr/en/center-research-and-best-practices-learning-and-te#gsc.tab=0

Chivatá YP and Oviedo RC (2018) EFL students’ perceptions of activeness during the implementation of flipped learning approach at a Colombian university. GIST – Education and Learning Research Journal 17: 81–105.

Coombe CM, Schulz AJ, Brakefield-Caldwell W, Gray C, Guzman JR, Kieffer EC, Lewis T, Reyes AG, Rowe Z, and Israel, BA (2019) Applying experiential action learning pedagogy to an intensive course to enhance capacity to conduct community-based participatory research. Pedagogy in Health Promotion 6(3): 168–182.

Çalışkan I (2014) Identifying the needs of pre-service classroom teachers about science teaching methodology courses in terms of Parlett’s Illuminative Program Evaluation Model. International Journal of Education in Mathematics, Science and Technology 2(2): 138–148.

Çam-Aktaş B (2018) Induction to teaching program in Turkey: Attainments of novice teachers. European Journal of Education Studies 4(8).

Darwin S (2016) The emergence of contesting motives for student feedback-based evaluation in Australian higher education. Higher Education Research & Development 35(3): 419–432.

Darwin S (2017) What contemporary work are student ratings actually doing in higher education? Studies in Educational Evaluation 54: 13–21.

Dearden G and Laurillard D (1977) Illuminative evaluation in action: An illustration of the concept of progressive focusing. Research Intelligence 3(2): 3–7.

Donaldson SI (2017) Empowerment evaluation: An approach that has literally altered the landscape of evaluation. Evaluation and Program Planning 63: 136–137.

Dusenbury MJ and Olson MR (2019) The impact of flipped learning on student academic performance and perceptions. Collegiate Aviation Review International 37(1): 19–44.

Esau N, English R and Shung-King M (2020) An assessment of a “Training-of-trainers programme for clinic committees” in a South African district: A qualitative exploratory study. Research Square.

Fetterman DM (1993) Speaking the language of power: Communication, collaboration, and advocacy (Translating ethnography into action). London, England: Falmer Press.

Fetterman DM (1994) Empowerment evaluation. Evaluation Practice 15(1): 1–15.

Fetterman D (2001) Empowerment evaluation and self-determination: A practical approach toward program improvement and capacity building. In: Schneiderman N, Speers, MA, Silva, JM, Tomes, H and Gentry JH (eds) Integrating Behavioral and Social Sciences with Public Health. Massachusetts: American Psychological Association, pp.321–350.

Fetterman DM (1995) Empowerment evaluation: A form of self-evaluation. In: Annual Meeting of the American Educational Research Association, SanFrancisco, CA, 18-22 April, 1995.

Fetterman D (2019) Empowerment evaluation: A stakeholder involvement approach. Health Promotion Journal of Australia: Official Journal of Australian Association of Health Promotion Professionals 30(2): 137–142.

Fitzpatrick JL, Sanders, JR, and Worthen, BR (2010) Program evaluation: Alternative Approaches and Practical Guidelines (4th ed) London: Pearson Press.

Flipped Learning Academy (2018) Higher Education Flipped Learning Conference. http://www.flippedlearningacademy.org

Flipped Learning Global Initiative (nd) Available online at http://flr.flglobal.org, accessed August 4 2021.

Flipped Learning Review 3.0 Magazine [FLRM] (nd) Available online at http://flr.flglobal.org, accessed April 25 2018.

Foldnes, N (2016) The flipped classroom and cooperative learning: Evidence from a randomised experiment. Active Learning in Higher Education, 17(1): 39–49.

Fraenkel, JR, Wallen, NE, and Hyun, HH (2015) How to design and evaluate research in education. New York, NY: McGraw Hill Press.

Gay LR, Mills, GE, and Airasian, PW (2011) Educational research competencies for analysis and applications (10th ed) Pearson Press.

Gredler, ME (1996). Program Evaluation. Merrill Press.

Gruba P, Cardenas-Claros MS, Suvorov R, and Rick K (2016) Blended Language Program Evaluation. London, UK: Palgrave Macmillan Press.

Guba EE and Lincoln YS (1989) The fourth generation evaluation. Newbury Park, CA: Sage Press.

Guo Z, Zhao Y and He Z (2019) Course reform of general chemistry based on evaluation of curriculum achievement under engineering education accreditation. In: 9th International Conference on Social Science and Education Research (SSER 2019), 25-27 October, 2019, UK.

Gültekin M and Demirci C (2020) Evaluation of the English language preparatory school curriculum in the lights of illuminative evaluation model. European Journal of English Language Teaching 5(3): 103–131.

Hanson R (2019) The impact of two-tier instruments on undergraduate chemistry teacher trainees: An illuminative assessment. International Journal for Infonomics 12(4): 1920–1928.

Holland J and Campbell J (editors) (2005) Methods in development research: combining qualitative and quantitative approaches. West Yorkshire, UK: ITDG Press.

Huebner AJ and Betts SC (1999) Examining fourth generation evaluation: Application to positive youth development. Evaluation 5(3): 340–358.

Hwang GJ, Chen, MRA, Sung HY and Lin MH (2018) Effects of integrating a concept mapping-based summarization strategy into flipped learning on students' reading performances and perceptions in Chinese courses. British Journal of Educational Technology. https://doi.org/10.1111/bjet.12708

Karadağ E and Yücel C (2020) Devlet üniversiteleri ve fakülteleri sıralaması [DÜS] 2020 [Public universities and faculties rankings (DÜS) 2020]. University Research Laboratory Press. doi: 10.13140/RG.2.2.33183.61605

Klintberg I (1976) A responsive evaluation of two programs in medical education. Studies in Educational Evaluation 2(1): 23–30.

Krueger RA and Casey MA (2014) Focus groups: A practical guide for applied research (5th ed), Thousand Oaks, California: Sage Publications, Inc.

Kushner S (1996) The limits of constructivism in evaluation. Evaluation 2(2): 189–200.

Låg T and Sæle RG (2019) Does the flipped classroom improve student learning and satisfaction? A systematic review and meta-analysis. AERA Open 5(3): 2332858419870489.

Lai CL and Hwang GJ (2016) A self-regulated flipped classroom approach to improving students’ learning performance in a mathematics course. Computers & Education 100: 126–140.

Lam J (2015) The student experience of a blended learning accounting course: A case study in Hong Kong. PhD Thesis, University of Nottingham, UK.

Lang FK, Randles CA and Jeffery KA (2020) Developing and evaluating a graduate student teaching assistant training course in the chemistry department of a large American university. Journal of Chemical Education 97(6): 1515–1529.

Larusdottir M, Roto V, Stage J, Lucero, A and Šmorgun, I (2019) Balance talking and doing! Using google design sprint to enhance an intensive ucd course. In Human-Computer Interaction – INTERACT 2019, pp.95–113. Springer International Publishing.

Laughlin R and Broadbent J (1996) Redesigning fourth generation evaluation: An evaluation model for the public-sector reforms in the UK? Evaluation 2(4): 431–451.

Laughlin R and Broadbent J (1996) Redesigning fourth generation evaluation: An evaluation model for the public-sector reforms in the UK? Evaluation 2(4): 431–451.

Lay M and Papadopoulos I (2007) An exploration of fourth generation evaluation in practice. Evaluation 13(4): 495–504.

Lee HM (2007) An inquiry into co-teaching in classes and students’ reaction with different teachers. Fall 2007 Issues in EFL 5(2): 78–91.

Lin CJ and Hwang GJ (2018a) A learning analytics approach to investigating factors affecting EFL students' oral performance in a flipped classroom. Educational Technology & Society 21(2): 205–219.

Lin HC and Hwang GJ (2018b) Research trends of flipped classroom studies for medical courses: a review of journal publications from 2008 to 2017 based on the technology-enhanced learning model. Interactive Learning Environments. doi: 10.1080/10494820.2018.1467462

Long T, Cummins J and Waugh M (2017) Use of the flipped classroom instructional model in higher education: Instructors’ perspectives. Journal of Computing in Higher Education 29(2): 179–200.

Lopes AP and Soares F (2017) What do students of a higher education institution think about flipped learning? In: Proceedings of Edulearn17 Conference, 3-5th July, Barcelona, Spain.

Louhab FE, Bahnasse A, Bensalah F, Khiat A, Khiat Y and Talea M (2020) Novel approach for adaptive flipped classroom based on learning management system. Education and Information Technologies 25(2): 755–773.

Luo Er C (2015) NTU to spend S$75 million to implement flipped classroom model. Channel NewsAsia. https://www.channelnewsasia.com/news/singapore/ntu-to-spend-s-75-million-to-implement-flipped-classroom-model-8247600

Madaus G and Stufflebeam D (2000) Program evaluation: A historical overview. In: Stufflebeam DL, Madaus CF and Kellaghan T (eds) Evaluation Models, pp.3–18. Dordrecht, Kluwer Academic Press.

Massey C (2017) A case study of curriculum innovation for global capacities: One response to the call of the twenty-first century. In: S. Choo et al. (eds), educating for the 21st Century. Springer Press.

Miles MB and Huberman AM (1994) Qualitative Data Analysis: An Expanded Sourcebook. Thousand Oaks, USA: Sage Publications, Inc.

Nanyang Technological University (2018) Learning design and development. http://www.ntu.edu.sg/cits/lsa/LDD/Pages/OnlineCourseDesignDevelopment.aspx

Nevo D (1983) The conceptualization of educational evaluation: An analytical review of the literature. Review of Educational Research 53(1): 117–128.

Oliver E (2019) The triangle of effective education implemented for Theology. HTS Teologiese Studies/Theological Studies 75(1): 1–8.

Orhan A (2019) The effect of flipped learning on students’ academic achievement: A meta-analysis study. Çukurova University Faculty of Education Journal 48(1): 368–396.

Özüdoğru F and Adıgüzel OC (2016) The analysis of the views of English teachers about 2nd grade English language teaching curriculum. E-international Journal of Educational Research 7(2) 16–35.

Özüdoğru F (2017) The teaching of listening and speaking skills within the context of primary school second grade English language teaching curriculum. Mehmet Akif Ersoy University Journal of Faculty of Education 42: 189–210.

Pardo A and Mirriahi N (2017) Design, deployment and evaluation of a flipped learning first-year engineering course. In: Reidsema C, Kavanagh L, Hadgraft R and Smith N (eds), Flipping the Classroom: Practice and Practices in Higher Education, pp.177-191. Singapore: Springer Press.

Parlett RP and Dearden G (1977) Introduction to Illuminative Evaluation: Studies in Higher Education. California: Pacific Soundings Press.

Parlett M and Hamilton D (1972) Evaluation as illumination: A new approach to study of innovatory programs. Centre for Research in the Educational Sciences, University of Edinburgh.

Parlett M and Hamilton D (1976) Evaluation as illumination. In: Tawney D (eds), Curriculum Evaluation Today. London, UK: Macmillan Press.

Patton MQ (1980) Qualitative Evaluation Models. London: Sage Press.

Patton MQ (2002) Qualitative Research and Evaluation Methods (3rd ed) London: Sage Press.

Patton MQ (2018). Evaluation science. American Journal of Evaluation 39(2): 183–200.

Paolucci-Whitcomb P, Bright WE II, Carlson RV and Meyers HW (1987) Interactive evaluation: Processes for improving special education leadership training. Remedial and Special Education 8(3): 52–61.

Praslova L (2010) Adaptation of Kirkpatrick’s four level model of training criteria to assessment of learning outcomes and program evaluation in Higher Education. Educational Assessment, Evaluation and Accountability 22: 215–225. https://doi.org/10.1007/s11092-010-9098-7

Rakel R (1976) A summary: responsive evaluation and family practice. Studies in Educational Evaluation 2(1): 35–36.

Ranellucci J, Robinson KA, Rosenberg JM, Lee Y, Roseth CJ and Linnenbrink-Garcia L (2021) Comparing the roles and correlates of emotions in class and during online video lectures in a flipped anatomy classroom. Contemporary Educational Psychology 65:101966.

Schnoes CJ, Murphy-Berman V and Chambers JM (2000) Empowerment evaluation applied: Experiences, analysis, and recommendations from a case study. American Journal of Evaluation 21(1): 53–64.

Smith C and Becker S (2021) Using communities of practice to facilitate technology integration among k-12 educators: A qualitative meta-synthesis. Journal of Technology and Teacher Education 29(4): 559–583.

Smith J and Osborn M (2003) Interpretive phenomenological analysis. In: Smith, JA (ed), Qualitative Psychology: A Practical Guide to Research Methods 51–80. London: Sage Press.

Sorcinelli G, Parsons M and Halpern E (1984) Naturalistic responsive evaluation: A new methodology for evaluating health and safety in education. Lifelong Learning, 8(1): 4–6.

Spanja S (2019) Evaluation as a pedagogical phenomenon. Školski vjesnik, 68(1): 279–297.

Spiegel AN, Bruning RH and Giddings L (1999) Using responsive evaluation to evaluate a professional conference. The American Journal of Evaluation 20(1): 57–67.

Stake RE (nd) Program evaluation, particularly responsive evaluation. Evaluation in Education and Human Services 343–362.

Stake RE (1967) Toward technology for the evaluation of educational programs. In: Tyler, RW, Gagne RM and Scriven M (eds), Perspectives of Curriculum Evaluation, pp.1-12. Chicago, USA: Rand McNally Press.

Stake RE (1974) Program evaluation, particularly responsive evaluation. In: Dockrell WB and Hamilton D (eds) Rethinking Educational Research. London, UK: Hodder and Stoughton Press.

Stake RE (1975) To evaluate an arts program. In: Stake RE (ed.), Evaluating the Arts in Education: A Responsive Approach, pp.13-31. Columbu, OH: Merrill Press.

Stake RE (1977) The countenance of educational evaluation. In: Bellack AA and Kliebard HM (eds) Curriculum and Evaluation, pp.372-390. Berkeley, CA: McCutchan Press.

Stake RE, Migotsky C, Davis R, Cisneros EJ, Depaul G, Dunbar C and et al (1997) The evolving synthesis of program value. Evaluation Practice 18(2): 89–103.

Stake R (2003) Responsive evaluation. In: Kellaghan T and Stufflebeam DL (eds) International Handbook of Educational Evaluation. Kluwer International Handbooks of Education, 9. Dordrecht: Springer Press.

Statistical Package for the Social Sciences Inc (2012). IBM statistics 21. SPSS Inc Press.

Stufflebeam DL, Madaus GF and Kellaghan T (2002) Evaluation Models. Dordrecht: Kluwer Academic Publishers.

Stöhr C, Demazière, C and Adawi T (2020) The polarizing effect of the online flipped classroom. Computers & Education 147.

Şahin Ş and Kılıç A (2018) School self-evaluation model suggestion. International Journal of Instruction, 11(3): 193–206.

Tesch R (1990) Qualitative Research: Analysis Types and Software Tools. New York: Falmer Press.

Thanabalan TV, Siraj S and Alias N (2015) Evaluation of a digital story pedagogical module for the indigenous learners using the stake countenance model. Procedia - Social and Behavioral Sciences, 176: 907–914.

Topper A and Lancaster S (2016). Online graduate educational technology program: An illuminative evaluation. Studies in Educational Evaluation, 51(1): 108–115.

van der Mars H (1989) Observer reliability: Issues and procedures. In: Darst PW, Zakrajsek DB and Mancini VH (eds) Analyzing Physical Education and Sport Instruction (2nd ed) Human Kinetics 53-80.

Ying Y and Russman MA (2018) Evaluation of curriculum impact to students’ internship: A case study in Chinese department of Bina Nusantara University, Indonesia. In: ICDEL '18: Proceedings of the 2018 International Conference on Distance Education and Learning May, 2018, 84-87. https://doi.org/10.1145/3231848.3231872

Yoon S, Park MY and McMillan M (2017) An illuminative evaluation: Student experience of flipped learning using online contents. Journal of Problem-Based Learning, 4(1): 47–54.

Yücel-Toy B and Ok A (2012) The qualitative inquiry in the evaluation of a pedagogical course from the prospective teachers’ points of view. The Qualitative Report, 17(1): 143–174.

Zawacki-Richter O, Kerres M, Bedenlier S, Bond M and Buntins K (eds) (2020) Systematic Reviews in Educational Research. Springer Fachmedien Wiesbaden Press.

Zohrabi M (2012) Preliminary aspects of language course evaluation. The Journal of Pan-Pasific Association of Applied Linguistics, 16(1): 123–144.

Zou D, Xie H, Wang, FL and Kwan R (2020) Flipped learning with Wikipedia in higher education. Studies in Higher Education, 1–20.