Next Article in Journal
Operation Optimization Method of Distribution Network with Wind Turbine and Photovoltaic Considering Clustering and Energy Storage
Next Article in Special Issue
Levels of Sustainability Awareness in Spanish University Students of Nautical Activities as Future Managers of Sports and Active Tourism Programmes
Previous Article in Journal
A Framework for Using UAVs to Detect Pavement Damage Based on Optimal Path Planning and Image Splicing
Previous Article in Special Issue
Development of Spatio-Temporal Orientation of Children with Down Syndrome through Educational Platforms after Romanian Pandemic Lockdown
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Exploring Skills in Observing Teaching Competency through Video Evaluation of Class Demonstrations by Pre-Service Physical Education Teachers

1
Department of Physical Education, Kyung Hee University, Yongin-si 17104, Republic of Korea
2
Department of Physical Education, Shin Han University, Uijeongbu 11644, Republic of Korea
3
Department of Physical Education, College of Education, Wonkwang University, Iksan-si 54538, Republic of Korea
4
Department of Physical Education, College of Education, Korea University, Seoul 02841, Republic of Korea
*
Authors to whom correspondence should be addressed.
The first two authors contributed equally to this work.
The corresponding two authors contributed equally to this work.
Sustainability 2023, 15(3), 2183; https://doi.org/10.3390/su15032183
Submission received: 31 December 2022 / Revised: 19 January 2023 / Accepted: 22 January 2023 / Published: 24 January 2023
(This article belongs to the Special Issue Physical Education and Educational Innovation for Sustainability)

Abstract

:
This study aimed to evaluate the level of skill in observing teaching competency in pre-service physical education (PE) teachers and provide basic data to cultivate teaching competency. A total of 21 third-year pre-service PE teachers were selected as participants. The study derived descriptive statistics to analyze the participants’ observation skills regarding teaching competency in different class stages using evaluation results of class demonstrations by pre-service teachers. The Mann–Whitney U test was conducted to verify the statistical significance of the evaluation between in-service and pre-service teachers. Compared with in-service teachers, pre-service teachers reported high agreement with intuitive teaching behaviors. However, pre-service teachers indicated low agreement with skills that required complex teaching behaviors depending on various situations. Based on theories by Schon (1983), pre-service teachers showed high “knowledge for practice” and low “knowledge in practice”. The present study confirmed that pre-service PE teachers tended to have high propositional knowledge and low methodological knowledge regarding teaching. Pre-service teacher education requires an approach that harmonizes theory- and practice-centered education. This study provided directions for pre-service teacher education to enhance the competency of pre-service teachers for leading and analyzing classes.

1. Introduction

The purpose of pre-service teacher education is to nurture teachers with practical teaching expertise who can guide students in school. In the area of physical education (PE), which mainly consists of physical activities, teaching is commonly conducted in various environments, such as school fields and gymnasiums, depending on the class contents. Therefore, teacher education must be conducted to accurately realize the purpose of education based on various factors, such as physical activity, learning environment, and learners [1]. In pre-service teacher education, training for the cultivation of practical teaching ability is limited to conducting class demonstrations in courses consisting of PE teaching methods, textbook research, and teaching methods. In the absence of mandatory practice and regulations, such training has not always been provided. Class demonstration is an effective way to enhance the practical teaching capacity of pre-service teachers, and research on class demonstrations in pre-service PE teacher education has shown various educational meanings.
Zach, Harari, and Harari [2] reported that class demonstrations based on pre-service teacher education help develop sufficient knowledge and teaching capabilities necessary to run classes in schools. Similarly, Kim [3] showed that self-reflection of class demonstrations in pre-service PE teachers enables understanding of problems and teaching philosophy of PE. Jeon et al. [4] observed that pre-service PE teachers develop competencies to understand the use of documents, such as lesson plans and curricula, through reflection activities of class demonstrations. Saban and Çoklar [5] reported that through micro-teaching, pre-service teachers can identify the strengths and weaknesses of their teaching behavior by reflecting on the use of various teaching tools, lesson planning, and timing.
Ryu [6] showed that self-evaluation of classes using video demonstrations and reflective activities helps pre-service teachers find and improve problems in teaching activities and gain confidence. Indeed, teacher evaluation of class demonstrations by pre-service PE teachers involves reflecting on evaluation results, which identifies problems with various teaching behaviors, such as inefficient presentation of assignments, lack of communication skills with students, and lack of student evaluation [7]. In a study on planning and implementation of class demonstrations by pre-service teachers, Park and Choi [8] suggested the need for an evaluation system that can accurately analyze and interpret the causes of positive and negative behaviors as well as identify practical knowledge levels.
Based on these findings, class demonstrations help pre-service teachers reflect on the process of planning and operating classes and improve their teaching competency. In particular, simultaneous evaluation of teaching and reflective activities effectively improve the quality of classes by further improving teaching competency. Reflective activities have positive effects on class demonstration; opportunities to understand and improve problems through objective evaluation allow professional evaluation of teaching competency according to systematic standards [9,10]. Therefore, evaluation of pre-service teachers’ class demonstrations is an effective educational method to cultivate teaching competency for the successful management of classes in school [11].
For instance, NASPE [12] has presented conceptual definitions of each evaluation item and developed a tool to effectively evaluate the teaching expertise of PE teachers. SHAPE America [13] and NBPTS [14] suggested that qualification standards for PE teachers must specifically present the detailed contents of teachers’ responsibilities. A team of researchers developed a scale, called Self-Evaluation of Teacher Effectiveness Questionnaire in Physical Education, consisting of 25 questions in six domains that state values in improving teachers’ knowledge, understanding, motivation, and belief in education [15]. As such, experts are actively developing tools for teacher evaluation.
Kim [1] developed a teaching competency evaluation tool for PE teachers and evaluated classes led by PE teachers. Kim analyzed the teaching competency by sex and experience to evaluate the applicability of the developed tool. However, most studies on teacher evaluation are focused on evaluating the teaching competency of PE teachers. Meanwhile, research on developing teaching competency evaluation tools or evaluating the performance of pre-service PE teachers—who need practical teaching experience—is lacking. Teacher evaluation requires the analysis of data on teaching as a process, teaching methods, and teacher knowledge, as well as the use of adequate evaluation tools. Such evaluation of teaching competency cannot be achieved in a short period of time; rather, it must be systematically learned to acquire professional abilities [16]. Therefore, studies must be conducted to evaluate the teaching competency of pre-service teachers, identify exact problems, and seek improvements.
Our study aimed to evaluate class demonstrations conducted by pre-service PE teachers and to identify their level of practical teaching knowledge. We selected videos of class demonstrations by pre-service PE teachers conducted in PE teaching methods and evaluated these using the teaching competency evaluation tool developed by Kim and Kwak [17]. Specifically, we aimed to compare the evaluation results of pre-service PE teachers and field teachers to identify their class observation skills. Education that observes and evaluates the process of class demonstration or practice in pre-service teacher education is expected to affect the improvement of teaching competency [18,19,20,21,22,23,24].
Specifically, the research questions of this study were as follows. First, what tendencies do the differences in the mean scores of detailed items show according to the class level between pre-service and field PE teachers? Second, in what order do the detailed items of the class level between the two groups show concordance? Third, what significant differences do the detailed items of the class level between the two groups show? With our findings, we expected to help pre-service PE teachers develop the ability to evaluate correct and incorrect PE teaching behaviors. Furthermore, by presenting the future directions of PE teacher evaluation education, we intended to help enhance professionalism in teachers.

2. Methods

2.1. Participants

Our study participants were 21 third-grade pre-service teachers enrolled in the Department of Physical Education at Happy University, three PE teachers with more than 10 years of experience as PE teachers, and three PE teachers who are PhDs in sports education. To derive meaningful research results that meet the purpose of our study, we used objective sampling among the non-probability sampling methods. The participants had no previous experience of participating in teaching practice and guiding students in schools. However, they had completed major courses, such as Introduction to School Physical Education, Theory of Physical Education, Theory of Gymnastics, Theory of Soccer Guidance, Theory of Cross-Country Guidance, and Theory of Volleyball Guidance, as well as the different major courses and teaching courses required of students by the second semester of the third year, such as Introduction to Education, Psychological Aspects of Education, and Educational Technology.
We explained the purpose and necessity of the study to all pre-service teachers and guided the progress of the study. In particular, we emphasized that the feedback regarding teaching behavior and education on class video analysis, both provided according to the results of this study, was expected to help them improve their teaching abilities. Subsequently, the study was conducted with 21 pre-service teachers who voluntarily agreed to participate. Regarding the number of participants (pre- and in-service teachers), we calculated the number required for the Mann–Whitney U test using G-power 3.1.6 [25]. The standard for calculating the number of samples was set at a significance level of 0.05 and an effect size of 0.80. The analysis revealed that the minimum sample size for our study was 22 people.

2.2. Data Collection

This study was conducted from March 2022 to July 2022, the first semester of 2022. To evaluate the video demonstrations of pre-service PE teachers, we conducted lectures on efficient class operation and practice in the fifth session. This allowed us to enhance the participants’ understanding of the plan and operation of class demonstrations. In sessions six to eight, lesson plans completed by the participants were reviewed for feedback. In session nine, middle school PE class videos were shown to the participants, and class evaluation methods were taught using evaluation tools. After all class demonstrations, we evaluated the videos of class demonstrations by pre-service teachers in the classroom in the 14th session. The class with the best systematic plan and operation was selected and then evaluated by three experienced PE teachers, using the pre-service PE teacher teaching competency evaluation tool [17]. The specific evaluation tool item standards are shown in Table 1. Pre-service teachers completed the evaluation tool as they watched videos of class demonstrations. After completion, the evaluation papers were submitted to the instructor for data collection.

2.3. Data Analysis

First, we derived the descriptive statistics for the analysis of class demonstration evaluation results and assessed the level of skill in observing teaching competency by stage. Second, we analyzed the intra-correlation coefficient (ICC) to evaluate agreement between the evaluators [26]. Single measures of ICC are used to evaluate differences in outcomes between groups, and mean measures, differences from the mean [27]. ICC analysis can provide high validity and reliability in measuring the evaluation results of a small number of people [26], as shown in this study. Third, to identify differences between evaluation of in-service and pre-service teachers, we conducted a matrix analysis to visualize the results on coordinates based on the X-axis (in-service teachers) and Y-axis (pre-service teachers). The Mann–Whitney U test is a non-parametric test and can identify differences without requiring assumptions of normality and homogeneity of variance when parameter assumptions are not satisfied [28].

2.4. Inter-Rater Reliability

To confirm the reliability of the evaluators, we selected one of the pre-service teachers’ class demonstration videos and evaluated it three times. First, the evaluators received training on how to create evaluation tools. Second, the evaluation was conducted while watching the video. The evaluation was carried out three times, conducted at intervals of 30 min. Table 2 shows the ICC that we analyzed to investigate inter-rater reliability. We confirmed the reliability between raters.

2.5. Ethics

After explaining the purpose and necessity of the study to the participants, we provided each with a written IRB consent form for participation. The entire process of class demonstration was observed and operated to execute the study in accordance with the proposed plan. The data collected during the study were reviewed by with pre-service teachers. Additionally, peer debrief and triangulation were conducted with two PhDs in Sports Education who had interests in and conducted research on pre-service teacher education. This study was conducted after obtaining IRB approval (GINUEIRB-2021-005) from Gyeongin National University of Education in Korea.

3. Results

3.1. Class Preparation Stage

Figure 1 and Table 3 show the evaluation score on class preparation by in-service and pre-service teachers. The mean score difference between the two groups was 0.53 points. In detail, inter-rater agreement was observed in the order of “safety inspection of learning environment” (–0.04), “preparing learning materials” (0.76), and “securing teaching aids and space” (0.80). The Mann–Whitney U test showed a significant difference in “preparing learning materials” (U = 6.00, p = 0.05).

3.2. Introduction Stage

Figure 2 and Table 4 show the evaluation score on the introduction stage of class demonstration by in-service and pre-service teachers. The mean score difference between the two groups was 1.11 points. In detail, inter-rater agreement was observed in the order of “use of various questions” (0.41), “health check” (0.62), “establishment and introduction of learning organization” (0.73), “recall of previous lesson contents” (0.79), “motivation” (0.98), “smooth progress” (1.06), “warm-up activities” (1.09), “attention” (1.15), “use of demonstrations, media, and cues” (1.29), “attendance and dress check” (1.45), “use of adequate language” (1.47), and “safety education” (2.33). The Mann–Whitney U test showed a significant difference in “attendance and dress check” (U = 2.00, p = 0.01) and “warm-up activities” (U = 4.00, p = 0.01) of the routine activity domain and “attention” (U = 6.50, p = 0.05), “recall of previous lesson contents” (U = 9.00, p = 0.05), “use of demonstrations, media, and cues” (U = 4.50, p = 0.05), “use of adequate language” (U = 1.50, p = 0.01), and “safety education” (U = 0.00, p = 0.01) of the learning objectives and task presentation domain.

3.3. Development Stage

Figure 3 and Table 5 show the evaluation scores on the development stage of class demonstration by in-service and pre-service teachers. The mean score difference between the two groups was 0.64 points. In detail, inter-rater agreement was observed in the order of “adequacy of learning environment” (0.08), “use of appropriate teaching and learning methods” (0.09), “adequate use of teaching materials and media” (0.12), “presentation of various tasks” (−0.33), “inappropriate teaching behavior” (0.38), “providing feedback” (0.51), “appropriateness of task execution time” (0.51), “fair and equal treatment” (1.08), “efficient control and operation of class hours” (1.15), “teaching method based on the characteristics of learners” (1.39), and “establishing a communicative atmosphere” (1.41). The Mann–Whitney U test showed a significant difference in “teaching method based on the characteristics of learners” (U = 2.00, p = 0.01) of the class strategy domain. In the observation and interaction domain, we found significant differences in “establishing a communicative atmosphere” (U = 5.00, p = 0.05) and “fair and equal treatment” (U = 6.00, p = 0.05). The maintaining the learning environment domain showed a significant difference in “efficient control and operation of class hours” (U = 3.00, p = 0.01).

3.4. Conclusion Stage

Figure 4 and Table 6 show the evaluation score on the conclusion stage of class demonstration by in-service and pre-service teachers. The mean score difference between the two groups was 0.79 points. In detail, inter-rater agreement was observed in the order of “encouraging active participation of learners” (0.14), “cool-down activities” (−0.21), “preview of next lesson” (0.26), “learning transfer to daily life” (0.51), “confirming the understanding of learning contents” (−1.04), “efficient organization of learning materials” (1.14), and “injury check” (2.24). The Mann–Whitney U test showed a significant difference in “injury check” (U = 0.50, p = 0.01) of the routine activity domain and “confirming the understanding of learning contents” (U = 8.00, p = 0.05) of the summary and evaluation domain.

4. Discussion

We analyzed the differences in the characteristics of evaluation results for each stage of class demonstration between pre-service and in-service teachers. Both groups had the same evaluation scores for “securing teaching aids and space” and “safety inspection of learning environment” of the establishing a learning environment domain in the class preparation stage. This stage has the purpose of selecting an appropriate place for learning contents before class and creating a safe and enjoyable learning environment by using adequate teaching aids and facilities [29]. In pre-service teacher education, the importance of establishing a learning environment is emphasized for smooth class progression. Pre-service teachers are thought to have understood the knowledge needed to create a learning environment and experience the process of preparing a class, thereby accumulating the knowledge to distinguish teaching behaviors to create the necessary learning environment. As such, they showed similar results for the evaluation of class demonstration videos as in-service PE teachers.
However, inter-rater agreement was not observed for “preparing learning materials”. This suggests differences in the standards for using materials suitable for learning topics between pre-service and in-service teachers. Preparing learning materials involves organizing an appropriate space and preparing sufficient teaching aids, such as scoreboards and team vests, to facilitate task activities according to individual or group activities [30]. As such, the differences between the evaluation scores of pre-service and in-service teachers can be expected; the latter have abundant experience in preparing learning materials for teaching. Pre-service PE teachers can grasp the appropriate behavior of securing space for classes; however, they have not reached the same level of distinguishing teaching behaviors for preparing learning materials appropriate for various conditions.
In the routine activity domain, pre- and in-service PE teachers showed the same evaluation scores for “health check” and “smooth progression”, and discrepancies in the scores for “attendance and dress check” and “warm-up activities”. Routine activity refers to events that occur repeatedly in class, such as attendance check, dress check, and warm-up activities [31]. In-service PE teachers use various and interesting ways for attendance check and warm-up activities. In contrast, pre-service teachers conduct formal routine activities, which they consider as excellent teaching activities.
In the learning objectives and task presentation domain, pre-service and in-service teachers showed similar evaluation scores for “motivation”, “use of various questions”, and “organization”, and discrepancies in the scores for “attention”, “presenting learning tasks”, “use of demonstrations, media, and cues”, and “use of adequate language”. Task presentation plays a role in promoting active participation by effectively presenting learning topics and tasks to the learners [32]. This requires effective communication using language, demonstrations, and media. Effective teachers explain task presentations concisely and clearly, demonstrate with complete movements, use appropriate cues, and emphasize key contents [33]. In-service teachers may have given a moderate score for the use of different task presentation behaviors, whereas the pre-service teachers tended to overrate.
The pre-service and in-service PE teachers gave similar scores for “use of appropriate teaching and learning methods” and “presenting various tasks” in the teaching strategy domain of the development stage. In contrast, the two groups did not show an agreement for “teaching method based on the characteristics of learners”. The national PE curriculum suggests teaching and learning methods that consider the characteristics of learners [34]. Such teaching strategy tailored for the learners is an important factor in PE. However, since most pre-service PE teachers performed class demonstrations as secondary assistant teachers, they faced difficulties in understanding the characteristics of learners. Consequently, the pre-service teachers may have given high scores, in contrast to in-service teachers.
In the observation and interaction domain, intuitive teaching functions, such as “providing feedback” and “fair and equal treatment”, can be easily judged from videos of class demonstrations. However, pre-service teachers tended to overrate items that are learned through field experience, such as “establishing a communicative atmosphere”. In the maintaining the learning environment domain, pre-service teachers showed discrepancies in scores for “efficient control and operation of control hours” and similar scores for “appropriateness of task execution time”, “adequacy of learning environment”, “adequate use of teaching materials and media”, and “inappropriate teaching behavior” compared with the in-service teachers. Based on these findings, pre-service PE teachers showed a tendency to overrate instructional functions that involve direct interaction with learners, compared with in-service teachers. However, pre-service PE teachers had similar opinions as in-service teachers on skills that could be acquired from assisting fellow teachers.
Pre- and in-service PE teachers showed agreement in scores for “cool-down activities” and “efficient organization of teaching materials” in the routine activity domain of the conclusion stage while showing a discrepancy in the score for “injury check”. Injury check is directly related to the safety and health of students [35]. However, pre-service teachers may not have acquired knowledge on basic routine activities as in the introduction stage, thereby limiting their analysis of “injury check”.
Pre-service and in-service PE teachers showed similar scores for “encouraging active participation of learners”, “lesson transfer to daily life”, and “preview of next lesson” in the summary and evaluation domain while showing a discrepancy in the score for “confirming the understanding of learning contents”. This suggests that pre-service teachers tended to overrate the important educational activity of confirming the achievement of learning goals through reflective activities with students.
Thus, pre-service PE teachers had a high level of “knowledge for practice” in which universal concepts or propositional knowledge were represented in specific language and methods through class demonstrations. However, their level of “knowledge in practice”, which refers to knowledge that is internalized or newly acquired in practice through teaching, was judged to be low. Based on these problems of pre-service PE teachers’ class analysis ability, theory-oriented teacher education may not be helpful in cultivating pre-service teachers’ practical competence [36]. In pre-service teacher education, the dominance of “theory-centered teacher education” based on the technical rationalism model [37] is a major obstacle [21].
Therefore, rather than concentrating on education that highlights theory (knowing-that), education that harmoniously composes practical knowledge (knowing-how) is needed. As a way to increase the practical knowledge of pre-service PE teachers, Schon’s [38] cyclical view of teacher knowledge is limited. A plan to practice a balanced education of “knowledge for practice” and “knowledge in practice” is required. Based on our results, we urge the development of various models for class demonstration and evaluation in pre-service PE teacher education. Through the development and application of a model that integrates theory and practice, pre-service teacher education can move in the direction of cultivating the ability of preservice PE teachers to manage and analyze classes.

5. Conclusions and Suggestions

In our study, the pre-service teachers showed discrepancies in their evaluation scores for class demonstration videos and tended to overrate many items compared with in-service teachers. Such tendency was attributed to the low level of knowledge in pre-service teachers observing teaching behaviors required for different classes and may be related to a lack of practical teaching knowledge. Class demonstrations in pre-service PE teacher education in universities often depend on assistant teachers rather than actual students, similar to micro-teaching. Intuitive teaching function is the capacity to demonstrate and appropriately apply the learned contents as assistant teachers. However, teaching skills that require interaction with actual students or teaching behaviors acquired through field experience and presented as practical knowledge are difficult to demonstrate or evaluate. Therefore, in light of our findings, the following suggestions are presented to improve the teaching behavior analysis ability of pre-service PE teachers.
First, pre-service teachers should obtain higher levels of practical teaching knowledge. The lack of reliability in the evaluation results by pre-service teachers may be attributed to their limited knowledge to judge the level of teaching behavior. To analyze classes, the teacher must apply curriculum knowledge and teaching methods, as well as observe class environment and learner characteristics. Therefore, pre-service teacher education must provide effective training to cultivate practice-oriented pedagogical content knowledge required for PE teachers.
Second, institutions must establish a well-organized curriculum that can help pre-service teachers accumulate adequate knowledge and analysis skills for PE classes. Pre-service teachers often do not have opportunities to observe in-person or lead PE classes at schools. Therefore, they must be sustainably provided with opportunities to spectate PE classes led by excellent in-service teachers and learn professional PE class management skills and standards.
Based on our findings, suggestions for follow-up studies are as follows. Future studies must explore the value of self-reflective activities according to class evaluations to confirm the value of evaluation tools from the perspective of pre-service teachers. Additionally, studies must combine and apply systematic observation methods for analysis of teaching behavior. Using teaching behavior analysis tools, such as duration recording, QMTPS, and Cheffers’ Adaptation to Flanders’ Interaction Analysis System, will increase the reliability and validity of data in follow-up studies.
Finally, this study has the following limitations. First, it was conducted with pre-service teachers, and second, it included a small number of in-service teachers at a specific university. Future research should target a large number of pre-service and in-service teachers across various teacher education institutions. This can reduce the error of the sample. Further, more interesting results can be derived by using the statistical method of parameters.

Author Contributions

Conceptualization, C.-M.K., J.-H.J. and H.-S.Y.; methodology, C.-M.K., M.-J.K. and H.-S.Y.; writing, original draft preparation, C.-M.K., J.-H.J. and H.-S.Y.; writing, review and editing, C.-M.K., J.-H.J., H.-S.Y. and M.-J.K.; visualization, M.-J.K. and H.-S.Y.; supervision, all authors. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Research Foundation of Korea (NRF-2020S1A5B5A17091060).

Institutional Review Board Statement

This study was conducted in accordance with the guidelines of the Declaration of Helsinki and approved by the Institutional Review Board of Gyeongin National University of Education in Korea (GINUEIRB-2021-005).

Informed Consent Statement

Informed consent was obtained from all the subjects involved in the study.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Kim, C.M. Development of Physical Education Teachers’ Teaching Competency Evaluation Tool and Application. Ph.D. Thesis, Kyung Hee University, Yongin, Republic of Korea, 2019. [Google Scholar]
  2. Zach, S.; Harari, I.; Harari, N. Changes in teaching efficacy of pre-service teachers in physical education. Phys. Educ. Sport Pedagog. 2012, 17, 447–462. [Google Scholar] [CrossRef]
  3. Kim, W.J. Study of self-reflective process on pre-service physical education teachers’ microteaching. Korean J. Sport Pedagog. 2010, 17, 25–52. [Google Scholar]
  4. Jeon, S.; Hong, A.; Jung, H. Formation Process and Characteristics of Preliminary Physical Education Teachers’ Micro-teaching Experience and Professional Identity. Korean J. Sport Pedagog. 2017, 24, 105–129. [Google Scholar] [CrossRef]
  5. Saban, A.; Çoklar, A.N. Pre-service teachers’ opinions about the micro-teaching method in teaching practice classes. Turkish Online J. Educ. Technol. 2013, 12, 234–240. [Google Scholar]
  6. Ryu, M.J. Understanding the experiences of pre-service teachers in self-analysis and self-evaluation and its meaning in video-assistant micro-teaching class. J. Res. Curric. Instr. 2019, 23, 83–95. [Google Scholar] [CrossRef]
  7. Kwak, E.C.; Kim, C.M. Exploring the educational possibility of teaching evaluation system in pre-service physical education teacher education program. J. Learn.-Cent. Curric. Instr. 2020, 20, 493–517. [Google Scholar] [CrossRef]
  8. Park, J.J.; Choi, E.C. Understanding the pre-service PE teacher’s practical knowledge through reflective micro-teaching. Korean J. Sport Sci. 2010, 21, 1595–1614. [Google Scholar] [CrossRef]
  9. Hunt, K.; Gurvitch, R.; Lund, J.L. Teacher evaluation: Done to you or with you? J. Phys. Educ. Recreat. Danc. 2016, 87, 21–27. [Google Scholar] [CrossRef]
  10. Yalcin Arslan, F. Reflection in pre-service teacher education: Exploring the nature of four EFL pre-service teachers’ reflections. Reflective Pract. 2019, 20, 111–124. [Google Scholar] [CrossRef]
  11. Boud, D. The role of self-assessment in student grading. Assess. Eval. High. Edu. 1999, 14, 20–30. [Google Scholar] [CrossRef]
  12. National Association for Sport and Physical Education. Physical Education Teacher Evaluation Tool; NASPE: Reston, VA, USA, 2007. [Google Scholar]
  13. SHAPE America. National Standards for Initial Physical Education Teacher Education. Available online: https://www.shapeamerica.org/accreditation/upload/2017-SHAPE-America-Initial-PETEStandards-and-Components.pdf (accessed on 13 January 2022).
  14. National Board for Professional Teaching Standards (NBPTS). Physical Education Standards; NBPTS: Reston, VA, USA, 2014. [Google Scholar]
  15. Kyrgiridis, P.; Derri, V.; Emmanouilidou, K.; Chlapoutaki, E.; Kioumourtzoglou, E. Development of a questionnaire for self-evaluation of teacher effectiveness in physical education (SETEQ-PE). Meas. Phys. Educ. Exerc. Sci. 2014, 18, 73–90. [Google Scholar] [CrossRef]
  16. Rink, J.; Werner, P. Qualitative Measures of Teaching performance-scale (QMTPS). In Analyzing Physical Education and Sport Instruction; Darst, P., Zakrajek, D., Mancini, V., Eds.; Human Kinetics: Champaign, IL, USA, 1989. [Google Scholar]
  17. Kim, C.M.; Kwak, E.C. An exploration of a reflective evaluation tool for the teaching competency of pre-service physical education teachers in Korea. Sustainability 2022, 14, 8195. [Google Scholar] [CrossRef]
  18. Chamoso, J.M.; Cáceres, M.J.; Azcárate, P. Reflection on the teaching-learning process in the initial training of teachers. Characterization of the issues on which pre-service mathematics teachers reflect. Teach. Teach. Educ. 2012, 28, 154–164. [Google Scholar] [CrossRef]
  19. Darling-Hammond, L.; Bransford, J.; LePage, P.; Hammerness, K.; Duffy, H. Preparing Teachers for a Changing World: What Teachers Should Learn and Be Able to Do; Jossey-Bass: San Francisco, CA, USA, 2005. [Google Scholar]
  20. Greenburg, A.D. A Comparison of Problems Confronting Male High School Physical Education Teachers in an Inner-City and in Suburban Area. Ph.D. Thesis, University of Illinois, Chicago, IL, USA, 1970. [Google Scholar]
  21. Korthagen, F.A.J. Linking Practice and Theory: The Pedagogy of Realistic Teacher Education; Lawrence Erlbaum Associates Publishers: London, UK, 2001. [Google Scholar]
  22. Nolan, J.; Hoover, L.A. Teacher Supervision and Evaluation; John Wiley & Sons, Inc.: New York, NY, USA, 2004. [Google Scholar]
  23. So, W.-M.W.; Pow, J.; Hung, V.H.-K. The interactive use of a video database in teacher education: Creating a knowledge base for teaching through a learning community. Comput. Educ. 2009, 53, 775–786. [Google Scholar] [CrossRef]
  24. Borko, H.; Jacobs, J.; Eiteljorg, E.; Pittman, M.E. Video as a tool for fostering productive discussions in mathematics professional development. Teach. Teach. Educ. 2008, 24, 417–436. [Google Scholar] [CrossRef]
  25. Faul, F.; Erdfelder, E.; Buchner, A.; Lang, A.G. Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 2009, 41, 1149–1160. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Mehta, S.; Bastero-Caballero, R.F.; Sun, Y.; Zhu, R.; Murphy, D.K.; Hardas, B.; Koch, G. Performance of intra class correlation coefficient (ICC) as a reliability index under various distributions in scale reliability studies. Stat. Med. 2018, 37, 2734–2752. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Bujang, M.A.; Baharum, N. A simplified guide to determination of sample size requirements for estimating the value of intraclass correlation coefficient: A review. Arch. Orofac. Sci. 2017, 12, 1–11. [Google Scholar]
  28. Park, S.I.; Lee, Y.W. Hypothesis testing: Means and proportions. J. Vet. Clin. 2009, 26, 401–407. [Google Scholar]
  29. Siedentop, D.; Tannehill, D. Developing Teaching Skills in Physical Education, 4th ed.; Mayfield: Mountain View, CA, USA, 1999. [Google Scholar]
  30. Grube, D.; Ryan, S.; Lowell, S.; Stringer, A. Effective classroom management in physical education: Strategies for beginning teachers. J. Phys. Educ. Recreat. Dance 2018, 89, 47–52. [Google Scholar] [CrossRef]
  31. Werner, P.; Rink, J. Case studies of teacher effectiveness in second grade physical education. J. Teach. Phys. Educ. 1989, 8, 280–297. [Google Scholar] [CrossRef]
  32. Rink, J. Teaching Physical Education for Learning, 7th ed.; McGraw-Hill: Boston, MA, USA, 2014. [Google Scholar]
  33. Roehler, L.R.; Duffy, G.G.; Herrmann, B.A.; Conley, M.; Johnson, J. Knowledge structures as evidence of the ‘personal’: Bridging the gap from thought to practice. J. Curric. Stud. 1988, 20, 159–165. [Google Scholar] [CrossRef]
  34. Korean Ministry of Education. 2015 National Curriculum for Physical Education; Ministry of Education: Sejong-si, Republic of Korea, 2015.
  35. Metzler, M.W. Instructional Models for Physical Education, 3rd ed.; Routledge: New York, NY, USA, 2017. [Google Scholar]
  36. So, K.H. Teacher learning: How and what teachers learn. J. Curric. Stud. 2009, 27, 107–126. [Google Scholar] [CrossRef]
  37. Schon, D.A. The Reflective Practitioner; Jossey-Bass: San Francisco, CA, USA, 1983. [Google Scholar]
  38. Schön, D.A. Educating the Reflective Practitioner: Toward a New Design for Teaching and Learning in the Professions; Jossey-Bass: San Francisco, CA, USA, 1987. [Google Scholar]
Figure 1. Comparison of detailed evaluation items in class preparation stage.
Figure 1. Comparison of detailed evaluation items in class preparation stage.
Sustainability 15 02183 g001
Figure 2. Comparison of detailed evaluation items in introduction stage.
Figure 2. Comparison of detailed evaluation items in introduction stage.
Sustainability 15 02183 g002
Figure 3. Comparison of detailed evaluation items in development stage.
Figure 3. Comparison of detailed evaluation items in development stage.
Sustainability 15 02183 g003
Figure 4. Comparison of detailed evaluation items in conclusion stage.
Figure 4. Comparison of detailed evaluation items in conclusion stage.
Sustainability 15 02183 g004
Table 1. Items for each teaching evaluation domain.
Table 1. Items for each teaching evaluation domain.
StageDomainEvaluation Contents
Class preparationEstablishing a learning environmentSecuring teaching aids and space
Safety inspection of learning environment
Preparing learning materials
IntroductionRoutine activityAttendance and dress check
Health check
Warm-up activities
Smooth progress
Learning objectives and task presentationAttention
Recall of previous lesson contents
Use of demonstrations, media, and cues
Use of adequate language
Motivation
Use of various questions
Establishment and introduction of learning organization
Safety education
DevelopmentClass strategyUse of appropriate teaching and learning methods
Teaching method based on the characteristics of learners
Presenting various tasks
Observation and interactionProviding feedback
Establishing a communicative atmosphere
Fair and equal treatment
Maintaining the learning environmentAdequacy of learning environment
Efficient control and operation of class hours
Appropriateness of task execution time
Adequate use of teaching materials and media
Inappropriate teaching behavior
ConclusionRoutine activityCool-down activities
Injury check
Efficient organization of learning materials
Summary and evaluationConfirming understanding of learning contents
Encouraging active participation of learners
Learning transfer to daily life
Preview of next lesson
Total33 items
Table 2. Inter-rater reliability analysis.
Table 2. Inter-rater reliability analysis.
ClassificationICC Value95% Confidence IntervalF Test
Lower BoundUpper Bound Significance (p-Value)
Single measures0.5080.3010.6944.0250.000
Mean measures0.7560.5640.8724.0250.000
Table 3. Analysis of class preparation stage.
Table 3. Analysis of class preparation stage.
Class StageDomainDetailed ItemIn-Service Teachers
(n = 3)
Pre-Service Teachers
(n = 21)
GAPUZp
MSDMSD
Class preparationEstablishing a learning environmentSecuring teaching aids and space3.670.584.470.720.8010.00−1.8000.072
Safety inspection of learning environment4.330.584.290.59−0.0425.00−0.0610.951
Preparing learning materials4.000.004.760.440.766.00−2.4950.013 *
Total (M)4.004.510.53
* p < 0.05. GAP: Gap between X and Y, U: Mann–Whitney test, Z: Z-value.
Table 4. Introduction stage analysis.
Table 4. Introduction stage analysis.
Class StageDomainDetailed ItemIn-Service Teachers
(n = 3)
Pre-Service Teachers
(n = 21)
GAPUZp
MSDMSD
Introduction stageRoutine activityAttendance and dress check2.670.584.120.601.45 2.00−2.7480.006 **
Health check3.670.584.290.470.62 12.00−1.7820.075
Warm-up activities3.670.584.760.441.09 4.00−2.7200.007 **
Smooth progress3.000.004.060.831.06 6.00−2.2010.028 *
Learning objectives and task
presentation
Attention2.670.583.820.811.15 6.50−2.1440.032 *
Recall of previous lesson contents3.330.584.120.700.79 9.00−2.0610.039 *
Use of demonstrations, media, and cues3.000.004.290.771.29 4.50−2.3640.018 *
Use of adequate language3.000.004.470.621.47 1.50−2.7390.006 **
Motivation2.670.583.651.000.98 11.00−1.6080.108
Use of various questions3.001.003.410.870.41 19.00−0.7350.462
Establishment and introduction of learning organization 3.330.584.060.750.73 10.50−1.8040.071
Safety education1.670.584.000.792.33 0.00−2.8030.005 **
Total (M)2.974.091.11
* p < 0.05, ** p < 0.01. GAP: Gap between X and Y, U: Mann–Whitney test, Z: Z-value.
Table 5. Development stage analysis.
Table 5. Development stage analysis.
Class StageDomainDetailed ItemIn-Service Teachers
(n = 3)
Pre-Service Teachers
(n = 21)
GAPUZp
MSDMSD
Development stageClass strategyUse of appropriate teaching and learning methods3.670.583.760.660.0924.00−0.1780.858
Teaching method based on the characteristics of learners2.670.584.060.561.392.00−2.8270.005 **
Presenting various tasks4.330.584.000.87−0.3320.50−0.5750.565
Observation and interactionProviding feedback3.670.584.180.530.5114.50−1.4450.149
Establishing a communicative atmosphere3.001.004.410.511.415.00−2.4380.015 *
Fair and equal treatment3.330.584.410.621.086.00−2.2470.025 *
Maintaining the learning environmentAdequacy of learning environment4.330.584.410.800.0821.50−0.4780.633
Efficient control and operation of class hours3.670.584.820.391.153.00−2.9700.003 **
Appropriateness of task execution time3.670.584.180.810.5114.50−1.2960.195
Adequate use of teaching materials and media4.000.004.120.600.1222.50−0.3940.694
Inappropriate teaching behavior3.330.583.710.850.3818.50−0.7940.427
Total (M)3.614.190.64
* p < 0.05, ** p < 0.01. GAP: Gap between X and Y, U: Mann–Whitney test, Z: Z-value.
Table 6. Conclusion stage analysis.
Table 6. Conclusion stage analysis.
Class StageDomainDetailed ItemIn-Service Teachers
(n = 3)
Pre-Service Teachers
(n = 21)
GAPUZp
MSDMSD
Conclusion stageRoutine
activity
Cool-down activities4.330.584.120.70−0.2122.00−0.4620.644
Injury check2.001.004.240.562.24 0.50−2.9240.003 **
Efficient organization of learning materials2.331.153.470.941.14 10.00−1.7680.077
Summary and evaluationConfirming the understanding of learning contents4.330.583.290.77−1.048.00−2.0130.044 *
Encouraging active participation of learners4.330.584.470.620.14 21.50−0.4780.633
Lesson transfer to daily life3.670.584.180.880.51 16.50−1.0130.311
Preview of next lesson 4.330.584.590.510.26 19.00−0.7970.425
Total (M)3.624.050.79
* p < 0.05, ** p < 0.01. GAP: Gap between X and Y, U: Mann-Whitney test, Z: Z-value.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Kim, C.-M.; Kim, M.-J.; Youn, H.-S.; Jung, J.-H. Exploring Skills in Observing Teaching Competency through Video Evaluation of Class Demonstrations by Pre-Service Physical Education Teachers. Sustainability 2023, 15, 2183. https://doi.org/10.3390/su15032183

AMA Style

Kim C-M, Kim M-J, Youn H-S, Jung J-H. Exploring Skills in Observing Teaching Competency through Video Evaluation of Class Demonstrations by Pre-Service Physical Education Teachers. Sustainability. 2023; 15(3):2183. https://doi.org/10.3390/su15032183

Chicago/Turabian Style

Kim, Chul-Min, Min-Jun Kim, Hyun-Su Youn, and Joo-Hyug Jung. 2023. "Exploring Skills in Observing Teaching Competency through Video Evaluation of Class Demonstrations by Pre-Service Physical Education Teachers" Sustainability 15, no. 3: 2183. https://doi.org/10.3390/su15032183

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop