The Description of the Preliminary Field Testing of the Design Model The Data Presentation

101

2. Preliminary Field Testing

After designing the preliminary product model, the researcher administered the post-design survey that was an evaluation of the designed model so-called designed model prototype. In this study, the researcher gathered the evaluators’ opinions, feedbacks, and suggestions as the basis for revising and producing final product of the product. In this section, the researcher presents the data gathered from the evaluation. Fourteen questionnaires were distributed to fourteen evaluators. The evaluators consisted of thirteen lecturers of different University in Jogjakarta, another evaluator has some experiences in teaching in public school. Eight of the evaluators were still studying in the Graduate Program of English Language Studies of Sanata Dharma University. The discussion on the description of the respondents and the data presentation are as follows:

a. The Description of the Preliminary Field Testing of the Design Model

The description of the preliminary field testing respondents of the designed model is presented in the table 4.9. Table 4.9. The Description of the Preliminary Field Testing of the Designed Model Respondents Sex Educational Background Teaching Experience in year F M S1 S2 S3 ≤ 5 ≥ 5 English lecturer 12 1 6 7 - 6 7 English teacher - 1 - 1 - 1 - 102

b. The Data Presentation

The data for this subsection is acquired from the evaluation of the material design by distributing the evaluation questionnaires. There are two parts that will be discussed in this subsection, namely the Descriptive Statistics of Participants ’ opinions on the Designed Model and the Participants ’ Comments and Suggestions on the Designed Model. 1 The Descriptive Statistics of Participants’ Opinions on the Prototype Designed Model This part presents the respondents’ opinion on the designed model by stating their agreement, disagreement, and doubt by choosing one of five points of correlation and agreement. The questionnaire is intended to obtain feedback about the appropriateness of the English Language Teacher Reflection Towards Teaching Development. The questionnaire was divided into two parts of statistical data gathering. Firstly, the statistical descriptions will show the degree of correlation between the designed model and the teaching development. Secondly, another statistical descriptions will define the degree of the participants agreement about the applicability of the designed model. The following table is the table of point of the degree of correlationagreement towards the product. Table 4.10. Meaning of Point of CorrelationAgreement Point of CorrelationAgreement Meaning 1 Very Low CorrelationStrongly Disagree 2 Low CorrelationDisagree 3 Doubt 4 High CorrelationAgree 5 Very High CorrelationStrongly Agree 103 Subsequently, the following is the table of the Descriptive Statistics of correlation between the designed model and the teaching development. Table 4.11. The Descriptive Statistics of Correlation between the Designed Model and the Teaching Development No . Statements Frequency of points of correlation Central Tendency 1 2 3 4 5 N M 1. Foreign and second language acquisition - - 1 12 1 14 4 2. Theory of foreign language teaching - - 4 6 4 14 4 3. Methodology of teaching English as a foreign language - - 1 8 5 14 4.3 4. The concept of Indonesian National Curriculum of 2013 - - 8 4 2 14 3.6 5. Conducting a lesson in English Teaching - - - 6 8 14 4.6 Total - - 14 36 20 Mean 4,1 Good After the data were calculated and analyzed, it was found that the results of the correlation between the functionality of the product and teaching development were quite satisfying. From the respondents’ opinions on the designed model, it was found out that the average point of the central tendency is 4.1 from the scale 5.0. It indicates that the designed model is relevant as a means of English language teacher reflective teaching. There is another Descriptive Statistics of respondents opinions that will highlight the degree of agreement towards the applicability of the product for the English language teachers. The following is the table of the second Descriptive Statistics of the participants agreement about the applicability of the designed model. 104 Table 4.12. The Descriptive Statistics of The Participants Agreement about the Applicability of the Designed Model No . Statements Frequency of points of agreement Central Tendency 1 2 3 4 5 N M 1. The product helps teachers think about different aspects of teacher education. - - 3 5 6 14 4.2 2. The product helps teachers to understand what competences a teacher of foreign languages should have. - - - 6 8 14 4.6 3. The product helps teachers aware of the competences they have developed as well as those they still need to develop. - - - 5 9 14 4.6 4. The product helps teachers to understand the relationship between underlying knowledge and practical skills in the process of teaching. - - 1 8 5 14 4.3 5. The product is a good instrument for the self-assessment of teacher competences. - - - 5 9 14 4.6 6. The product is a useful teaching and learning device. - - 5 5 4 14 3.9 Total - - 9 34 41 Mean 4,3 Good After the second part of the questionnaire data were calculated and analyzed, it was found that the results of the applicability of the product for the English language teachers were also not disappointing. From the respondents’ opinions on the designed model, it was found out that the average point of the central tendency is 4.3 from the scale 5.0. It indicates that the designed model is applicable as a means of English language teacher reflective teaching. However, there was a need to conduct more exploration on the existing part of the design based on the respondents’ comments and suggestions. 105 2 The Participants’ Comments and Suggestions on the Designed Model Prototype This part elaborates the respondents’ comments and suggestions on the designed model by providing them eight open-ended questions. The purpose of those questions is to give as much freedom to the respondents to state their mind about the designed model. From the open-ended questions, the respondents stated that the designed model had an interesting layout and various reflection items that cover a lot of teaching development aspects. All participants stated that the presentation of the reflection sections was complete and encouraging. However, there was a need to conduct more exploration on the existing part of the design based on the respondents’ comments and suggestions. The respondents’ comments and suggestions are summarized and presented in table 4.13. Table 4.13. The Participant s’ Comments and Suggestions No. Parts of the drawbacks Types of Drawbacks Suggestions 1 Contents Reflections on the curriculum 2013 are not specific enough Highlight more specific reflections on new curriculum Administering such reflection is still a big challenge for English language teachers Put more emphasis on the reasons why teachers really need to use this tool Some reflection descriptors use unfamiliar terms that might be barely understandable for English language teachers Simplify some descriptor statements in several sections to make it more comprehensible 2 Instructions Grading indicators of the self-reflection assessment are inadequately clear and formal. Put a clearer and formal grading indicators as well as descriptive definitions for each score in the grading indicators so the teachers will be aware of the required standard in teaching English 106

3. Main Product Revision