Developing the Video Animation-based Material

b. Expert Validation

After developing the product, a formative evaluation was conducted. Morrison, Ross, Kalman, Kemp 2011, p. 274 state that “formative evaluation is the quality control of the development process”. The materials thus would be verified by the expert to know how well the designed materials. This step is called as expert validation. To validate the designed materials, the researcher distributed close and open-ended questionnaires for experienced lecturers and English teachers. The experts’ opinions, feedback and suggestions are really helpful to identify, to eliminate, and to modify existing materials. In other words, formative evaluation result was used as a basis for developing the existing materials. There were two English lecturers and two English teachers in this study. They were selected concerning their experience and expertise. They are English Lecturers in English Language Study Program, Sanata Dharma University. The first participant has been teaching English for more than 23 years. Right now she teaches English for Young Learners subject for graduate students. Meanwhile, the second participant has been teaching for about 15 years. Foundation in English Education and Program and Material Development are two subjects he taught. Both the lectures are experts in designing the materials. They have designed many books for schools. The third was an English teacher for young learners. She teaches in SD Negeri Purwomartani Kalasan and Jomblang 1 Berbah. The last expert was a teacher in Kanisius Elementary school Kulon Progo and UKDW University. She is also a fourth semester graduate student in Sanata Dharma University. PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI The questionnaire for experts consists of 23 closed-ended questions and 4 open-ended questions. The questionnaire was intended to validate the design of listening and speaking activities and the applicability of CALL principles. The questionnaire for the English teacher was distributed on Monday, April 4 th , 2016, whereas for the English lecturer was done on Tuesday, April 12 th , 2016. Table 4.8 Meaning of Point of Agreement Meaning of Scores Converted Scores Strongly Agree 5 Agree 4 Undecided 3 Disagree 2 Strongly Disagree 1 As can be seen in the table above, the questionnaire was a Likert Scale questionnaire, with 5 responses. The result score of the questionnaire was converted to find out the interpretation and meaning. There were five answers provided; i.e. Strongly Agree, Agree, Undecided, Disagree, and Strongly Disagree. The result then can be interpreted as the following table. Table 4.9 Quantitative Data Conversion Sudijono, 2009, p. 175 From the table above, the score range is categorized into 1-5. It can be seen that if the mean score was above 4.6, it was considered as very good. It means that the design did not need any revision. Then, if the mean was in the range 3.6 – 4.5, it means the revision was optional. After that, the design was fair but still need to be modified in some parts of the design if the range of mean score was in the range 2.6 – 3.5. Next, if the score was in the range 1.6 – 2.5, it was considered poor and recommended to revise some parts. Lastly, if the mean score was under 1.5, it means that the design was considered as very poor. Thus, it definitely needed to have a total revision. The following table is the result of expert validation questionnaire. Table 4.10 Result of Expert Validation Questionnaire No. Statements Mean M 1. The topics are related with the syllabus. 3.75 2. The materials are suitable with the student s’ needs. 4.25 3. The materials are arranged systematically. 4 4. The learning outcomes are clearly stated. 3 5. The input is meaningful and relevant content. 3.5 6. The input is attractive in motivating students to view. 3.75 7. The input presents a simple new language and ideas. 3.75 8. The designed materials enable students to understand more about the topics. 3.5 9. The input can make the students enjoy learning process. 3.5 10. The designed materials provide enough chunks of language. 4 11. The designed materials provide clear pronunciation. 3.5 12. The designed materials encourage students to use self- corrections to improve the clarity of production. 3.25 13. The designed materials help the students using facial expression and body language to convey meaning. 3 14. The designed materials teach grammar implicitly. 3.75 PLAGIAT MERUPAKAN TINDAKAN TIDAK TERPUJI 15. The designed materials encourage the students to produce language according to the situations. 3.75 16. The designed materials encourage interaction between students and students and between students and teacher. 3.5 17. The designed materials support learners in learning language with different ways of learning. 4.25 18. The designed materials encourage the students to produce varied and creative language. 4.25 19. The designed materials offer opportunities to students to interact and negotiate meaning. 3.5 20. The designed materials promote students to evaluate their own work and to give feedback to the other students of the class. 3.75 21. The designed materials establish an ideal classroom atmosphere. 3.75 22. The designed materials provoke the learner autonomy. 3.5 23. The designed materials provide authentic tasks. 3.5 Total Score 84.25 Mean 3.66 In the table above, the average point of central tendency on the expert validation questionnaire was 3.66 from the scale 5.00. It is interpreted as good. However, there were certain parts which still need to be revised and modified. Firstly, on the first statement, it can be seen that the mean score was 3.75. It means that the topics are related to the syllabus. However, one of expert mentioned that there were some parts were incompleted so that, several parts need to be included in the design. In line with the syllabus, the designed materials were suitable for the learners’ needs since the researcher conducted needs analysis and document analysis before designing the materials. It was proved from the result that the mean score was 4.25 which considered as good. From this result, there was no revision regarding the students’ needs. The next statement was about the learning outcomes. The mean score was 3. It reflected that the learning outcomes were clearly stated. This result was considered as good. However, it still needs an exploration on the design for the improvement of the design. From the result of the discussion with the experts, they suggested clarifying the objectives of each topic. It aims to reach the learning goal successfully and make the learning process more purposeful. Thus the researcher made some changes to the learning objectives. Another component which still needs some attentions was statement number 13. The participants of the expert validation said that the video animation has not yet helped the students using facial expression and body language to convey meaning. During designing the materials, the researcher just considered that video animation maker has very limited of facial expression and body language. It made the characters in the video animation did not act the language out expressively like what human do. Therefore, to overcome this problem, the researcher creates such activities that use actions to make the meaning of the words clear and to help the students more understand about the language. According to Moon, 2006, physical activity will help children to construct their understanding the language. She also adds that physical activity provides children with exposure to meaningful input. The second part of the questionnaire was open-ended questions. Generally, the participants argued that the designed materials were fascinating and appropriate for young learners, interesting, and providing the simplicity of the language. In addition, it provides opportunities for the teacher to provide a better context of the language. Nevertheless, there were some comments and suggestions