50 The  materials  were  selected  based  on  school  based  curriculum  which  is
KTSP
Kurikulum  Tingkat  Satuan  Pendidikan
.  The  writer  designed  eight materials because it they were enough for speaking materials in semester 2.
After  finishing  the  eight  materials  for  the  designed  materials,  then  the writer looked  for evaluators and  asked  about  the  designed  materials. The  further
explanation will be discussed in the next part.
8. Evaluating the Designed Materials
After  designing  the  materials,  the  writer  distributed  the  questionnaire  to the  evaluators  to  find  out  the  opinion  and  suggestion  on  the  designed  materials.
Questionnaires  were  aimed  to  get  feedback  to  improve  the  materials.  Those included the designed materials, the syllabus, and the example of the lesson plan.
The questionnaires were distributed to five evaluators on May 2
nd
2016 and May 14
th
,  2016  and  were  collected  a  week  after.  Questionnaires  consisted  of  fifteen statements  in  close-ended  questionnaire  and  four  questions  in  open-ended
questionnaire. See appendix D.
a. The Description of the Evaluators
The evaluators were three English teachers of SMA N 1 Ngaglik and two lecturers  of  English  Language  Education  Study  Program  ELESP  of  Sanata
Dharma University. The evaluators gave judgments whether the proposed of a set of  instructional  materials  was  accepted  or  not.  The  table  below  describes  the
evaluators ‟ background of the post designed survey.
51
Table 4.4: The result of pre-design survey
Evaluators Educational Background
Teaching Experience in Years
S1 S2
S3 Other
5 5-10
10-15 15
Teacher A 
 Teacher B
 
Teacher C 
 Lecture A
 
Lecture B 
This  table  shows  about  the  educational  background  and  the  teaching experience  of  each  evaluator.  It  shows  that  all  of  the  evaluator  had  teaching
experience  more  than  5  years  and  it  proved  that  they  had  experienced  about teaching  and  how  to  solve  some  problems  regarding  to  the  students  need.  The
educational  backgrounds  from  all  of  the  evaluators  were  good.  One  of  the evaluators had bachelor degree, three of the evaluators had master degree, and one
of  the  evaluators  had  doctoral  degree.  It  meant  that  they  could  give  some suggestions, opinions, and criticism toward the writer‟s designed materials.
b. The Data Presentation of the Result
There  were  two  kinds  of  data  to  be  presented  in  this  section,  since  the questionnaires  which  are  distributed  consisted  of  closed-form  and  open-form
items.  The  first  data  presented  in  form  of  level  of  agreements  as  closed-form items. The number and degree of agreement are described as follows.
1= Strongly Disagree 2= Disagree
3= Agree 4= Strongly Agree