23 namely formative evaluation of the design materials. This step conducted through
the expert validation by distributing the evaluation questionnaire to the lecturers of English Language Education Study Program of Sanata Dharma University and
the English teacher of SMKN 1 Nanggulan.
D. Instruments and Data Gathering Technique
The data gathering was conducted twice: before designing the material pre-design and after designing the materials post-design. During pre-design
study, two instruments were used: interview and pre-design questionnaire. According to Ary, Jacobs and Razavieh 2002, interview is one of the
most widely used methods to gather the data on subjects’ opinion, beliefs and feelings. The writer used informal interview to gather the data about students’
needs. The interview was con ducted to give additional data about students’ need,
behavior and characteristics. The writer interviewed the English teacher of SMKN 1 Nanggulan
. The interview was conducted in May 2013. In order to design appropriate materials questionnaire was used to gather
the data about the students’ needs. According to Seliger and Shohamy 1989, a questionnaire is a printed form of data collection which contains questions or
statements for subject to respond. Ary, Jacobs and Razavieh 2002 said that there are two types of questionnaires; structured and unstructured questionnaires. A
structured questionnaire contains the questions and alternative answers to them. While unstructured questionnaire does not contain the alternative answers so the
respondents can answer freely.
24 The writer implemented structured questionnaire in the pre-design study.
This questionnaire was distributed during the research and information collecting step.
This questionnaire aimed to collect the learners’ needs and characteristics. Meanwhile, in the post-design study, the second questionnaire was
evaluation questionnaire. The questionnaire was distributed together with the designed materials to the English teacher and lecturers of English Language
Education Study Program Sanata Dharma University to assess the designed materials. The questionnaire consisted of two parts. In the first part the
respondents stated their degree of agreement of the statements and in the second part the respondents wrote down their opinions and suggestions to improve the
designed materials.
E. Data Analysis Technique
They are two important things to be discussed in this part, data analysis technique of pre-design study and data analysis technique of post-design study.
1. Data Analysis Technique of Pre-design Study
In the pre-design study, the analysis of the data was aimed to find the student
s’ needs and interest in speaking English. The questionnaires were distributed to the students in the
form of structured questions. Each participant’s opinion of the questionnaires was calculated in percentage as most people find it
easier to understand data in percentage than in raw frequencies Brown and Rodgers, 2002.