implementation of the designed materials. The evaluation, then, was used to revise the designed materials into final version.
The type of data would be described in the following table. The table covers the summary of steps in which the writer gathered data; the type of data
that would be obtained; the instruments that would be used; and the sources of the data.
Table 3.1 : The Type of Data
Step Type of Data
Instrument Sources
Research and Information
Collecting
1. Students’ characteristics
2. Students’ needs
3. Students’ motivation
4. Students’ strength and weakness
5. Basis of listening activities
6. Listening activities in class
7. Learning techniques and activities
8. Materials, media and topic choice
9. Learning difficulties
10. Expectation toward this study
Interview -
Teachers -
Students
Preliminary Product
Verification
1. Evaluation of the designed
materials: a.
Major goals of the designed materials
b. Explanation of the content,
tasks and activities c.
Relevance between the designed materials with
students’ level and students’ program
d. Concordance between the level
of difficulty with what should a.
Closed-form Questionnaire
b. Interview
- Teachers
- Lectures
Step Type of Data
Instrument Sources
be given to students e.
Relevance between activities and the topic
f. Effectiveness of tasks and
activities to facilitate students in achieving the goals
g. The instruction of each task in
the designed materials h.
Variety of task i.
Effectiveness of media and another additional materials
2. Opinion and suggestion toward the designed materials
Main Field Testing
a. evaluation on the designed
materials and the implementation a.
Students’ interest of the materials
b. comprehension of the materials
c. clearness of the listening
materials and the instruction d.
relation between materials and students’ vocational program
e. the most interesting part
f. the most difficult part
2. Opinion and suggestion toward the designed materials and the
implementation Questionnaire:
- open form
- closed form
Students
D. Research Instruments
This study applied two types of instruments to gather data. There were interviews and questionnaires. The interviews were used in Research and
Information Collecting and Preliminary Product Testing, while the questionnaires were used in Preliminary Product Testing and Main Field Testing.
1. Instrument for Research and Information Collecting
The writer conducted interviews for obtaining the data in Research and
Information Collecting step. Interviews were intended to English teachers and
second year students of Visual Communication Design Program in SMKN 5 Yogyakarta. The interviews were conducted in informal way to create familiarity
among the writer and the participants. The interviews were aimed to gain information about students’ characteristics, needs, and problems, the learning
techniques, the existing materials, teaching media and expectation toward this study.
2. Instrument for Preliminary Product Verification
The questionnaire was used in Preliminary Product Verification to obtain
feedback of the designed materials. It was distributed to English teachers of SMKN 5 Yogyakarta and English Lecturers of English Language Education Study
Program in Sanata Dharma University. The questionnaire was closed form type in which the participants were expected to choose the alternative statements which
were provided in each question. Moreover, interview also conducted in this step
to gain the data about opinion and suggestion toward the designed materials.
3. Instrument for Main Field Testing
In Main Field Testing, the writer gathered the data during the implementation of the designed materials. The data was obtained by distributing
questionnaire to the second year students of Visual Communication Design
program. The questionnaire was combination of open and closed form questions. It was aimed to gather the data of students’ understanding and opinion toward the
designed materials. This questionnaire was made in Bahasa Indonesia to avoid misinterpretation. The data of the questionnaire, then, would be used to revise the
designed materials into the final version.
E. Data Analysis Techniques
Data analysis techniques were applied on the three steps of the overall steps used in this study. The three steps were Research and Information Collecting step,
Preliminary Product Verification step, and Main Field Testing step. The specific technique of the data analysis would be presented below.
1. Analysis Techniques in Research and Information Collecting
In this step, the writer utilized interview as the instrument to gather the data. The data of interviews were analyzed from the recording of interviews. The data,
then, were presented in forms of narrative description and developed as one basis
in designing English listening materials using task based language teaching for the second year students of Visual Communication Design Program in SMKN 5
Yogyakarta.
2. Analysis Techniques in Preliminary Product Verification
In Preliminary Product Verification step, the data were collected through questionnaire and interviews. The questionnaire was in form of close-form
questions in which the responses were presented in form of Likert scale items. According to Wiersma 1995:318, Likert scale is a scale with number of points
that represent a set of related responses, one for each point. The participants had to choose one of the five statements from each question, which reflecting their
opinion toward the designed materials. The participants’ opinions were measured using 5 points of agreement, as follow:
Table 3.2 : Points of Agreement
Points of Agreement
Meaning 1
The participants strongly disagree with the statements 2
The participants disagree with the statements 3
The participants doubt the statements 4
The participants agree with the statements 5
The participants strongly agree with the statements
The data from closed form questions, then, were analyzed to find out the central tendency of the participant’s statements toward the designed materials.
The measurement of central tendency, which is commonly known as averages, is a suitable way to find single index which can represent a whole set of measures
Ary, Jacobs, and Razavieh, 1979:99. The most commonly used indices are the mean, median, and mode. The mean is the sum of all scores divided by the
number of scores, while the median is the middle point of all the scores and the mode is the score with the greatest frequency Wiersma, 1995:340. In this study,
the three indices were presented as follow:
Table 3.3 : The Descriptive Statistics of Participants’ Opinions
No Participant’ statement
on… Frequency of the degree
of agreement Central Tendency
1 2
3 4
5 N
Mn Mdn
Md
Note: N
: Number of participants Mn
: Mean Mdn : Median
Md : Mode
Furthermore, the mean was counted using the formulation below:
Note: X : the range point; Σ X : the sum of all score; N: the number of participants
X = Σ X N
In addition, the interview was conducted to find out participants’ opinions, suggestions, andor recommendations to the designed materials. The data from the
interview would be analyzed from the recording of interview and presented in narrative description.
3. Analysis Techniques in Main Field Testing
In Main Field Testing step, the data was obtained by distributing the questionnaire. The questionnaire was combination of two forms of questions,
open and closed form questions. The data of open-form questions involved participants’ understanding of the designed material and also their opinion toward
the implementation of the designed materials. Those data were analyzed and presented in narrative description. While the data of closed-form questions were
presented in the form of table.
F. Research Procedure
This part summarizes the six RD steps that would be conducted in this study. The procedural step of each step of RD would be described as follow:
1. Research and Information Collecting
Studying the related literatures, curriculum, syllabus Conducting interviews
2. Preliminary Form of Product Development
Analyzing the interview Stating the purposes of the learning