Main Field Testing Main Product Revision

implementation of the designed materials. The evaluation, then, was used to revise the designed materials into final version. The type of data would be described in the following table. The table covers the summary of steps in which the writer gathered data; the type of data that would be obtained; the instruments that would be used; and the sources of the data. Table 3.1 : The Type of Data Step Type of Data Instrument Sources Research and Information Collecting 1. Students’ characteristics 2. Students’ needs 3. Students’ motivation

4. Students’ strength and weakness

5. Basis of listening activities 6. Listening activities in class 7. Learning techniques and activities 8. Materials, media and topic choice 9. Learning difficulties

10. Expectation toward this study

Interview - Teachers - Students Preliminary Product Verification 1. Evaluation of the designed materials: a. Major goals of the designed materials b. Explanation of the content, tasks and activities c. Relevance between the designed materials with students’ level and students’ program d. Concordance between the level of difficulty with what should a. Closed-form Questionnaire b. Interview - Teachers - Lectures Step Type of Data Instrument Sources be given to students e. Relevance between activities and the topic f. Effectiveness of tasks and activities to facilitate students in achieving the goals g. The instruction of each task in the designed materials h. Variety of task i. Effectiveness of media and another additional materials 2. Opinion and suggestion toward the designed materials Main Field Testing a. evaluation on the designed materials and the implementation a. Students’ interest of the materials b. comprehension of the materials c. clearness of the listening materials and the instruction d. relation between materials and students’ vocational program e. the most interesting part f. the most difficult part 2. Opinion and suggestion toward the designed materials and the implementation Questionnaire: - open form - closed form Students

D. Research Instruments

This study applied two types of instruments to gather data. There were interviews and questionnaires. The interviews were used in Research and Information Collecting and Preliminary Product Testing, while the questionnaires were used in Preliminary Product Testing and Main Field Testing.

1. Instrument for Research and Information Collecting

The writer conducted interviews for obtaining the data in Research and Information Collecting step. Interviews were intended to English teachers and second year students of Visual Communication Design Program in SMKN 5 Yogyakarta. The interviews were conducted in informal way to create familiarity among the writer and the participants. The interviews were aimed to gain information about students’ characteristics, needs, and problems, the learning techniques, the existing materials, teaching media and expectation toward this study.

2. Instrument for Preliminary Product Verification

The questionnaire was used in Preliminary Product Verification to obtain feedback of the designed materials. It was distributed to English teachers of SMKN 5 Yogyakarta and English Lecturers of English Language Education Study Program in Sanata Dharma University. The questionnaire was closed form type in which the participants were expected to choose the alternative statements which were provided in each question. Moreover, interview also conducted in this step to gain the data about opinion and suggestion toward the designed materials.

3. Instrument for Main Field Testing

In Main Field Testing, the writer gathered the data during the implementation of the designed materials. The data was obtained by distributing questionnaire to the second year students of Visual Communication Design program. The questionnaire was combination of open and closed form questions. It was aimed to gather the data of students’ understanding and opinion toward the designed materials. This questionnaire was made in Bahasa Indonesia to avoid misinterpretation. The data of the questionnaire, then, would be used to revise the designed materials into the final version.

E. Data Analysis Techniques

Data analysis techniques were applied on the three steps of the overall steps used in this study. The three steps were Research and Information Collecting step, Preliminary Product Verification step, and Main Field Testing step. The specific technique of the data analysis would be presented below.

1. Analysis Techniques in Research and Information Collecting

In this step, the writer utilized interview as the instrument to gather the data. The data of interviews were analyzed from the recording of interviews. The data, then, were presented in forms of narrative description and developed as one basis in designing English listening materials using task based language teaching for the second year students of Visual Communication Design Program in SMKN 5 Yogyakarta.

2. Analysis Techniques in Preliminary Product Verification

In Preliminary Product Verification step, the data were collected through questionnaire and interviews. The questionnaire was in form of close-form questions in which the responses were presented in form of Likert scale items. According to Wiersma 1995:318, Likert scale is a scale with number of points that represent a set of related responses, one for each point. The participants had to choose one of the five statements from each question, which reflecting their opinion toward the designed materials. The participants’ opinions were measured using 5 points of agreement, as follow: Table 3.2 : Points of Agreement Points of Agreement Meaning 1 The participants strongly disagree with the statements 2 The participants disagree with the statements 3 The participants doubt the statements 4 The participants agree with the statements 5 The participants strongly agree with the statements The data from closed form questions, then, were analyzed to find out the central tendency of the participant’s statements toward the designed materials. The measurement of central tendency, which is commonly known as averages, is a suitable way to find single index which can represent a whole set of measures Ary, Jacobs, and Razavieh, 1979:99. The most commonly used indices are the mean, median, and mode. The mean is the sum of all scores divided by the number of scores, while the median is the middle point of all the scores and the mode is the score with the greatest frequency Wiersma, 1995:340. In this study, the three indices were presented as follow: Table 3.3 : The Descriptive Statistics of Participants’ Opinions No Participant’ statement on… Frequency of the degree of agreement Central Tendency 1 2 3 4 5 N Mn Mdn Md Note: N : Number of participants Mn : Mean Mdn : Median Md : Mode Furthermore, the mean was counted using the formulation below: Note: X : the range point; Σ X : the sum of all score; N: the number of participants X = Σ X N In addition, the interview was conducted to find out participants’ opinions, suggestions, andor recommendations to the designed materials. The data from the interview would be analyzed from the recording of interview and presented in narrative description.

3. Analysis Techniques in Main Field Testing

In Main Field Testing step, the data was obtained by distributing the questionnaire. The questionnaire was combination of two forms of questions, open and closed form questions. The data of open-form questions involved participants’ understanding of the designed material and also their opinion toward the implementation of the designed materials. Those data were analyzed and presented in narrative description. While the data of closed-form questions were presented in the form of table.

F. Research Procedure

This part summarizes the six RD steps that would be conducted in this study. The procedural step of each step of RD would be described as follow:

1. Research and Information Collecting

Studying the related literatures, curriculum, syllabus Conducting interviews

2. Preliminary Form of Product Development

Analyzing the interview Stating the purposes of the learning