Research Instrument

C. Research Instrument

1. Research Instrument Development

a. Test

In this research, the students were given the pretest before the treatment. The students divided into some groups, each group consists of two until four students. The researcher designed the items for speaking test and used the interaction with group technique; the researcher also gave example on how to do the task. The students shared their opinion in their group and then presented their work result in class. After the treatment, the researcher gave the post test, and the results analyzed to describe in data analysis. Because the test in discussion was focused on process, so the researcher used checklist to their activity in group.

b. Questionnaires

Questionnaire is one of the research instruments which consist of a series of questions or statements to obtain the information from participants. In a questionnaire, the participants respond to the questions or statements by writing or marking an answer sheet (Fraenkel et al., 2011: p.125).

The purpose of the researcher used questionnaire was to know the level of anxiety of the students in speaking. This would also help the researcher to measure the students‟ speaking anxiety level. This study uses the adaption and translation of Foreign Language Classroom Anxiety Scale (FLCAS) developed by Horwitz et al. (1986).

FLCAS consist of 33 question with answer response options range 1-5 of each item. The 5- point Likert‟s scale is range from “Strongly agree” (SA), “Agree” (A), “Neither Agree nor Disagree” (NA), “Disagree” (D), and “Strongly Disagree” (SA).

2. Instrument Try Out

Before the questionnaire was used as an instrument, the researcher did a tryout first in the other class. Try out was used to measure the suitability of the questionnaire. Third semester of English study program has 3 classes and it belongs to population on this research, as a result the researcher conducted try out

in the class C. the instrument was given on Thursday, 5 th October, and it was done by 23 students.

3. Instrument Validity

a. Questionnaire

Validity means the extent to which an instrument measures what should be measured (Ary,et.al, 2010: p.316). The instrument is valid while the instrument which is used in the research can be used to measure what the researcher wants to measure (Ary, et.al, 2003: p.225). So, the validity and the instrument of the research are interrelated. In this research, the researcher used content validity. The standard of content validity is the degree to which the sample of items, tasks, or questions on a test are representative of some defined universe or domain of content.

The procedure to find out the validity of the instrument is by estimating the validity of the test items using Pearson‟s Product Moment Correlation formula.

rxy= correlation coefficient between variable X and Y N = total number of students

X = score of each item for every student Y = total score of every student Then, the correlation coefficient of each item was verified through the criteria of validity. Besides that, the researcher can compare the r (correlation coefficient) obtained with the r table according to the number of students (N) who took the test.

Table 3.3 Criteria of Validity

r xy < 0.20 The validity of item is very low

0.20 ≤ r xy < 0.40 The validity of item is low

0.40 ≤ r xy < 0.60 The validity of item is moderate

0.60 ≤ r xy < 0.80 The validity of item is high

r xy ≥ 0.80 The validity of item is very high

Table 3.4 Distribution of Instrument Try out in class C

No Validity Index

Criteria and number

Total percentage

Communication apprehension:

Item was valid

Fear or Negative Evaluation:

Test Anxiety:

Communication apprehension:

Item was not

valid

Fear or Negative Evaluation

Test Anxiety:

From table calculation above, it means from 33 items that were given, there were 21 numbers which are valid. And 12 numbers were not invalid (See Appendix).

b. Test

To guarantee the validity of speaking test, the researcher took some theme. It was about it was interpersonal dialogue where the students gave information to their other friend s‟ about their past activities. Validity of speaking test dealt with the aspect the researcher wanted to measure. The researcher applied oral ability scale proposed by Heaton (1991) which scored the test by the pronunciation, grammar, vocabulary, fluency, and comprehensibility.

To make the score more acceptable and avoid subjectivity of the research, the researcher used inter- rater in scoring students‟ performances. Inter rater means that there was another person who gave score beside the researcher herself. In this research, the first rater was the ninth semester students whose name are Sri Tumika, Dyah Sri Wulandari and Rusmaya Nurlinda, and second rather was the researcher.

4. Instrument Reliability

According to Horwit and Cramer (2000: p.28) reliability is the extent to which the measure will give the same response under similar circumstances. In other word, reliability shows a measure of consistency in measuring the same phenomenon.

Brown (2004) says that reliability has to do with accuracy of measurement. This kind of accuracy is reflected in obtaining of similar result when measurement is repeated on different occasion or with different instruments or by different person. Reliable testing which researcher use to assess this questionnaire is cronbach‟s alpha by using SPSS 16.0.

Reliability Statistics

Cronbach's Alpha

N of Items

Table 3.5 Criteria of Reliability

Very high reliability

High reliability

Moderate reliability

Low reliability

Very low reliability

The result of calculation by SPSS, the reliability score that the researcher got was r = 0.912, the questionnaire can be said as reliable if has a coefficient equal to or higher than 0.60. The calculation is that questionnaire reliable and include in category very high reliability.