DEVELOPMENT OF RESEARCH INSTRUMENT

E. DEVELOPMENT OF RESEARCH INSTRUMENT

The instruments for this study are students’ speaking skill test of English and the emotional intelligence test.

1. The instrument for student’s speaking skill

a. Conceptual Definition

Student’s speaking skill is one of the language skill, learning achievement of English at SMK consists of the four skills of English plus grammatical and vocabulary components since English is a general and compulsory subject at SMK, learning achievement of English aims at figuring out the student’s ability in speaking skill for expressing their English in a simple way through answering some questions after having treatment of learning process.

b. Operational Definition

Student’s speaking skill is ability of student’s communication which involve various skills to decide on when to speak; what form to use; which words are suitable in form and meaning; use of sequences of sounds, voice, tone and form; convincing that one feels the need to speak properly in the right situation; and correct positioning of tongue and lips to produce linguistic sounds. The score of learning achievement could be gained through administering the test to the students. The objective of Student’s speaking skill is ability of student’s communication which involve various skills to decide on when to speak; what form to use; which words are suitable in form and meaning; use of sequences of sounds, voice, tone and form; convincing that one feels the need to speak properly in the right situation; and correct positioning of tongue and lips to produce linguistic sounds. The score of learning achievement could be gained through administering the test to the students. The objective of

For the questions in questionnaire are in a rather complicated English, the researcher translated them first into Indonesian, simplified, and adjusted some cases in questionnaire in accordance with Indonesian culture before administering them to the students.

c. Description of instrument of student’s speaking skill

Items No. DIMENTION INDICATOR

Positive Negative

1 Dialogue

Giving invitation

Expressing certainty

Expressing opinion

Expressing agreement and

disagreement Barganing

8, 17, 19 Total

d. Validation/Test of Instruments

1) Test of level of Grain Difficulty To know the questions are easy, medium, and hard, they are done test of the difficulty level, to calculate the difficulty index is used the formula:

B P=

JS

Description: P = Difficulty Index

B = Number of students who answered that question correctly. JS = Total number of students of test participants where: P = 0.00 to 0.30: difficult P = 0.30 to 0.70: moderate P = 0.70 to 1.00: easy

Table 3.4 Test of item difficulty level

No. Item

Explaination

1 0,30

moderate

2 0,40

moderate

3 0,50

moderate

4 0,40

moderate

5 0,50

moderate

6 0,50

moderate

7 0,50

moderate

8 0,30

moderate

9 0,50

moderate

10 0,50

moderate

11 0,20

difficult

12 0,50

moderate

13 0,30

moderate

14 0,30

moderate

15 0,50

moderate

2) Test of Item Differentiator Power About the distinguishing features is the ability of a matter to distinguish between the smart students with the less smart 2) Test of Item Differentiator Power About the distinguishing features is the ability of a matter to distinguish between the smart students with the less smart

D=P A –P B , dengan P A =

dan P B = J A J B

Description:

D = Index of item differentiator power JA = The number of test participants the high group JB = The number of test participants the low group BA = The number of test participants the high group that answer

correctly. BB = The number of test participants the low group that answer correctly. PA = The proportion of the high group participants who answered correctly NT = The proportion of the low group participants who answered correctly According to Ngalim Purwanto (2004: 144) in his book ”Prinsip- prinsip dan teknik evaluasi pengajaran ”give prediction towards item differentiator power as follows:

D : 0,00 – 0,20 : Bad

D : 0,20 – 0,40 : Middle

D : 0,40 – 0,70 : Good

D : 0,70 – 1,00 : Very good

The results of these tests can be used to distinguish between the students with the high ability and the students with the low ability.

Table 3.5 Test of item differentiator power

No Item

Differentiator

Explanation

1 0,20

Middle

2 0,20

Middle

3 0,30

Middle

4 0,30

Middle

5 0,10

Bad

6 0,10

Bad

7 0,30

Good

8 0,10

Bad

9 0,40

Good

10 0,30

Middle

11 0,10

Bad

12 0,40

Good

13 -1

Bad

14 0 Bad

15 0 Bad

16 0,30

Middle

17 0 Bad

18 0,20

Middle

3)Test of Item Validity

According to Suharsimi Arikunto (2001: 75) formula of validity that is used is correlation of point biserial (r pb ):

xi - xt

pi

r pb =

St

qi

Description: r pb : Correlation coeficient of the point biserial

X i : The total average score of the respondents who answered

correctly

X t : The total average score of all respondents p i : Proportion of correct answers to item i q i : The proportion of incorrect answers item i St : Standard deviation of total score

In granting inter-resullt towards r pb to be used db (N-nr) with N = Number of students and nr = 2, then the r pb be consulted to score table of r product moment at significant level 5%. After the calculation of validity, the items were said to be valid if the score of r hitung is greater than the score of r tabel (r hitung >r tabel ) for the significant level  = 5% and n = number of samples.

Table 3.6 Result of Validity Calculation

Items r bis

r table

Explanation

Invalid

Valid

Valid

4 -0.04

Invalid

Invalid

Invalid

11 -0.37 0,36 Invalid

12 0.79 0,36 Valid

13 -0.48 0,36 Invalid

14 -0.09 0,36 Invalid

21 -0.04 0,36 Invalid

28 -0.37 0,36 Invalid

29 0.79 0,36 Valid

4)Test of Reliability

Reliability of instrument for multiple choice is tested by using Kuder Richardson 20 (Drs. Safari, M.A.; 2004: 54), with formula:

where: r 11 = Coefficient of reliability test k

= Number of items St 2 = Variance of total score

pi = Proportion of correct answers to item i qi

= The proportion of incorrect answers to item i pq = Total of the multiplication between p and q In granting the interpretation of test reliability coefficient (r 11 ) is

generally used benchmarks as follows:

a. If r 11 is equal to or greater than 0.70 means that the test results are be tested the reliability has revealed a high reliability.

b. If r 11 is smaller than 0.70 means that the test results are be tested the reliability does not have a high reliability.

Because r 11 is equal to 0,82 or greater than 0,70 means test of learning outcome are being tested the reliability has had the high reliability.

2. The instrument for the emotional intelligence test

a. Conceptual Definition

Emotional intelligence is defined as the ability to recognize, to work, to express, to motivate, and to manage emotions effectively in order to shape our relationships well and know how feel and act in our daily lives. They are continually compiling and analyzing data on the test-retest reliability and criterion and construct validity.

b. Operational Definition

Emotional intelligence is the scores obtained from test of emotional intelligence. It is aimed at measuring the students’ emotional intelligence. There are five components in making good relationships, namely: (1) recognitions, (2) options, (3) expressions, and (4) motivations. Furthermore, there are two factors in identifying our attitudes, they are: (1) feeling, and (2) behavior. For the questions in questionnaire are in a rather Emotional intelligence is the scores obtained from test of emotional intelligence. It is aimed at measuring the students’ emotional intelligence. There are five components in making good relationships, namely: (1) recognitions, (2) options, (3) expressions, and (4) motivations. Furthermore, there are two factors in identifying our attitudes, they are: (1) feeling, and (2) behavior. For the questions in questionnaire are in a rather

c. Isntrumen description of emotional intelligence

In determining the grain material of instrument, the researcher refers to the instrument indicators. Here are the instrument descriptions of emotional intelligence

Table 3.7

Description and number of items Relationship

d. Validity Test

The item validity and the question reliability by using ‘r ‘ product moment (Suharsimi Arikunto, 1997: 71) with formula:

n( XY) – (X)(Y)

r xy =

2 2 2 {n( 2 X )–( X) }n y –( y) Description:

r xy = Correlation between variables X and Y r xy = Correlation between variables X and Y

X = Independent variable Y

= Bound variable XY

= Multiplication between variables X and Y

X 2 = Variable of X squared Y 2

= Variable of Y squared

Table 3.8 Results of Validity Calculation

Item r bis

r table

Explanation

Valid

Valid

Valid

Invalid

Valid

Valid

Valid

Valid

Valid

Valid

Invalid

Valid

Valid

Valid

Valid

Valid

17 0,52 0,39 Valid

18 0,39 0,39 Valid

19 0,22 0,39 Invalid

20 0,54 0,39 Valid

21 0,55 0,39 Valid

22 0,49 0,39 Valid

23 0,39 0,39 Valid

24 0,52 0,39 Valid

25 0,44 0,39 Valid

26 0,17 0,39 Invalid

27 0,39 0,39 Valid

28 0,43 0,39 Valid

29 0,61 0,39 Valid

30 0,42 0,39 Valid

31 0,55 0,39 Valid

32 0,49 0,39 Valid

33 0,39 0,39 Valid

34 0,22 0,39 Invalid

35 0,44 0,39 Valid

36 0,47 0,39 Valid

37 0,39 0,39 Valid

38 0,43 0,39 Valid 38 0,43 0,39 Valid

For the test reliability of the questionnaire on student emotional intelligence to use the internal consistency reliability with coefficient alpha formula as proposed by Surapranata as follow:

k 2 Si r 11 =

1- k-1 2 St

Description: r11

= The overall reliability of the instrument k

= Number of questionnaire items Si 2

= Amount of variance of the scores of each item questionnaire

St 2 = Variance of total score To determine whether the reliability coefficient obtained qualified or not, refer to the following opinion "Actually there is not an exact measure of how high-reliability coefficient is generally moving from one hundred to zero percent, or from one to zero. Anas Sudjono make provision about the reliability coefficient in his book “Pengantar Evaluasi Pendidikan” (2001: 209) as follows: In giving

the interpretation of test reliability coefficient (r 11 ) is commonly used benchmark as follows:

1. If r 11 is equal to or greater than 0.70 means that the reliability of the test results are tested has revealed a high reliability.

2. If r 11 is smaller than 0.70 means that the reliability of test results of student’s speaking skill are tested not have a high reliability (unreliabel)

Because r 11 equal to 0.72 or greater than 0.70 means that the reliability of the test results of student’s speaking skill are being tested has revealed a high reliability.