DEVELOPMENT OF RESEARCH INSTRUMENT
E. DEVELOPMENT OF RESEARCH INSTRUMENT
The instruments for this study are students’ speaking skill test of English and the emotional intelligence test.
1. The instrument for student’s speaking skill
a. Conceptual Definition
Student’s speaking skill is one of the language skill, learning achievement of English at SMK consists of the four skills of English plus grammatical and vocabulary components since English is a general and compulsory subject at SMK, learning achievement of English aims at figuring out the student’s ability in speaking skill for expressing their English in a simple way through answering some questions after having treatment of learning process.
b. Operational Definition
Student’s speaking skill is ability of student’s communication which involve various skills to decide on when to speak; what form to use; which words are suitable in form and meaning; use of sequences of sounds, voice, tone and form; convincing that one feels the need to speak properly in the right situation; and correct positioning of tongue and lips to produce linguistic sounds. The score of learning achievement could be gained through administering the test to the students. The objective of Student’s speaking skill is ability of student’s communication which involve various skills to decide on when to speak; what form to use; which words are suitable in form and meaning; use of sequences of sounds, voice, tone and form; convincing that one feels the need to speak properly in the right situation; and correct positioning of tongue and lips to produce linguistic sounds. The score of learning achievement could be gained through administering the test to the students. The objective of
For the questions in questionnaire are in a rather complicated English, the researcher translated them first into Indonesian, simplified, and adjusted some cases in questionnaire in accordance with Indonesian culture before administering them to the students.
c. Description of instrument of student’s speaking skill
Items No. DIMENTION INDICATOR
Positive Negative
1 Dialogue
Giving invitation
Expressing certainty
Expressing opinion
Expressing agreement and
disagreement Barganing
8, 17, 19 Total
d. Validation/Test of Instruments
1) Test of level of Grain Difficulty To know the questions are easy, medium, and hard, they are done test of the difficulty level, to calculate the difficulty index is used the formula:
B P=
JS
Description: P = Difficulty Index
B = Number of students who answered that question correctly. JS = Total number of students of test participants where: P = 0.00 to 0.30: difficult P = 0.30 to 0.70: moderate P = 0.70 to 1.00: easy
Table 3.4 Test of item difficulty level
No. Item
Explaination
1 0,30
moderate
2 0,40
moderate
3 0,50
moderate
4 0,40
moderate
5 0,50
moderate
6 0,50
moderate
7 0,50
moderate
8 0,30
moderate
9 0,50
moderate
10 0,50
moderate
11 0,20
difficult
12 0,50
moderate
13 0,30
moderate
14 0,30
moderate
15 0,50
moderate
2) Test of Item Differentiator Power About the distinguishing features is the ability of a matter to distinguish between the smart students with the less smart 2) Test of Item Differentiator Power About the distinguishing features is the ability of a matter to distinguish between the smart students with the less smart
D=P A –P B , dengan P A =
dan P B = J A J B
Description:
D = Index of item differentiator power JA = The number of test participants the high group JB = The number of test participants the low group BA = The number of test participants the high group that answer
correctly. BB = The number of test participants the low group that answer correctly. PA = The proportion of the high group participants who answered correctly NT = The proportion of the low group participants who answered correctly According to Ngalim Purwanto (2004: 144) in his book ”Prinsip- prinsip dan teknik evaluasi pengajaran ”give prediction towards item differentiator power as follows:
D : 0,00 – 0,20 : Bad
D : 0,20 – 0,40 : Middle
D : 0,40 – 0,70 : Good
D : 0,70 – 1,00 : Very good
The results of these tests can be used to distinguish between the students with the high ability and the students with the low ability.
Table 3.5 Test of item differentiator power
No Item
Differentiator
Explanation
1 0,20
Middle
2 0,20
Middle
3 0,30
Middle
4 0,30
Middle
5 0,10
Bad
6 0,10
Bad
7 0,30
Good
8 0,10
Bad
9 0,40
Good
10 0,30
Middle
11 0,10
Bad
12 0,40
Good
13 -1
Bad
14 0 Bad
15 0 Bad
16 0,30
Middle
17 0 Bad
18 0,20
Middle
3)Test of Item Validity
According to Suharsimi Arikunto (2001: 75) formula of validity that is used is correlation of point biserial (r pb ):
xi - xt
pi
r pb =
St
qi
Description: r pb : Correlation coeficient of the point biserial
X i : The total average score of the respondents who answered
correctly
X t : The total average score of all respondents p i : Proportion of correct answers to item i q i : The proportion of incorrect answers item i St : Standard deviation of total score
In granting inter-resullt towards r pb to be used db (N-nr) with N = Number of students and nr = 2, then the r pb be consulted to score table of r product moment at significant level 5%. After the calculation of validity, the items were said to be valid if the score of r hitung is greater than the score of r tabel (r hitung >r tabel ) for the significant level = 5% and n = number of samples.
Table 3.6 Result of Validity Calculation
Items r bis
r table
Explanation
Invalid
Valid
Valid
4 -0.04
Invalid
Invalid
Invalid
11 -0.37 0,36 Invalid
12 0.79 0,36 Valid
13 -0.48 0,36 Invalid
14 -0.09 0,36 Invalid
21 -0.04 0,36 Invalid
28 -0.37 0,36 Invalid
29 0.79 0,36 Valid
4)Test of Reliability
Reliability of instrument for multiple choice is tested by using Kuder Richardson 20 (Drs. Safari, M.A.; 2004: 54), with formula:
where: r 11 = Coefficient of reliability test k
= Number of items St 2 = Variance of total score
pi = Proportion of correct answers to item i qi
= The proportion of incorrect answers to item i pq = Total of the multiplication between p and q In granting the interpretation of test reliability coefficient (r 11 ) is
generally used benchmarks as follows:
a. If r 11 is equal to or greater than 0.70 means that the test results are be tested the reliability has revealed a high reliability.
b. If r 11 is smaller than 0.70 means that the test results are be tested the reliability does not have a high reliability.
Because r 11 is equal to 0,82 or greater than 0,70 means test of learning outcome are being tested the reliability has had the high reliability.
2. The instrument for the emotional intelligence test
a. Conceptual Definition
Emotional intelligence is defined as the ability to recognize, to work, to express, to motivate, and to manage emotions effectively in order to shape our relationships well and know how feel and act in our daily lives. They are continually compiling and analyzing data on the test-retest reliability and criterion and construct validity.
b. Operational Definition
Emotional intelligence is the scores obtained from test of emotional intelligence. It is aimed at measuring the students’ emotional intelligence. There are five components in making good relationships, namely: (1) recognitions, (2) options, (3) expressions, and (4) motivations. Furthermore, there are two factors in identifying our attitudes, they are: (1) feeling, and (2) behavior. For the questions in questionnaire are in a rather Emotional intelligence is the scores obtained from test of emotional intelligence. It is aimed at measuring the students’ emotional intelligence. There are five components in making good relationships, namely: (1) recognitions, (2) options, (3) expressions, and (4) motivations. Furthermore, there are two factors in identifying our attitudes, they are: (1) feeling, and (2) behavior. For the questions in questionnaire are in a rather
c. Isntrumen description of emotional intelligence
In determining the grain material of instrument, the researcher refers to the instrument indicators. Here are the instrument descriptions of emotional intelligence
Table 3.7
Description and number of items Relationship
d. Validity Test
The item validity and the question reliability by using ‘r ‘ product moment (Suharsimi Arikunto, 1997: 71) with formula:
n( XY) – (X)(Y)
r xy =
2 2 2 {n( 2 X )–( X) }n y –( y) Description:
r xy = Correlation between variables X and Y r xy = Correlation between variables X and Y
X = Independent variable Y
= Bound variable XY
= Multiplication between variables X and Y
X 2 = Variable of X squared Y 2
= Variable of Y squared
Table 3.8 Results of Validity Calculation
Item r bis
r table
Explanation
Valid
Valid
Valid
Invalid
Valid
Valid
Valid
Valid
Valid
Valid
Invalid
Valid
Valid
Valid
Valid
Valid
17 0,52 0,39 Valid
18 0,39 0,39 Valid
19 0,22 0,39 Invalid
20 0,54 0,39 Valid
21 0,55 0,39 Valid
22 0,49 0,39 Valid
23 0,39 0,39 Valid
24 0,52 0,39 Valid
25 0,44 0,39 Valid
26 0,17 0,39 Invalid
27 0,39 0,39 Valid
28 0,43 0,39 Valid
29 0,61 0,39 Valid
30 0,42 0,39 Valid
31 0,55 0,39 Valid
32 0,49 0,39 Valid
33 0,39 0,39 Valid
34 0,22 0,39 Invalid
35 0,44 0,39 Valid
36 0,47 0,39 Valid
37 0,39 0,39 Valid
38 0,43 0,39 Valid 38 0,43 0,39 Valid
For the test reliability of the questionnaire on student emotional intelligence to use the internal consistency reliability with coefficient alpha formula as proposed by Surapranata as follow:
k 2 Si r 11 =
1- k-1 2 St
Description: r11
= The overall reliability of the instrument k
= Number of questionnaire items Si 2
= Amount of variance of the scores of each item questionnaire
St 2 = Variance of total score To determine whether the reliability coefficient obtained qualified or not, refer to the following opinion "Actually there is not an exact measure of how high-reliability coefficient is generally moving from one hundred to zero percent, or from one to zero. Anas Sudjono make provision about the reliability coefficient in his book “Pengantar Evaluasi Pendidikan” (2001: 209) as follows: In giving
the interpretation of test reliability coefficient (r 11 ) is commonly used benchmark as follows:
1. If r 11 is equal to or greater than 0.70 means that the reliability of the test results are tested has revealed a high reliability.
2. If r 11 is smaller than 0.70 means that the reliability of test results of student’s speaking skill are tested not have a high reliability (unreliabel)
Because r 11 equal to 0.72 or greater than 0.70 means that the reliability of the test results of student’s speaking skill are being tested has revealed a high reliability.