pengabdian masyarakat menentukan batas kelulusan standard setting dengan metode angoff 29 desember 2
UNIVERSITAS NEGERI YOGYAKARTA
LEMBAGA PENELITIAN DAN PENGABDIAN KEPADA MASYARAKAT
PUSAT PENELITIAN KEBIJAKAN DAN SISTEM PENGUJIAN PENDIDIKAN
No. 1226/ UN34.21/ TU/ 2012
Diberikan kepada
Dr. SamsuC3~fadi
atas peran sertanya sebagai
v
\ h \ $ r * i n t: i«
dalam acara "WORKSHOP PENENTUAN STANDARD SETTING BAGI GURU SMK KELOM POK TEKNOLOGI DAN REKAYASA"
yang diselenggarakan oleh Pusat Penelitian Kebijakan dan Sistem Pengujian Pendidikan LPPM UNY
pada tanggal 29 Desember 2012
Yogyakarta, 29 Desember 2012
M engetahui
LPPM UNY
. Dr. Anik Ghufron
IP. 19621111 198803 1001
Prof. DrTSudJi Munadi, M .Pd.
19530310 197803 1003
MENENTUKAN BATAS KELULUSAN (STANDARD SETTING)
DENGAN METODE ANGOFF
M a k a la h D is a m p a ia n p a d a W o rk s h o p P e n e n tu a n
Standard Setting
B a g i G u ru S M K
K e lo m p o k T e k n o lo g i d a n R e k a y a s a
O le h :
S am sul H ad i
H e ri R e tn o w a ti
S u d ji M u n a d i
Pusat Penelitian Kebijakan dan Sistem Pengujian Pendidikan
Lembaga Penelitian dan Pengabdian Kepada Masyarakat
UNIVERSITAS NEGERI YOGYAKARTA
2012
MENENTUKAN BATAS KELULUSAN (STANDARD SETTING)
DENGAN METODE ANGOFF *)
O le h :
S a m s u l H a d i, H e r i R e t n o w a t i , d a n S u d ji M u n a d i
Pusbijadikbangsisjian LPPM UNY
Pendahuluan
P e n ila ia n p a d a
k u rik u lu m b e rb a s is k o m p e te n s i m e n g g u n a k a n a c u a n k rite ria .
A s u m s i y a n g d ig u n a k a n p a d a a c u a n k rite ria a d a la h s e tia p p e s e rta d id ik d a p a t b e la ja r
p e l a j a r a n a p a s a ja , h a n y a w a k t u n y a y a n g b e r b e d a .
a d a l a h lu l u s d a n t i d a k lu lu s . P e n e t a p a n
skor
H a s il p e n ila ia n a c u a n k rite ria
b a t a s lu l u s a ta u d i k e n a l d e n g a n
p e n e ta p a n s ta n d a r k e lu lu s a n d a p a t d ila k u k a n m e la lu i
judgement.
P e n e ta p a n d e n g a n
c a r a i n i m e m i l i k i k e l e m a h a n , y a it u t i d a k b e r d a s a r k a n d a t a e m p i r i k d a n p r o s e d u r y a n g
t e l a h t e r u j i d i l a p a n g a n . U n t u k it u p e r l u d i c a r i c a r a y a n g d a p a t d i p e r t a n g g u n g
ja w a b k a n d a ri te o ri p e n g u k u ra n .
P e m e r i n t a h t e l a h m e n e r b i t k a n P e r a t u r a n P e m e r i n t a h N o 19 t a h u n 2 0 0 5 t e n t a n g
S ta n d a r N a s io n a l P e n d id ik a n d a la m ra n g k a m e n in g k a tk a n k u a lita s p e n d id ik a n . P P
te rs e b u t
m encakup
8
s ta n d a r n a s io n a l
p e n d id ik a n .
S a la h
s a tu
s ta n d a r
n a s io n a l
p e n d i d i k a n y a n g p e n t i n g a d a l a h s t a n d a r k o m p e t e n s i l u l u s a n ( S K L ) , y a it u k e m a m p u a n
m i n i m u m y a n g h a r u s d i m i l i k i p e s e r t a d i d i k y a n g l u l u s d a r i s u a tu j e n j a n g p e n d id ik a n .
K o m p e t e n i l u l u s a n a d a l a h k e m a m p u a n m i n i m u m y a n g h a r u s d i c a p a i p e s e r t a d id ik .
SK L
in i
m e n ja d i
acuan
d a la m
m en y u su n
k is i-k is i
u jia n
a k h ir
je n ja n g
p e n d id ik a n . K i s i - k i s i i n i d i g u n a k a n s e b a g a i a c u a n u n t u k m e n u l i s s o a l u j i a n . S ia p a
s a ja y a n g m e n y u s u n s o a l a p a b ila m e n g g u n a k a n k is i-k is i y a n g s a m a a k a n m e n g h a s il
*) M a t e r i d i s a m p a i k a n p a d a W o r k s h o p P e n e n t u a n
Standard Setting B a g i
G u ru S m k
K e l o m p o k T e k n o l o g i d a n R e k a y a s a p a d a ta n g g a l 2 9 D e s e m b e r 2 0 1 2 d i L P P M
UNY
1
k a n so a l y a n g re la tif sam a .
S o a l i n i d a p a t d i g u n a k a n u n t u k u ji a n , d a n s k o r y a n g
d i p e r o l e h d a p a t d i b a n d i n g k a n a n t a r s i s w a a ta u a n t a r s e k o la h . O l e h k a r e n a it u d a l a m
m e n y ia p k a n
soal
u ji a n ,
k is i-k is i
u jia n
h a ru s
je la s ,
s e h in g g a
soal
u jia n
dapat
d i k e m b a n g k a n l e b i h b a ik .
U jia n
N a s io n a l (U N )
E v a lu a s i B e la ja r T a h a p
yang
d ila k s a n a k a n
A k h i r ( E b ta n a s )
d i In d o n e s ia b a ik
m aupun
U jia n
it u
b e rn a m a
A k h ir N a s io n a l (U A N )
m e r u p a k a n s a la h s a tu p r o s e s p e n g u k u r a n h a s i l b e l a j a r y a n g t e l a h d i l a k s a n a k a n s e c a r a
n a s io n a l.
A dapun
tu ju a n n y a
se b a g a i b e rik u t
: (1 ) u n tu k
m e m p e ro le h
in fo rm a s i
te n ta n g m u tu h a s il p e n d id ik a n s e c a ra n a s io n a l, (2 ) m e n g u k u r p e n c a p a ia n h a s il b e la ja r
s is w a b a ik
s e k o la h /m a d ra s a h
n e g eri m a u p u n
s w a s ta ,
(3 ) m e m p e ro le h
g a m b aran
p e r b a n d i n g a n m u tu p e n d i d i k a n p a d a s e k o l a h m a d r a s a h , a n t a r s e k o l a h / m a d r a s a h , d a n
a n ta r w ila y a h d a ri ta h u n k e ta h u n , (4 ) m e n ja d i b a h a n p e n e n tu a n k e b ija k a n p e m b in a a n
s e k o la h /m a d ra s a h , (5 ) s e b a g a i b a h a n p e rtim b a n g a n d a la m m e m b e rik a n S u ra t T a n d a
T a m a t B e l a j a r d a n s e l e k s i m a s u k k e j e n j a n g p e n d i d i k a n y a n g l e b i h t in g g i.
M e s k i p u n p e l a k s a n a a n U N a d a y a n g p r o d a n k o n t r a , b a t a s lu l u s
UN
d ite n tu k a n
m enggunakan
k e b ija k a n .
Pada
ta h u n
2005,
b a ta s
(cut o f score)
lu l u s
yang
d i t e n t u k a n 4 ,0 1 . U n t u k t a h u n 2 0 0 6 d a n 2 0 0 7 , b a t a s lu l u s s e l a n j u t n y a d i t i n g k a t k a n
m e n j a d i 4 ,2 6 . B a t a s lu l u s i n i d i b e r l a k u k a n u n t u k t i g a m a t a p e l a j a r a n , y a k n i b a h a s a
I n d o n e s i a , m a t e m a t i k a d a n b a h a s a I n g g r is . N i l a i 4 ,0 1 m a u p u n 4 ,2 6 m e r u p a k a n b a ta s
y a n g re la tif re n d a h d ib a n d in g k a n b a ta s lu lu s n e g a r a -n e g a ra la in n y a , n a m u n d e m ik ia n
m a s y a r a k a t m e r e s p o n n y a d e n g a n p e n u h k e c e m a s a n d a n k e r e s a h a n , d a n b a ta s in i
d i a n g g a p t e r l a l u t i n g g i. P a d a b a t a s lu lu s u n t u k m a t a p e l a j a r a n m a t e m a t i k a , b i l a n g a n b i l a n g a n a k a n m e n j a d i s a n g a t s e n s it if . H a l i n i t e r k a i t d e n g a n m a t a p e l a j a r a n i n i y a n g
d i a n g g a p s u li t, s e h i n g g a m e n j a d i p e n y e b a b s i s w a t i d a k lu l u s d i s u a t u j e n j a n g s e k o la h .
D a la m
m enem puh
p e la k s a n a a n
UN
te ta p
p e n d id ik a n ,
dapat
lu l u s
s e la lu
sesuai
ada
dengan
h a ra p a n
tin g k a t
p e s e rta
d id ik
kem am puannya
yang
dan
m e m e n u h i s t a n d a r k o m p e t e n s i l u l u s a n y a n g t e l a h d i t e n t u k a n . T e r k a i t d e n g a n h a l in i,
b a t a s lu l u s p e r l u d i t e n t u k a n t i d a k h a n y a b e r d a s a r k a n k e b i j a k a n
2
(judgement)
d a ri
p e m e rin ta h
s e m a ta , n a m u n j u g a
b e r d a s a r k a n k e m a m p u a n s is w a .
h a ru s b e rd a sa rk a n
d a ta e m p iris
yang
a d a a ta u
K e m a m p u a n s is w a in i d a p a t d ie s tim a s i b e rd a s a rk a n
p o la re s p o n s p e s e rta d id ik y a n g d ib e rik a n te rh a d a p U A N . S e la n ju tn y a p e rm a s a la h a n
yang
tim b u l
yakni
“b e ra p a k a h
b a ta s
lu l u s
m a te m a tik a y a n g te rs ta n d a r (U N m is a ln y a )? ”
u jia n
m a te m a tik a
b e rd a sa rk a n
te s
U n t u k m e n j a w a b p e r m a s a l a h a n in i,
d i p e r l u k a n p e n e l i t i a n u n t u k m e n e n t u k a n b a t a s lu l u s
(cut o f score)
U j i a n n a s i o n a l a ta u
k r i t e r i a k e t u n t a s a n m i n im a l. P a d a m a k a l a h i n i a k a n d i s a j i k a n m e t o d e m e n e n t u k a n
b a t a s lu l u s d e n g a n m e t o d e A n g o f f y a n g b e r b a s i s te s .
Pengertian Kriteria Kelulusan
D e f i n i s i te n t a n g
d e fin is i m e n u ru t k a m u s.
d is e p a k a ti.
standard
te la h b a n y a k d ik e m u k a k a n p a ra p a k a r d a n ju g a
Standard
d a p a t d i a r t i k a n s e b a g a i u k u r a n a ta u p a t o k a n y a n g
Standard setting
a d a la h p ro s e s m e n e n tu k a n
cut score
te rh a d a p in s tru m e n
p e n d i d i k a n a ta u p s i k o l l o g i u n t u k m e n j a w a b p e r t a n y a a n “ s e b e r a p a b a g u s y a n g d i s e b u t
c u k u p b a g u s ” ( G e o r g e E n g e lh a r d , J r . d a n S t e p h e n E . C r a m e r , 1 9 9 5 d a l a m W il s o n ,
d k k ; 1 9 9 7 ).
K om ponen
e s e n s ia l d a ri
d i k e m u k a k a n o le h
standard setting
m e la lu i
judgment
s e p e rti y a n g
A n g o f f (1 9 7 1 ), E b e l (1 9 7 2 ), J a e g e r (1 9 8 2 ), a n d N e d e ls k y (1 9 5 4 )
a d a l a h p a n e l i s a ta u p e n i l a i a h li ( P la k e , M e l i c a n , & M i l l s ,
m e n g id e n tifik a s i d e la p a n k u a lifik a s i a h li b id a n g s tu d i
1 9 9 1 ). J a e g e r ( 1 9 9 1 )
(Subject Matter Expert,
SM E)
y a k n i ( 1 ) t e r b a i k d a l a m b i d a n g s p e s i a l i s a s i n y a ; ( 2 ) m e m i l i k i w a w a s a n y a n g lu a s
d a la m b id a n g k e a h lia n n y a ; (3 ) m e m ilik i k e m a m p u a n m e n y e le s a ik a n m a s a la h d e n g a n
c e p a t s e s u a i b id a n g n y a ; (4 ) m a m p u m e n g k a ji s e c a ra m e n d a la m
le v e l k o n s e p tu a l
d a la m b id a n g n y a d ib a n d in g k a n o ra n g b a ru ; (5 ) m e n g a n a lis is p ro b le m -p ro b le m d a la m
b id a n g n y a s e c a ra k u a lita tif; (6 ) m e n ila i p ro b le m s e c a ra le b ih a k u ra t d ib a n d in g k a n
o r a n g b a r u ; d a n ( 8 ) m e m p u n y a i d a y a i n g a t s e m a n t i k y a n g l e b i k k o m p le k s .
Standard setting
a d a l a h p r o s e s y a n g d i g u n a k a n u n t u k m e n e n t u k a n a ta u m e m i l i h
passing score
p a d a s u a tu u ji a n . D a r i s e m u a l a n g k a h - l a n g k a h d i d a l a m p r o s e s
s u a tu
3
p e n g e m b a n g a n te s ,
standard setting
m e ru p a k a n ta h a p a n y a n g le b ih d e k a t p a d a s e n i
d a r i p a d a s a in s ( il m u p e n g e t a h u a n ) ; s e d a n g m e t o d e s t a t i s t i k y a n g s e r in g d i g u n a k a n d i
standard setting,
d a l a m p e l a k s a n a a n s u a tu
ju g a le b ih b a n y a k m e la lu i p e rtim b a n g a n
d a n a ta u k e b i j a k a n . H a t t i e & B r o w n ( 2 0 0 3 ) m e n y a t a k a n b a h w a
standard m e r u p a k a n
setting performance
s u a t u p r o s e s m e m i n t a p e r t i m b a n g a n r a s i o n a l d a r i p a r a a h li y a n g
(a) m e m ilik i p e n g e ta h u a n te n ta n g
k e b u tu h a n
a k a n te s d a n
asesm en
y a n g in g i n
d i t e t a p k a n s ta n d a r n y a ; ( b ) m e m a h a m i m a k n a s k o r p a d a l e v e l y a n g b e r v a r i a s i p a d a
s k a la
yang
d ig u n a k a n
u n tu k
m e n y im p u lk a n
p e rfo rm an si
p e s e rta
te s ;
dan
(c)
m e m a h a m i s e p e n u h n y a b a ta s a n te n ta n g p re s ta s i y a n g b e rh u b u n g a n d e n g a n s ta n d a r
p e rfo rm a n s i y a n g d im in ta k a n k e p a d a m e re k a u n tu k d ite ta p k a n .
Metode Standard Setting
T e rd a p a t le b ih d a ri 3 0 m e to d e m e n e n tu k a n
standard setting
y ang b e rb e d a d an
t e l a h d i u r a i k a n d i d a l a m b e r b a g a i l i t e r a t u r p e n g u k u r a n ( G la s s , 1 9 7 8 ; H a m b l e t o n ,
1 9 8 0 ; Ja e g e r,
1 9 7 9 ). M e to d e d a la m
standard setting
p e s e r t a te s
standard setting
d ib e d a k a n m e n ja d i e m p a t,
b e r d a s a r k a n p a d a m a te r i , b u t i r / t e s y a n g d i g u n a k a n , b e r d a s a r k a n p a d a
(examenee)
d a n b e rd a s a rk a n k e b ija k a n
(judgement).
a. M e t o d e b e r p u s a t p a d a i t e m /t e s
T e s d ia n g g a p s e b a g a i s e k u m p u la n b u tir
(item pool).
M e to d e y a n g b e rp u s a t
p a d a te s in i l e b i h c e n d e r u n g m e n g g u n a k a n p e n d e k a t a n k la s i k .
M e t o d e b e r p u s a t p a d a te s m i s a l n y a :
1)
m e t o d e N e d e l s k y ( b e r d a s a r k a n b a n y a k n y a p i l i h a n ( o p ti o n ) e s e n s i a l y a n g
m e m p u n y a i f u n g s i) ,
2)
p e n i l a i a n p r o f e s s i o n a l ( b e b e r a p a p r o f e s s i o n a l d i m i n t a m e n il a i, k e m u d i a n s e c a r a
in tu itif m e n e ta p k a n p e s e rta m a n a y a n g
c r it e r ia ) ,
4
s u d a h d a n b e lu m
m e n g u a s a i w ila y a h
3)
m e to d e A n g o f f (b e b e ra p a
rater
m e n e ta p k a n
cut o f score
b e rd a s a rk a n p e rk ira a n
p e l u a n g m e n j a w a b b e n a r te r h a d a p b u t i r y a n g d i k e l o m p o k k a n b e r d a s a r k a n t i n g k a t
k e s u li ta n ) .
4)
m e to d e E b e l (m e ru p a k a n p e rb a ik a n d a ri m e to d e A n g o ff, d e n g a n
m e m p e r t i m b a n g k a n t i n g k a t k e s u k a r a n b u t i r d a n r e l e v a n s i is i.
U n t u k m e t o d e b e r p u s a t p a d a it e m , l e b i h c e n d e r u n g m e n g g u n a k a n p e n d e k a t a n
t e o r i r e s p o n s b u ti r , y a k n i :
1)
m e to d e
Bookmark
(p e rb a ik a n
m e to d e
A n g o ff,
dengan
m e m p e rtim b a n g k a n
p a r a m e t e r b u ti r )
2)
m e to d e
p e m e ta a n b u tir
( item
mapping )
yang
m e m p e rtim b a n g k a n
p a ra m e te r-
p a r a m e t e r b u t i r h a s i l e s ti m a s i.
P a d a m a k a l a h i n i a k a n d ib a h a s t e n t a n g m e t o d e A n g o f f s a ja .
Metode Angoff Tradisional (1971)
P a d a m e to d e A n g o f f k la s ik (1 9 7 1 ), p a n e lis d im in ta u n tu k b e rp ik ir te n ta n g
s u a t u k e l o m p o k p e s e r t a te s d a n m e n g e s t i m a s i p r o p o r s i d a r i m e r e k a y a n g a k a n d a p a t
m e n ja w a b ite m d e n g a n te p a t. K e m u n g k in a n in i k e m u d ia n d iju m la h k a n u n tu k s e m u a
it e m u n t u k m e m p e r o l e h
cutting score
passing score
m in im u m . R e r a ta
cut-off score
m e ru p a k an
f i n a l u n t u k s e b u a h te s . D e n g a n k a t a l a i n b a h w a , k o n s e n s u s d a r i s e m u a
p e n ila ia n a h li m e n ja d i
passing score
m in im u m .
K e u n g g u la n m e to d e A n g o f f d ib a n d in g d e n g a n p ro s e d u r y a n g la in (Im p a ra ,
2 0 0 0 :2
dan
G o o d w in ,
1 9 9 6 :2 5 3 )
a d a la h
p ro se d u rn y a
se d e rh a n a
d ila k s a n a k a n , k a re n a n y a re lia b ilita s a s e s m e n in tr a d a n in te r
t i n g g i.
M e to d a in i m e n g g u n a k a n
d ip a h a m i.
judgement
m udah
m e n ja d i
s ta tis tik s e d e rh a n a y a n g m u d a h d ih itu n g d a n
M e t o d e A n g o f f d a p a t d i l a k s a n a k a n s e b a g a i b e r i k u t ( b u t e - i n d u c t i o n .s t -
a n d r e w s .a c .u k / , 2 0 0 9 ) :
a.
dan
P a n e li s m e l i h a t b u t i r s o a l p e r t a m a d a n m e n i l a i t i n g k a t k e s u l i t a n n y a .
5
b.
S e ti a p p a n e l i s s e c a r a i n d i v i d u m e n g e s t i m a s i p e r s e n t a s e s e k e l o m p o k p e s e r t a te s
y a n g d a p a t m e n ja w a b b u tir s o a l d e n g a n b e n a r.
c.
P a n e li s m e n d i s k u s i k a n h a s i l e s t i m a s i m e r e k a .
d.
S e ti a p h a s i l e s t i m a s i d i t a b u l a s i k a n d a n d i h i t u n g r a t a - r a t a n y a .
e.
U r u t a n d i a ta s d i u l a n g u n t u k s e m u a b u t i r s o a l.
f.
R a t a - r a t a h a s i l e s t i m a s i s e ti a p b u t i r d i j u m l a h d a n d i r a t a - r a t a k a n k e m b a l i u n t u k
m e m p e ro le h
cutpoint.
Metode Extended Angoff (1997)
U n tu k
m e n y e d e rh a n a k a n p ro s e s p a d a m e to d e A n g o ff,
Im p a ra d a n
P la k e
( 1 9 9 7 ) m e n g u s u l k a n a g a r p a n e li s m e m u t u s k a n a p a k a h p e s e r t a u j i a n s e c a r a i n d i v i d u a l
m a m p u a ta u t i d a k m a m p u m e n j a w a b b u t i r s o a l d e n g a n b e n a r ( S ta h l , 2 0 0 8 ) . C a r a in i
d i n a m a k a n p r o s e d u r Y A / T I D A K . J a w a b a n d i s k o r 1 b i l a y a d a n d i s k o r 0 j i k a ti d a k .
S k o r d ip e ro le h d a ri tia p b u tir s o a l k e m u d ia n d iju m la h d a n h a s iln y a d in a m a k a n
s e b a g a i K r i t e r i a K e l u l u s a n M i n i m a l ( K K M ) a ta u
Minimum Passing Level
(M P L ) d a ri
p a n e li s . R a t a - r a t a K K M d a r i s e k e l o m p o k p a n e l i s m e r u p a k a n b a t a s k e l u l u s a n f in a l.
R a s io n a l
d a ri
m o d ifik a s i
in i
a d a la h
akan
le b ih
m udah
bagi
p a n e li s
m e m p e r k i r a k a n k e m a m p u a n s a tu p e s e r t a u j i a n d a r i p a d a k e m a m p u a n s e k u m p u l a n
p e s e r t a u ji a n , s e l a i n it u m e n j a w a b Y A / T I D A K
le b ih m u d a h d ila k u k a n d a rip a d a
m e n g h i t u n g p e r s e n t a s e ( R ic k e r , 2 0 0 9 ) .
Pelaksanaan Penentuan Standard Setting
P a d a p e l a k s a n a a n s t a n d a r d s e tt in g d e n g a n m e t o d e A n g o f f , a d a b e b e r a p a h a l
y a n g d ip e rlu k a n y a itu :
1.
P a n e li s , y a it u g u r u m a t e m a t i k a y a n g a h li d i b id a n g t e r s e b u t d a n m e m p u n y a i
p e n g a l a m a n m e n g a j a r y a n g c u k u p la m a , m i s a l n y a 1 0 ta h u n . P a n e l i s y a n g
d i p e r l u k a n m i n i m a l s e j u m l a h 11 o r a n g y a n g m e w a k i l i s e k o l a h d e n g a n p r e s t a s i
6
r e n d a h , s e d a n g , d a n t i n g g i, j u g a m e w a k i l i k e t e r w a k i l a n d a e r a h , y a k n i d e s a
a ta u p in g g i r a n , d a n k o ta .
2.
T e s m a t e m a t i k a y a n g te r s t a n d a r ,
m is a ln y a p e ra n g k a t U N
m a ta p e la ja ra n
m a te m a ti k a .
3.
K u r ik u lu m , y a n g m e m u a t S t a n d a r K o m p e t e n s i d a n K o m p e t e n s i D a s a r u n t u k
m e m b u a t d e s k r i p s i t e n t a n g h a l - h a l / i n d i k a t o r y a n g d i u k u r o le h s u a t u b u ti r .
4.
I n s t r u m e n u n t u k m e n u l i s k a n p e n d a p a t p a n e l i s t e n t a n g s u a t u b u ti r . I n s t r u m e n
y a n g d a p a t d i b u a t b e r u p a t a b e l , m i s a l n y a s e p e r t i y a n g d i s a j i k a n p a d a T a b e l 1.
Standard Setting
P e n e n tu a n
p a n e li s ,
p u ta ra n
1 dan
p u ta ra n
d i l a k u k a n d e n g a n 3 t a h a p , y a it u p e l a t i h a n k e p a d a
2.
P a d a tia p
s e l, p a n e l i s
m e n g is ik a n
p e lu a n g
m e n j a w a b b e n a r t i a p b u t i r y a n g d a p a t d i c a p a i s i s w a ( p a d a m e t o d e A n g o f f ) a ta u
m e n u lis k a n b u tir y a n g d a p a t d ija w a b d e n g a n b e n a r (Y A , p a d a m e to d e
Extended
d a ri
A n g o f f ) . R e r a t a d a r i j u m l a h p e l u a n g m e n j a w a b b e n a r s e ti a p b u t i r ( p a d a m e t o d e
A n g o f f ) a ta u
re ra ta b a n y a k n y a b u tir y a n g d a p a t d ija w a b p e s e rta (p a d a m e to d e
Extended d a r i
A n g o ff) m e ru p a k a n h a s il d a ri p u ta ra n 1 d a n p u ta ra n 2. H a s il a k h ir d a ri
standard setting
d e n g a n m e to d e A n g o ff d ite n tu k a n d e n g a n r e ra ta h a s il p u ta ra n 1 d a n
p u t a r a n 2.
T a b e l 1. C o n t o h I n s t r u m e n u n t u k M e n u l i s k a n H a s i l P a n e li s
N o . B u tir
P1
P2
P3
P4
P5
P6
1.
2.
3.
n.
K e te ra n g a n :
P : P a n e li s
7
P7
P8
P9
P10
P11
D e s k rip to r
Simpulan dan Rekomendasi
S a la h s a tu m e t o d e u n t u k m e n e n t u k a n b a t a s k e l u l u s a n y a it u m e t o d e A n g o f f ,
y a n g m e r u p a k a n m e t o d e b e r b a s i s te s . M e t o d e i n i d a p a t d i l a k s a n a k a n p a d a p e n e n t u a n
b a ta s
lu l u s
m a ta
p e la ja ra n
m a te m a tik a
b e rp e n g a la m a n , d a n m e n g g u n a k a n
m enggunakan
in s tru m e n
yang
dengan
p e ra n g k a t te s
se d e rh a n a .
m e lib a tk a n
g u ru
m a te m a tik a
y a n g te rs ta n d a rk a n , d a n h a n y a
M e to d e
in i
dapat
d ila k s a n a k a n
o le h
k e lo m p o k g u ru m a ta p e la ja ra n (M G M P ), y a n g h a s iln y a d a p a t d ig u n a k a n s e b a g a i
p e m b a n d in g k r ite ria k e lu lu s a n m a ta p e la ja ra n m a te m a tik a y a n g s e la m a in i d ig u n a k a n
o le h g u r u d i s e k o la h .
Referensi
A n g o ff, W . H . (1 9 7 1 ). S c a le, n o rm s , a n d e q u iv a le n t sco res. In R . L. T h o r n d ik e (E d .),
E d u c a tio n a l m e a s u re m e n t (2 n d ed ., pp . 5 0 8 -6 0 0 ). W a s h in g to n , D C : A m e ric a n
C o u n c il o n E d u c a tio n .
E b e l, R o b e r t L. (1 9 7 2 ). E s s e n tia ls o f e d u c a tio n a l m e a su re m e n t. E n g le w o o d C liffs: P re n tice H all.
G la s, C .A .W . e t a l.(1 9 9 7 ).A S te p M o d e l to A n a ly z e P a rtia l C re d it. In H a m b le to n , K .R &
v a n d e r L in d e n W .J. (e d s, 1 9 97), H a n d b o o k o f M o d e r n Ite m R e s p o n s e T h e o ry ,
S p rin g er.
G o o d w in , L . D . (1 9 9 9 ). R e la tio n s b e tw e e n o b s e r v e d ite m d iff ic u lty le v e ls a n d A n g o ff
m in im u m p a ss in g le v e ls f o r a g ro u p o f b o rd e rlin e e x a m in e e s. A p p lie d M e a s u re m e n t
in E d u c a tio n , 12, 13-28.
H a m b le to n , K .R . et al. (1 9 9 1 ). F u n d a m e n ta ls o f Ite m R e s p o n s e T h e o ry , S a g e P u b lic a tio n s.
H a ttie , J.A ., & B ro w n , G . T . L . (2 0 0 3 , A u g u st). S ta n d a rd se ttin g f o r a sT T le re a d in g : A
c o m p a r is o n o f m e th o d s. a sT T le T e c h n ic a l R e p o r t # 2 1 , U n iv e rs ity o f
A u c k la n d /M in is try o f E d u c a tio n .
8
Im p a ra J a m e s C . & P la k e B a r b a r a S. A C o m p a ris o n o f C u t S c o re s u s in g M u ltip le S ta n d a rd
S e ttin g M e th o d s . P a p e r p re s e n te d at th e L a rg e S c a le A s s e s s m e n t C o n fe re n c e .
S n o w b ird , U T Ju n e , 2 0 0 0 . at
h ttp ://w w w .u n l.e d u /B IA C O /c o o p /Is a c /a e ra m illa rd s im p f in a l .p d f d ia m b il ta n g g a l 27
N o v e m b e r 2005
Im p a ra , J.C ., & P la k e , B .S . (1 9 9 7 ). S ta n d a rd -se ttin g : A n a lte rn a tiv e a p p ro a c h . Jo u rn a l o f
E d u c a tio n a l M e a s u re m e n t, 34 , 3 5 3 -3 6 6 .
Im p a ra , J.C ., B a r b a r a S P la k e . 1998. T e a c h e rs ’ A b ility to E s tim a te Ite m D iffic u lty : A T e s t
o f th e A ss u m p tio n s in th e A n g o ff S ta n d a rd S e ttin g M e th o d . U n iv e rs ity o f N e b ra sk a L in c o ln . J o u rn a l o f E d u c a tio n a l M e a s u re m e n t S p rin g , 1998. V o l.3 5 , N o. 1
Im p a ra , J.C ., B a r b a r a S P la k e . 2 0 0 0 . A C o m p a ris o n o f C u t S c o re s u sin g M u ltip le S ta n d a rd
S e ttin g M e th o d s , U n iv e rs ita s N e b ra s k a - L in c o ln , P a p e r p r e s e n te d a t th e L a rg e S c a le
A s s e ss m e n t C o n fe re n c e . S n o w b ird , U T , J u n e , 2 0 0 0 .
Ja e g e r, R . M . (1 9 8 9 ). C e r tific a tio n o f stu d e n t c o m p e te n c e . In R . L. L in n (E d .), E d u c a tio n a l
m e a s u re m e n t (3 rd ed ., p p . 4 8 5 -5 1 4 ) . N e w Y o rk : A m e ric a n C o u n c il o n
E d u c a tio n /M a c m illa n .
Ja e g e r, R . M . (1 9 9 1 ). S e le c tio n o f ju d g e s f o r s ta n d a rd -se ttin g . E d u c a tio n a l M e a su re m e n t:
Issu e s a n d P ra c tic e , 10(2), 3 -6, 10.
M itz e l, H . C ., L e w is , D . M ., P a tz , R . J., & G re e n , D . R . (2 0 0 1 ). T h e B o o k m a rk P ro c e d u re :
P s y c h o lo g ic a l P e rs p e c tiv e s . In G .J. C iz e k (E d .), S e ttin g P e rf o rm a n c e S ta n d a rd s.
M a h w a h , N J.
N e d e lsk y , L . (1 9 5 4 ). A b s o lu te g ra d in g s ta n d a rd s fo r o b je c tiv e test. E d u c a tio n a l a n d
P s y c h o lo g ic a l M e a s u re m e n t, 14, 3-19.
P la k e B. S ., Im p a ra , J. C ., & Irw in , P. (2 0 0 0 ). C o n sis te n c y o f A n g o ff- b a s e d p re d ic tio n s o f
ite m p e rfo rm a n c e : E v id e n c e o f te c h n ic a l q u a lity o f re s u lts f r o m th e A n g o f f sta n d a rd
se ttin g m e th o d . J o u rn a l o f E d u c a tio n a l M e a s u re m e n t, 3 7 (4 ), 3 4 7 - 3 5 5 .
P la k e , B . S., M e lic a n , G . J., & M ills, C . N . (1 9 9 1 ). F a c to rs in flu e n c in g in tr a ju d g e c o n sis te n c y
d u rin g s ta n d a rd -se ttin g . E d u c a tio n a l m e a s u re m e n t: Is su e s a n d P r a c tic e , 10(2), 15-16,
2 2 , 25.
9
R ic k e r, K . L . 2 0 0 9 . S e ttin g C u t S co res: C ritic a l R e v ie w o f A n g o ff a n d M o d ifie d -A n g o ff
M e th o d s. E d m o n to n (A lb e rta , C a n a d a ): C e n tre f o r R e s e a r c h in A p p lie d M e a s u re m e n t
an d E v a lu a tio n U n iv e rs ity o f A lb e rta .
S ta h l, J. A . 2 0 0 8 . S ta n d a rd S e ttin g M e th o d o lo g ie s : S tre n g th s an d W e a k n e ss e s . Illin o is:
P e a rs o n V U E . D ia m b il p a d a ta n g g a l 28 S e p te m b e r 2 0 0 9 dari
w w w .ia e a 2 0 0 8 .c a m b rid g e a s s e s s m e n t.o rg .u k /c a /d ig ita lA s s e ts/1 8 0 5 0 2 _ S ta h l.p d f
10
LEMBAGA PENELITIAN DAN PENGABDIAN KEPADA MASYARAKAT
PUSAT PENELITIAN KEBIJAKAN DAN SISTEM PENGUJIAN PENDIDIKAN
No. 1226/ UN34.21/ TU/ 2012
Diberikan kepada
Dr. SamsuC3~fadi
atas peran sertanya sebagai
v
\ h \ $ r * i n t: i«
dalam acara "WORKSHOP PENENTUAN STANDARD SETTING BAGI GURU SMK KELOM POK TEKNOLOGI DAN REKAYASA"
yang diselenggarakan oleh Pusat Penelitian Kebijakan dan Sistem Pengujian Pendidikan LPPM UNY
pada tanggal 29 Desember 2012
Yogyakarta, 29 Desember 2012
M engetahui
LPPM UNY
. Dr. Anik Ghufron
IP. 19621111 198803 1001
Prof. DrTSudJi Munadi, M .Pd.
19530310 197803 1003
MENENTUKAN BATAS KELULUSAN (STANDARD SETTING)
DENGAN METODE ANGOFF
M a k a la h D is a m p a ia n p a d a W o rk s h o p P e n e n tu a n
Standard Setting
B a g i G u ru S M K
K e lo m p o k T e k n o lo g i d a n R e k a y a s a
O le h :
S am sul H ad i
H e ri R e tn o w a ti
S u d ji M u n a d i
Pusat Penelitian Kebijakan dan Sistem Pengujian Pendidikan
Lembaga Penelitian dan Pengabdian Kepada Masyarakat
UNIVERSITAS NEGERI YOGYAKARTA
2012
MENENTUKAN BATAS KELULUSAN (STANDARD SETTING)
DENGAN METODE ANGOFF *)
O le h :
S a m s u l H a d i, H e r i R e t n o w a t i , d a n S u d ji M u n a d i
Pusbijadikbangsisjian LPPM UNY
Pendahuluan
P e n ila ia n p a d a
k u rik u lu m b e rb a s is k o m p e te n s i m e n g g u n a k a n a c u a n k rite ria .
A s u m s i y a n g d ig u n a k a n p a d a a c u a n k rite ria a d a la h s e tia p p e s e rta d id ik d a p a t b e la ja r
p e l a j a r a n a p a s a ja , h a n y a w a k t u n y a y a n g b e r b e d a .
a d a l a h lu l u s d a n t i d a k lu lu s . P e n e t a p a n
skor
H a s il p e n ila ia n a c u a n k rite ria
b a t a s lu l u s a ta u d i k e n a l d e n g a n
p e n e ta p a n s ta n d a r k e lu lu s a n d a p a t d ila k u k a n m e la lu i
judgement.
P e n e ta p a n d e n g a n
c a r a i n i m e m i l i k i k e l e m a h a n , y a it u t i d a k b e r d a s a r k a n d a t a e m p i r i k d a n p r o s e d u r y a n g
t e l a h t e r u j i d i l a p a n g a n . U n t u k it u p e r l u d i c a r i c a r a y a n g d a p a t d i p e r t a n g g u n g
ja w a b k a n d a ri te o ri p e n g u k u ra n .
P e m e r i n t a h t e l a h m e n e r b i t k a n P e r a t u r a n P e m e r i n t a h N o 19 t a h u n 2 0 0 5 t e n t a n g
S ta n d a r N a s io n a l P e n d id ik a n d a la m ra n g k a m e n in g k a tk a n k u a lita s p e n d id ik a n . P P
te rs e b u t
m encakup
8
s ta n d a r n a s io n a l
p e n d id ik a n .
S a la h
s a tu
s ta n d a r
n a s io n a l
p e n d i d i k a n y a n g p e n t i n g a d a l a h s t a n d a r k o m p e t e n s i l u l u s a n ( S K L ) , y a it u k e m a m p u a n
m i n i m u m y a n g h a r u s d i m i l i k i p e s e r t a d i d i k y a n g l u l u s d a r i s u a tu j e n j a n g p e n d id ik a n .
K o m p e t e n i l u l u s a n a d a l a h k e m a m p u a n m i n i m u m y a n g h a r u s d i c a p a i p e s e r t a d id ik .
SK L
in i
m e n ja d i
acuan
d a la m
m en y u su n
k is i-k is i
u jia n
a k h ir
je n ja n g
p e n d id ik a n . K i s i - k i s i i n i d i g u n a k a n s e b a g a i a c u a n u n t u k m e n u l i s s o a l u j i a n . S ia p a
s a ja y a n g m e n y u s u n s o a l a p a b ila m e n g g u n a k a n k is i-k is i y a n g s a m a a k a n m e n g h a s il
*) M a t e r i d i s a m p a i k a n p a d a W o r k s h o p P e n e n t u a n
Standard Setting B a g i
G u ru S m k
K e l o m p o k T e k n o l o g i d a n R e k a y a s a p a d a ta n g g a l 2 9 D e s e m b e r 2 0 1 2 d i L P P M
UNY
1
k a n so a l y a n g re la tif sam a .
S o a l i n i d a p a t d i g u n a k a n u n t u k u ji a n , d a n s k o r y a n g
d i p e r o l e h d a p a t d i b a n d i n g k a n a n t a r s i s w a a ta u a n t a r s e k o la h . O l e h k a r e n a it u d a l a m
m e n y ia p k a n
soal
u ji a n ,
k is i-k is i
u jia n
h a ru s
je la s ,
s e h in g g a
soal
u jia n
dapat
d i k e m b a n g k a n l e b i h b a ik .
U jia n
N a s io n a l (U N )
E v a lu a s i B e la ja r T a h a p
yang
d ila k s a n a k a n
A k h i r ( E b ta n a s )
d i In d o n e s ia b a ik
m aupun
U jia n
it u
b e rn a m a
A k h ir N a s io n a l (U A N )
m e r u p a k a n s a la h s a tu p r o s e s p e n g u k u r a n h a s i l b e l a j a r y a n g t e l a h d i l a k s a n a k a n s e c a r a
n a s io n a l.
A dapun
tu ju a n n y a
se b a g a i b e rik u t
: (1 ) u n tu k
m e m p e ro le h
in fo rm a s i
te n ta n g m u tu h a s il p e n d id ik a n s e c a ra n a s io n a l, (2 ) m e n g u k u r p e n c a p a ia n h a s il b e la ja r
s is w a b a ik
s e k o la h /m a d ra s a h
n e g eri m a u p u n
s w a s ta ,
(3 ) m e m p e ro le h
g a m b aran
p e r b a n d i n g a n m u tu p e n d i d i k a n p a d a s e k o l a h m a d r a s a h , a n t a r s e k o l a h / m a d r a s a h , d a n
a n ta r w ila y a h d a ri ta h u n k e ta h u n , (4 ) m e n ja d i b a h a n p e n e n tu a n k e b ija k a n p e m b in a a n
s e k o la h /m a d ra s a h , (5 ) s e b a g a i b a h a n p e rtim b a n g a n d a la m m e m b e rik a n S u ra t T a n d a
T a m a t B e l a j a r d a n s e l e k s i m a s u k k e j e n j a n g p e n d i d i k a n y a n g l e b i h t in g g i.
M e s k i p u n p e l a k s a n a a n U N a d a y a n g p r o d a n k o n t r a , b a t a s lu l u s
UN
d ite n tu k a n
m enggunakan
k e b ija k a n .
Pada
ta h u n
2005,
b a ta s
(cut o f score)
lu l u s
yang
d i t e n t u k a n 4 ,0 1 . U n t u k t a h u n 2 0 0 6 d a n 2 0 0 7 , b a t a s lu l u s s e l a n j u t n y a d i t i n g k a t k a n
m e n j a d i 4 ,2 6 . B a t a s lu l u s i n i d i b e r l a k u k a n u n t u k t i g a m a t a p e l a j a r a n , y a k n i b a h a s a
I n d o n e s i a , m a t e m a t i k a d a n b a h a s a I n g g r is . N i l a i 4 ,0 1 m a u p u n 4 ,2 6 m e r u p a k a n b a ta s
y a n g re la tif re n d a h d ib a n d in g k a n b a ta s lu lu s n e g a r a -n e g a ra la in n y a , n a m u n d e m ik ia n
m a s y a r a k a t m e r e s p o n n y a d e n g a n p e n u h k e c e m a s a n d a n k e r e s a h a n , d a n b a ta s in i
d i a n g g a p t e r l a l u t i n g g i. P a d a b a t a s lu lu s u n t u k m a t a p e l a j a r a n m a t e m a t i k a , b i l a n g a n b i l a n g a n a k a n m e n j a d i s a n g a t s e n s it if . H a l i n i t e r k a i t d e n g a n m a t a p e l a j a r a n i n i y a n g
d i a n g g a p s u li t, s e h i n g g a m e n j a d i p e n y e b a b s i s w a t i d a k lu l u s d i s u a t u j e n j a n g s e k o la h .
D a la m
m enem puh
p e la k s a n a a n
UN
te ta p
p e n d id ik a n ,
dapat
lu l u s
s e la lu
sesuai
ada
dengan
h a ra p a n
tin g k a t
p e s e rta
d id ik
kem am puannya
yang
dan
m e m e n u h i s t a n d a r k o m p e t e n s i l u l u s a n y a n g t e l a h d i t e n t u k a n . T e r k a i t d e n g a n h a l in i,
b a t a s lu l u s p e r l u d i t e n t u k a n t i d a k h a n y a b e r d a s a r k a n k e b i j a k a n
2
(judgement)
d a ri
p e m e rin ta h
s e m a ta , n a m u n j u g a
b e r d a s a r k a n k e m a m p u a n s is w a .
h a ru s b e rd a sa rk a n
d a ta e m p iris
yang
a d a a ta u
K e m a m p u a n s is w a in i d a p a t d ie s tim a s i b e rd a s a rk a n
p o la re s p o n s p e s e rta d id ik y a n g d ib e rik a n te rh a d a p U A N . S e la n ju tn y a p e rm a s a la h a n
yang
tim b u l
yakni
“b e ra p a k a h
b a ta s
lu l u s
m a te m a tik a y a n g te rs ta n d a r (U N m is a ln y a )? ”
u jia n
m a te m a tik a
b e rd a sa rk a n
te s
U n t u k m e n j a w a b p e r m a s a l a h a n in i,
d i p e r l u k a n p e n e l i t i a n u n t u k m e n e n t u k a n b a t a s lu l u s
(cut o f score)
U j i a n n a s i o n a l a ta u
k r i t e r i a k e t u n t a s a n m i n im a l. P a d a m a k a l a h i n i a k a n d i s a j i k a n m e t o d e m e n e n t u k a n
b a t a s lu l u s d e n g a n m e t o d e A n g o f f y a n g b e r b a s i s te s .
Pengertian Kriteria Kelulusan
D e f i n i s i te n t a n g
d e fin is i m e n u ru t k a m u s.
d is e p a k a ti.
standard
te la h b a n y a k d ik e m u k a k a n p a ra p a k a r d a n ju g a
Standard
d a p a t d i a r t i k a n s e b a g a i u k u r a n a ta u p a t o k a n y a n g
Standard setting
a d a la h p ro s e s m e n e n tu k a n
cut score
te rh a d a p in s tru m e n
p e n d i d i k a n a ta u p s i k o l l o g i u n t u k m e n j a w a b p e r t a n y a a n “ s e b e r a p a b a g u s y a n g d i s e b u t
c u k u p b a g u s ” ( G e o r g e E n g e lh a r d , J r . d a n S t e p h e n E . C r a m e r , 1 9 9 5 d a l a m W il s o n ,
d k k ; 1 9 9 7 ).
K om ponen
e s e n s ia l d a ri
d i k e m u k a k a n o le h
standard setting
m e la lu i
judgment
s e p e rti y a n g
A n g o f f (1 9 7 1 ), E b e l (1 9 7 2 ), J a e g e r (1 9 8 2 ), a n d N e d e ls k y (1 9 5 4 )
a d a l a h p a n e l i s a ta u p e n i l a i a h li ( P la k e , M e l i c a n , & M i l l s ,
m e n g id e n tifik a s i d e la p a n k u a lifik a s i a h li b id a n g s tu d i
1 9 9 1 ). J a e g e r ( 1 9 9 1 )
(Subject Matter Expert,
SM E)
y a k n i ( 1 ) t e r b a i k d a l a m b i d a n g s p e s i a l i s a s i n y a ; ( 2 ) m e m i l i k i w a w a s a n y a n g lu a s
d a la m b id a n g k e a h lia n n y a ; (3 ) m e m ilik i k e m a m p u a n m e n y e le s a ik a n m a s a la h d e n g a n
c e p a t s e s u a i b id a n g n y a ; (4 ) m a m p u m e n g k a ji s e c a ra m e n d a la m
le v e l k o n s e p tu a l
d a la m b id a n g n y a d ib a n d in g k a n o ra n g b a ru ; (5 ) m e n g a n a lis is p ro b le m -p ro b le m d a la m
b id a n g n y a s e c a ra k u a lita tif; (6 ) m e n ila i p ro b le m s e c a ra le b ih a k u ra t d ib a n d in g k a n
o r a n g b a r u ; d a n ( 8 ) m e m p u n y a i d a y a i n g a t s e m a n t i k y a n g l e b i k k o m p le k s .
Standard setting
a d a l a h p r o s e s y a n g d i g u n a k a n u n t u k m e n e n t u k a n a ta u m e m i l i h
passing score
p a d a s u a tu u ji a n . D a r i s e m u a l a n g k a h - l a n g k a h d i d a l a m p r o s e s
s u a tu
3
p e n g e m b a n g a n te s ,
standard setting
m e ru p a k a n ta h a p a n y a n g le b ih d e k a t p a d a s e n i
d a r i p a d a s a in s ( il m u p e n g e t a h u a n ) ; s e d a n g m e t o d e s t a t i s t i k y a n g s e r in g d i g u n a k a n d i
standard setting,
d a l a m p e l a k s a n a a n s u a tu
ju g a le b ih b a n y a k m e la lu i p e rtim b a n g a n
d a n a ta u k e b i j a k a n . H a t t i e & B r o w n ( 2 0 0 3 ) m e n y a t a k a n b a h w a
standard m e r u p a k a n
setting performance
s u a t u p r o s e s m e m i n t a p e r t i m b a n g a n r a s i o n a l d a r i p a r a a h li y a n g
(a) m e m ilik i p e n g e ta h u a n te n ta n g
k e b u tu h a n
a k a n te s d a n
asesm en
y a n g in g i n
d i t e t a p k a n s ta n d a r n y a ; ( b ) m e m a h a m i m a k n a s k o r p a d a l e v e l y a n g b e r v a r i a s i p a d a
s k a la
yang
d ig u n a k a n
u n tu k
m e n y im p u lk a n
p e rfo rm an si
p e s e rta
te s ;
dan
(c)
m e m a h a m i s e p e n u h n y a b a ta s a n te n ta n g p re s ta s i y a n g b e rh u b u n g a n d e n g a n s ta n d a r
p e rfo rm a n s i y a n g d im in ta k a n k e p a d a m e re k a u n tu k d ite ta p k a n .
Metode Standard Setting
T e rd a p a t le b ih d a ri 3 0 m e to d e m e n e n tu k a n
standard setting
y ang b e rb e d a d an
t e l a h d i u r a i k a n d i d a l a m b e r b a g a i l i t e r a t u r p e n g u k u r a n ( G la s s , 1 9 7 8 ; H a m b l e t o n ,
1 9 8 0 ; Ja e g e r,
1 9 7 9 ). M e to d e d a la m
standard setting
p e s e r t a te s
standard setting
d ib e d a k a n m e n ja d i e m p a t,
b e r d a s a r k a n p a d a m a te r i , b u t i r / t e s y a n g d i g u n a k a n , b e r d a s a r k a n p a d a
(examenee)
d a n b e rd a s a rk a n k e b ija k a n
(judgement).
a. M e t o d e b e r p u s a t p a d a i t e m /t e s
T e s d ia n g g a p s e b a g a i s e k u m p u la n b u tir
(item pool).
M e to d e y a n g b e rp u s a t
p a d a te s in i l e b i h c e n d e r u n g m e n g g u n a k a n p e n d e k a t a n k la s i k .
M e t o d e b e r p u s a t p a d a te s m i s a l n y a :
1)
m e t o d e N e d e l s k y ( b e r d a s a r k a n b a n y a k n y a p i l i h a n ( o p ti o n ) e s e n s i a l y a n g
m e m p u n y a i f u n g s i) ,
2)
p e n i l a i a n p r o f e s s i o n a l ( b e b e r a p a p r o f e s s i o n a l d i m i n t a m e n il a i, k e m u d i a n s e c a r a
in tu itif m e n e ta p k a n p e s e rta m a n a y a n g
c r it e r ia ) ,
4
s u d a h d a n b e lu m
m e n g u a s a i w ila y a h
3)
m e to d e A n g o f f (b e b e ra p a
rater
m e n e ta p k a n
cut o f score
b e rd a s a rk a n p e rk ira a n
p e l u a n g m e n j a w a b b e n a r te r h a d a p b u t i r y a n g d i k e l o m p o k k a n b e r d a s a r k a n t i n g k a t
k e s u li ta n ) .
4)
m e to d e E b e l (m e ru p a k a n p e rb a ik a n d a ri m e to d e A n g o ff, d e n g a n
m e m p e r t i m b a n g k a n t i n g k a t k e s u k a r a n b u t i r d a n r e l e v a n s i is i.
U n t u k m e t o d e b e r p u s a t p a d a it e m , l e b i h c e n d e r u n g m e n g g u n a k a n p e n d e k a t a n
t e o r i r e s p o n s b u ti r , y a k n i :
1)
m e to d e
Bookmark
(p e rb a ik a n
m e to d e
A n g o ff,
dengan
m e m p e rtim b a n g k a n
p a r a m e t e r b u ti r )
2)
m e to d e
p e m e ta a n b u tir
( item
mapping )
yang
m e m p e rtim b a n g k a n
p a ra m e te r-
p a r a m e t e r b u t i r h a s i l e s ti m a s i.
P a d a m a k a l a h i n i a k a n d ib a h a s t e n t a n g m e t o d e A n g o f f s a ja .
Metode Angoff Tradisional (1971)
P a d a m e to d e A n g o f f k la s ik (1 9 7 1 ), p a n e lis d im in ta u n tu k b e rp ik ir te n ta n g
s u a t u k e l o m p o k p e s e r t a te s d a n m e n g e s t i m a s i p r o p o r s i d a r i m e r e k a y a n g a k a n d a p a t
m e n ja w a b ite m d e n g a n te p a t. K e m u n g k in a n in i k e m u d ia n d iju m la h k a n u n tu k s e m u a
it e m u n t u k m e m p e r o l e h
cutting score
passing score
m in im u m . R e r a ta
cut-off score
m e ru p a k an
f i n a l u n t u k s e b u a h te s . D e n g a n k a t a l a i n b a h w a , k o n s e n s u s d a r i s e m u a
p e n ila ia n a h li m e n ja d i
passing score
m in im u m .
K e u n g g u la n m e to d e A n g o f f d ib a n d in g d e n g a n p ro s e d u r y a n g la in (Im p a ra ,
2 0 0 0 :2
dan
G o o d w in ,
1 9 9 6 :2 5 3 )
a d a la h
p ro se d u rn y a
se d e rh a n a
d ila k s a n a k a n , k a re n a n y a re lia b ilita s a s e s m e n in tr a d a n in te r
t i n g g i.
M e to d a in i m e n g g u n a k a n
d ip a h a m i.
judgement
m udah
m e n ja d i
s ta tis tik s e d e rh a n a y a n g m u d a h d ih itu n g d a n
M e t o d e A n g o f f d a p a t d i l a k s a n a k a n s e b a g a i b e r i k u t ( b u t e - i n d u c t i o n .s t -
a n d r e w s .a c .u k / , 2 0 0 9 ) :
a.
dan
P a n e li s m e l i h a t b u t i r s o a l p e r t a m a d a n m e n i l a i t i n g k a t k e s u l i t a n n y a .
5
b.
S e ti a p p a n e l i s s e c a r a i n d i v i d u m e n g e s t i m a s i p e r s e n t a s e s e k e l o m p o k p e s e r t a te s
y a n g d a p a t m e n ja w a b b u tir s o a l d e n g a n b e n a r.
c.
P a n e li s m e n d i s k u s i k a n h a s i l e s t i m a s i m e r e k a .
d.
S e ti a p h a s i l e s t i m a s i d i t a b u l a s i k a n d a n d i h i t u n g r a t a - r a t a n y a .
e.
U r u t a n d i a ta s d i u l a n g u n t u k s e m u a b u t i r s o a l.
f.
R a t a - r a t a h a s i l e s t i m a s i s e ti a p b u t i r d i j u m l a h d a n d i r a t a - r a t a k a n k e m b a l i u n t u k
m e m p e ro le h
cutpoint.
Metode Extended Angoff (1997)
U n tu k
m e n y e d e rh a n a k a n p ro s e s p a d a m e to d e A n g o ff,
Im p a ra d a n
P la k e
( 1 9 9 7 ) m e n g u s u l k a n a g a r p a n e li s m e m u t u s k a n a p a k a h p e s e r t a u j i a n s e c a r a i n d i v i d u a l
m a m p u a ta u t i d a k m a m p u m e n j a w a b b u t i r s o a l d e n g a n b e n a r ( S ta h l , 2 0 0 8 ) . C a r a in i
d i n a m a k a n p r o s e d u r Y A / T I D A K . J a w a b a n d i s k o r 1 b i l a y a d a n d i s k o r 0 j i k a ti d a k .
S k o r d ip e ro le h d a ri tia p b u tir s o a l k e m u d ia n d iju m la h d a n h a s iln y a d in a m a k a n
s e b a g a i K r i t e r i a K e l u l u s a n M i n i m a l ( K K M ) a ta u
Minimum Passing Level
(M P L ) d a ri
p a n e li s . R a t a - r a t a K K M d a r i s e k e l o m p o k p a n e l i s m e r u p a k a n b a t a s k e l u l u s a n f in a l.
R a s io n a l
d a ri
m o d ifik a s i
in i
a d a la h
akan
le b ih
m udah
bagi
p a n e li s
m e m p e r k i r a k a n k e m a m p u a n s a tu p e s e r t a u j i a n d a r i p a d a k e m a m p u a n s e k u m p u l a n
p e s e r t a u ji a n , s e l a i n it u m e n j a w a b Y A / T I D A K
le b ih m u d a h d ila k u k a n d a rip a d a
m e n g h i t u n g p e r s e n t a s e ( R ic k e r , 2 0 0 9 ) .
Pelaksanaan Penentuan Standard Setting
P a d a p e l a k s a n a a n s t a n d a r d s e tt in g d e n g a n m e t o d e A n g o f f , a d a b e b e r a p a h a l
y a n g d ip e rlu k a n y a itu :
1.
P a n e li s , y a it u g u r u m a t e m a t i k a y a n g a h li d i b id a n g t e r s e b u t d a n m e m p u n y a i
p e n g a l a m a n m e n g a j a r y a n g c u k u p la m a , m i s a l n y a 1 0 ta h u n . P a n e l i s y a n g
d i p e r l u k a n m i n i m a l s e j u m l a h 11 o r a n g y a n g m e w a k i l i s e k o l a h d e n g a n p r e s t a s i
6
r e n d a h , s e d a n g , d a n t i n g g i, j u g a m e w a k i l i k e t e r w a k i l a n d a e r a h , y a k n i d e s a
a ta u p in g g i r a n , d a n k o ta .
2.
T e s m a t e m a t i k a y a n g te r s t a n d a r ,
m is a ln y a p e ra n g k a t U N
m a ta p e la ja ra n
m a te m a ti k a .
3.
K u r ik u lu m , y a n g m e m u a t S t a n d a r K o m p e t e n s i d a n K o m p e t e n s i D a s a r u n t u k
m e m b u a t d e s k r i p s i t e n t a n g h a l - h a l / i n d i k a t o r y a n g d i u k u r o le h s u a t u b u ti r .
4.
I n s t r u m e n u n t u k m e n u l i s k a n p e n d a p a t p a n e l i s t e n t a n g s u a t u b u ti r . I n s t r u m e n
y a n g d a p a t d i b u a t b e r u p a t a b e l , m i s a l n y a s e p e r t i y a n g d i s a j i k a n p a d a T a b e l 1.
Standard Setting
P e n e n tu a n
p a n e li s ,
p u ta ra n
1 dan
p u ta ra n
d i l a k u k a n d e n g a n 3 t a h a p , y a it u p e l a t i h a n k e p a d a
2.
P a d a tia p
s e l, p a n e l i s
m e n g is ik a n
p e lu a n g
m e n j a w a b b e n a r t i a p b u t i r y a n g d a p a t d i c a p a i s i s w a ( p a d a m e t o d e A n g o f f ) a ta u
m e n u lis k a n b u tir y a n g d a p a t d ija w a b d e n g a n b e n a r (Y A , p a d a m e to d e
Extended
d a ri
A n g o f f ) . R e r a t a d a r i j u m l a h p e l u a n g m e n j a w a b b e n a r s e ti a p b u t i r ( p a d a m e t o d e
A n g o f f ) a ta u
re ra ta b a n y a k n y a b u tir y a n g d a p a t d ija w a b p e s e rta (p a d a m e to d e
Extended d a r i
A n g o ff) m e ru p a k a n h a s il d a ri p u ta ra n 1 d a n p u ta ra n 2. H a s il a k h ir d a ri
standard setting
d e n g a n m e to d e A n g o ff d ite n tu k a n d e n g a n r e ra ta h a s il p u ta ra n 1 d a n
p u t a r a n 2.
T a b e l 1. C o n t o h I n s t r u m e n u n t u k M e n u l i s k a n H a s i l P a n e li s
N o . B u tir
P1
P2
P3
P4
P5
P6
1.
2.
3.
n.
K e te ra n g a n :
P : P a n e li s
7
P7
P8
P9
P10
P11
D e s k rip to r
Simpulan dan Rekomendasi
S a la h s a tu m e t o d e u n t u k m e n e n t u k a n b a t a s k e l u l u s a n y a it u m e t o d e A n g o f f ,
y a n g m e r u p a k a n m e t o d e b e r b a s i s te s . M e t o d e i n i d a p a t d i l a k s a n a k a n p a d a p e n e n t u a n
b a ta s
lu l u s
m a ta
p e la ja ra n
m a te m a tik a
b e rp e n g a la m a n , d a n m e n g g u n a k a n
m enggunakan
in s tru m e n
yang
dengan
p e ra n g k a t te s
se d e rh a n a .
m e lib a tk a n
g u ru
m a te m a tik a
y a n g te rs ta n d a rk a n , d a n h a n y a
M e to d e
in i
dapat
d ila k s a n a k a n
o le h
k e lo m p o k g u ru m a ta p e la ja ra n (M G M P ), y a n g h a s iln y a d a p a t d ig u n a k a n s e b a g a i
p e m b a n d in g k r ite ria k e lu lu s a n m a ta p e la ja ra n m a te m a tik a y a n g s e la m a in i d ig u n a k a n
o le h g u r u d i s e k o la h .
Referensi
A n g o ff, W . H . (1 9 7 1 ). S c a le, n o rm s , a n d e q u iv a le n t sco res. In R . L. T h o r n d ik e (E d .),
E d u c a tio n a l m e a s u re m e n t (2 n d ed ., pp . 5 0 8 -6 0 0 ). W a s h in g to n , D C : A m e ric a n
C o u n c il o n E d u c a tio n .
E b e l, R o b e r t L. (1 9 7 2 ). E s s e n tia ls o f e d u c a tio n a l m e a su re m e n t. E n g le w o o d C liffs: P re n tice H all.
G la s, C .A .W . e t a l.(1 9 9 7 ).A S te p M o d e l to A n a ly z e P a rtia l C re d it. In H a m b le to n , K .R &
v a n d e r L in d e n W .J. (e d s, 1 9 97), H a n d b o o k o f M o d e r n Ite m R e s p o n s e T h e o ry ,
S p rin g er.
G o o d w in , L . D . (1 9 9 9 ). R e la tio n s b e tw e e n o b s e r v e d ite m d iff ic u lty le v e ls a n d A n g o ff
m in im u m p a ss in g le v e ls f o r a g ro u p o f b o rd e rlin e e x a m in e e s. A p p lie d M e a s u re m e n t
in E d u c a tio n , 12, 13-28.
H a m b le to n , K .R . et al. (1 9 9 1 ). F u n d a m e n ta ls o f Ite m R e s p o n s e T h e o ry , S a g e P u b lic a tio n s.
H a ttie , J.A ., & B ro w n , G . T . L . (2 0 0 3 , A u g u st). S ta n d a rd se ttin g f o r a sT T le re a d in g : A
c o m p a r is o n o f m e th o d s. a sT T le T e c h n ic a l R e p o r t # 2 1 , U n iv e rs ity o f
A u c k la n d /M in is try o f E d u c a tio n .
8
Im p a ra J a m e s C . & P la k e B a r b a r a S. A C o m p a ris o n o f C u t S c o re s u s in g M u ltip le S ta n d a rd
S e ttin g M e th o d s . P a p e r p re s e n te d at th e L a rg e S c a le A s s e s s m e n t C o n fe re n c e .
S n o w b ird , U T Ju n e , 2 0 0 0 . at
h ttp ://w w w .u n l.e d u /B IA C O /c o o p /Is a c /a e ra m illa rd s im p f in a l .p d f d ia m b il ta n g g a l 27
N o v e m b e r 2005
Im p a ra , J.C ., & P la k e , B .S . (1 9 9 7 ). S ta n d a rd -se ttin g : A n a lte rn a tiv e a p p ro a c h . Jo u rn a l o f
E d u c a tio n a l M e a s u re m e n t, 34 , 3 5 3 -3 6 6 .
Im p a ra , J.C ., B a r b a r a S P la k e . 1998. T e a c h e rs ’ A b ility to E s tim a te Ite m D iffic u lty : A T e s t
o f th e A ss u m p tio n s in th e A n g o ff S ta n d a rd S e ttin g M e th o d . U n iv e rs ity o f N e b ra sk a L in c o ln . J o u rn a l o f E d u c a tio n a l M e a s u re m e n t S p rin g , 1998. V o l.3 5 , N o. 1
Im p a ra , J.C ., B a r b a r a S P la k e . 2 0 0 0 . A C o m p a ris o n o f C u t S c o re s u sin g M u ltip le S ta n d a rd
S e ttin g M e th o d s , U n iv e rs ita s N e b ra s k a - L in c o ln , P a p e r p r e s e n te d a t th e L a rg e S c a le
A s s e ss m e n t C o n fe re n c e . S n o w b ird , U T , J u n e , 2 0 0 0 .
Ja e g e r, R . M . (1 9 8 9 ). C e r tific a tio n o f stu d e n t c o m p e te n c e . In R . L. L in n (E d .), E d u c a tio n a l
m e a s u re m e n t (3 rd ed ., p p . 4 8 5 -5 1 4 ) . N e w Y o rk : A m e ric a n C o u n c il o n
E d u c a tio n /M a c m illa n .
Ja e g e r, R . M . (1 9 9 1 ). S e le c tio n o f ju d g e s f o r s ta n d a rd -se ttin g . E d u c a tio n a l M e a su re m e n t:
Issu e s a n d P ra c tic e , 10(2), 3 -6, 10.
M itz e l, H . C ., L e w is , D . M ., P a tz , R . J., & G re e n , D . R . (2 0 0 1 ). T h e B o o k m a rk P ro c e d u re :
P s y c h o lo g ic a l P e rs p e c tiv e s . In G .J. C iz e k (E d .), S e ttin g P e rf o rm a n c e S ta n d a rd s.
M a h w a h , N J.
N e d e lsk y , L . (1 9 5 4 ). A b s o lu te g ra d in g s ta n d a rd s fo r o b je c tiv e test. E d u c a tio n a l a n d
P s y c h o lo g ic a l M e a s u re m e n t, 14, 3-19.
P la k e B. S ., Im p a ra , J. C ., & Irw in , P. (2 0 0 0 ). C o n sis te n c y o f A n g o ff- b a s e d p re d ic tio n s o f
ite m p e rfo rm a n c e : E v id e n c e o f te c h n ic a l q u a lity o f re s u lts f r o m th e A n g o f f sta n d a rd
se ttin g m e th o d . J o u rn a l o f E d u c a tio n a l M e a s u re m e n t, 3 7 (4 ), 3 4 7 - 3 5 5 .
P la k e , B . S., M e lic a n , G . J., & M ills, C . N . (1 9 9 1 ). F a c to rs in flu e n c in g in tr a ju d g e c o n sis te n c y
d u rin g s ta n d a rd -se ttin g . E d u c a tio n a l m e a s u re m e n t: Is su e s a n d P r a c tic e , 10(2), 15-16,
2 2 , 25.
9
R ic k e r, K . L . 2 0 0 9 . S e ttin g C u t S co res: C ritic a l R e v ie w o f A n g o ff a n d M o d ifie d -A n g o ff
M e th o d s. E d m o n to n (A lb e rta , C a n a d a ): C e n tre f o r R e s e a r c h in A p p lie d M e a s u re m e n t
an d E v a lu a tio n U n iv e rs ity o f A lb e rta .
S ta h l, J. A . 2 0 0 8 . S ta n d a rd S e ttin g M e th o d o lo g ie s : S tre n g th s an d W e a k n e ss e s . Illin o is:
P e a rs o n V U E . D ia m b il p a d a ta n g g a l 28 S e p te m b e r 2 0 0 9 dari
w w w .ia e a 2 0 0 8 .c a m b rid g e a s s e s s m e n t.o rg .u k /c a /d ig ita lA s s e ts/1 8 0 5 0 2 _ S ta h l.p d f
10