ch nic
al G
uid eli
ne s f
or E
va lu
ati ng
th e M
an ag
em en
t E ffe
cti ve
ne ss
o f A
qu ati
c, C
oa sts
a nd
S m
all Is
la nd
s C on
se rv
ati on
A re
as E
-K K
P 3K
30
Technical Guidelines for Evaluating the Management Effectiveness of Aquatic, Coasts and Small Islands Conservation Areas E-KKP3K
31 31
34
CRITERIA NO.
QUESTION ANSWER
VERIFICATION TOOL REMARKS
Yes No
15. Socio- economic
cultural management
B64 Has the incidence of breaches
in the conservation area decreased?
Patrol reports containing data about illegal and environmental unfriendly
activities, and the number of habitats damaged in the conservation area
time series reports, community patrol reports.
Self-explanatory.
B65 Do stakeholders use the
conservation area as a place for training and education?
Reports on training and education in the conservation area.
Self-explanatory. B66
Do tourism activities in the conservation area provide
socio-economic benefits to stakeholders, particularly the
local community? Impact analysis of tourism
activities in the conservation area. Self-explanatory.
B67 Do aquaculture activities in the
conservation area provide socio-economic benefits to
stakeholders, particularly the local community?
Impact analysis of aquaculture activities in the conservation area.
Self-explanatory.
B68 Do capture fisheries activities in
the conservation area provide socio-economic benefits to
stakeholders, particularly the local community?
Impact analysis of capture fisheries in the conservation area.
Self-explanatory.
Total number of ‘Yes’ answers Percentage
35 Level
Stage
Gold
5: Self Sustaining Conservation Area
CRITERIA NO.
QUESTION ANSWER
VERIFICATION TOOL REMARKS
Yes No
13. Institutionaliz
ation
E69
Are partnerships with stakeholders progressing well
and having a positive impact? Activity and monitoring reports, and
independent study reports that indicate a positive impact from
partnerships.
Self-explanatory.
16. Improving community
welfare
E70
Is management having a positive impact on management
performance? Independent study reports that
indicate management activities have a positive impact on the area’s
resources, and on social and economic aspects including
management organization.
Self-explanatory.
E71
Have incomes purchasing power increased as an impact
of management? Surveillance reports independent
evaluations, statistics agency data.
Self-explanatory. E72
Has economic activity in core sectors in the conservation area
fisheriestourism increased? Surveillance reports independent
evaluations, statistics agency data.
Self-explanatory. E73
Have increased local incomes raised public awareness of the
need to support conservation of the area’s resources?
Surveillance reports independent evaluations.
Self-explanatory.
17. Sustainable
funding
E74
Have activities carried out been a part of a sustainable funding system
that engages stakeholders? Activity reports and financial
reports.
Self-explanatory.
Total number of ‘Yes’ answers Percentage
32
Technical Guidelines for Evaluating the Management Effectiveness of Aquatic, Coasts and Small Islands Conservation Areas E-KKP3K
32
Te ch
ni ca
l G ui
de lin
es fo
r Ev
al ua
tin g
th e
M an
ag em
en t E
ffe ct
iv en
es s
of A
qu at
ic , C
oa st
s an
d S
m al
l I sl
an ds
C on
se rv
at io
n A
re as
E- K
K P
3K
33 33
36
The steps involved in evaluating management effectiveness are summarized in Figure 2 below.
Figure 2 – Steps in evaluating management effectiveness
The first step is to form the team that will perform the evaluation. In general, the composition of the team depends on the aim of the evaluation activity itself; whether
it is for evaluation purposes or for planning activities to improve management performance.
For evaluation purposes, it is strongly recommended that 50 of the team is made up of people other than management, in particular representatives of the
direct stakeholders such as representatives of fishers, tourism businesses, other community members, and the other 50 from the conservation management team,
in particular the unit head and planners. For planning purposes, all the team members could come from the local area, but
involving stakeholders such as local Marine Affairs Fisheries agency, the Directorate for Conservation of Area and Fish Species, and other relevant institutions
such as the National Aquatic Conservation Area Office and the Coasts and Marine Resources Management Office, is strongly recommended.
The next step is to gather the necessary background and baseline data to assist the next step, which is completing the evaluation score card. Please note that what is
meant by baseline data here includes, but is not limited to, decrees, minutes of meetings or workshops, and activity reports. In other words, anything that can be
used as a tool to verify ‘Yes’ answers, if agreed, can be used as baseline data.
Form evaluation team
Collect background and baseline data
Complete evaluation score card
Make a list of recommendations
Prioritize recommendations
37
group discussions should be limited to a maximum of 10 participants. As well as to obtain the consensus of the evaluation team members, the focus group discussions
should also act as a control of the responses given. As the score cards presented above show, and as presented in the appendix, as far as possible, positive ‘Yes’
responses should be backed by concrete proof that verifies the answer. Because only by giving as honest answers as possible can a list of recommended activities for the
subsequent stage be made. Preparation of the list of recommended activities should be based on all the ‘No’
answers generated at each level. Prioritizing of the recommended activities should be based on availability of funding and resources. It is strongly recommended that the
priority scales commonly used by government agencies be used here.
How to answer the questions
There are two possible answers to the questions on the score card: ‘Yes’ and ‘No’. It should be added here that ‘Yes’ answers should be given for activities or
matters related to the question that have been done or completed. Therefore, if
an activity is still in progress, or, for example, has been done but no report has been produced yet, the answer is ‘No’. However, there are some more specific questions
related to activities that could be answered ‘Yes’ for example, question K13.
How to measure achievement at each stage
To determine achievement at each stage, the following simple formula is used: Achievement percent
= Number of ‘Yes’ answers
Number of questions at the level being evaluated
x100 Red = 8; Yellow = 11; Green = 21; Blue = 28; Gold = 6
Example: If at level Red, the answer to 5 questions is ‘Yes’, achievement at this level is 58 x
100 = 62.4 If at level Green, the answer to 10 questions is ‘Yes’, achievement at this level is
1019 x 100 = 52.6 If at level Blue, the answer to 15 questions is ‘Yes’, achievement at this level is
1527 x 100 = 55.6
How to determine the level of a conservation area
To determine the level of the conservation area evaluated, the following simple rules are applied. If a conservation area achieves a perfect score of 100 for a particular
level, then it is at that level. This simple rule applies because this evaluation is based
34
Technical Guidelines for Evaluating the Management Effectiveness of Aquatic, Coasts and Small Islands Conservation Areas E-KKP3K
34
Te ch
ni ca
l G ui
de lin
es fo
r Ev
al ua
tin g
th e
M an
ag em
en t E
ffe ct
iv en
es s
of A
qu at
ic , C
oa st
s an
d S
m al
l I sl
an ds
C on
se rv
at io
n A
re as
E- K
K P
3K
35 35
38
on the principle of building blocks, whereby the next level cannot be attained if all the activities at the previous level have not be done or completed. Following are
some practical examples. It is should be emphasized here that the software used determines the level automatically.
Example: If the result of the evaluation is as follows,
Red Yellow
Green Blue
Gold
100 100
90 27
the conservation area being evaluated is level YELLOW. Another example:
If the result of the evaluation is as follows,
Red Yellow
Green Blue
Gold
95 47
20
the conservation area being evaluated is level RED, with a 95 achievement. Another example:
If the result of the evaluation is as follows,
Red Yellow
Green Blue
Gold
100 85
27 9
the conservation area being evaluated is level RED.
How to present the level of a conservation area
For reporting purposes then, only the level color and percentage achievement need be presented in reports, or for example, factsheets. Several examples are given
below:
100 means the conservation area is level RED
100 means the conservation area is level YELLOW 100
means the conservation area is level BLUE
39
A. Evaluation Data Collected
