Identification of Evaluation Criteria

Figure 3.2 Flow of the research process

3.3.1 Identification of Evaluation Criteria

The set of evaluation criteria is problem specific depending on the particular system being analyzed. The criteria selected should reflect all relevant condition to the decision problem and must contribute toward achieving the objectives. There is no universal technique available for determining a set of criteria. Likewise, a set of criteria is good if it is: 1 complete i.e. covers all aspects of a decision problem; 2 operational i.e. is meaningful to a decision 33 situation; 3 decomposable i.e. is amenable to partitioning into subsets of criteria, which may be necessary to facilitate a hierarchical approach to decision analysis; 4 non-redundant i.e. avoids the double-counting of decision consequences; and 5 minimal i.e. has the property of the smallest complete set of criteria characterizing the consequences of a decision. Developing criteria could be done through literature studies, analytical studies and survey of opinions. This research used literature study and survey of opinion in form of interview and discussion to develop evaluation criteria. Literature study was done to understand the relevant topics of mud hazard in Sidoarjo. Sources of the study include journal papers about impacts of hazard in Sidoarjo, monitoring reports of Lapindo hazard by BPLS, and internet sources of official or reliable institutions. The interview and discussion with experts were used to facilitate comparability and processing of results of literature study. Both interviews and discussions were done by face-to-face approach with some experts from various discipline area i.e. BPLS, Centre of Environmental Geology and disaster researchers. Interview is used to gain an understanding of the underlying reasons and motivations for people’s attitudes, preferences or behavior. People or a group of experts who will be affected by decision was asked to identify the criteria that should be included in a decision analysis. In general an interactive, step-by-step, staged interview approach is followed: a first round with a few, general questions and a subsequent round for more detailed specific questions. 34

3.3.2 Hierarchical Structure of The Criteria