36
3.4 Research Methods
As mentioned in previous section, this research is based on qualitative and quantitative approaches by mainly doing document analysis, interview, and survey. Document
analysis and interview were performed to get data about policyregulation, ICT deployment, and application and services regarding e-government, m-government and
LAPOR implementation in Indonesia. Survey was performed by distributing questionnaire to LAPOR users which was constructed from conceptual model.
3.4.1 Data Collection
Data collection consists of two parts according to the method used that are summarized in Table 4. This research uses triangulation to ensure data reliability by incorporating
different sources and methods. In term of sources, this research consulted some documents and LAPOR staffs. In terms of methods, this research performed document
investigation and questionnaire for main gathering method and semi-structured interview for triangulation.
Table 4 Data Collection Methods Summary
a. Analysis of Current State of M-Government Implementation
In-depth document analysis and interview were used to get data and information about current condition of m-government implementation in Indonesia. The documents being
37
investigated were mainly from published and unpublished documents related to e- government, m-government, LAPOR and participation in Indonesia, which were
ranging from government policies, regulations, standardisations, guidelines, white paper, and previous researches about m-government. The information being investigated
was based on the author’s understanding from literature study about the current practice
of m-government in terms of policiesregulations see Appendix D, technology, and application and services, with emphasis on mobile phone as one of most used channel
for m-government and LAPOR as the only suitable case study for this research’s topic.
b. Analysis of LAPOR Success and Citizens Perceived Benefits MeasuresConstructs
The questionnaire to evaluate LAPOR success in encouraging participation was designed based on DM IS Success Model explained in chapter 2.5 while the indicators
of the constructs were mainly adapted from prior studies to assure the content validity Wang Liao 2008. On the other hand, the questionnaire to analyse
citizen’s perceived benefits adopted Net Benefits measures developed by Scott et al. 2011. The indicators
that were operationalised into statements rated by using ‘1-6’ Likert scales, which is a
technique to measure respondent’s agreement or disagreement towards each statement in the questionnaire Noor 2011, where ‘1’ indicates strongly disagree and ‘6’ indicates
strongly agree. This even scale was determined with consideration from LAPOR experts’ suggestion since there is high possibility that the respondents will choose
neutral option. Furthermore, there is also one open-ended question for each dimension
to ask further comment about the dimensions being assessed. There are five dimensions used to measure LAPOR success in encouraging citizens to
use the systems: system quality, information quality, service quality, user satisfaction, useintention to continual use. The measures and indicators are summarised in Table 5.
38
Table 5 Measurement Indicators
39
As for the measuresconstructs of citizen’s perceived benefits, this research adopts Net
Benefits measures Scott et al. 2011 which highlight three e-government goals. There are nine measures as recapped in Table 6
and 25 items in total
1
.
Table 6 Perceived Benefits Measures Scott et al. 2011
Procedure
LAPOR success assessment in encouraging citizens’ use of system and citizens
perceived benefits were performed by distributing questionnaire with the help from LAPOR team. Questionnaire is used to elicit reliable responses with regard to what
users think and feel about the issue being brought up Collis Hussey 2014. This method can provide benefits in terms of minimum cost, shorter data collection period,
and access to wider range of audiences Robson 2011; Collis Hussey 2014. The population of the study is LAPOR users whose mobile phone number andor user
account are currently registered in LAPOR system while sample was generated differently between prospective respondents with mobile phone number and with user
account. The prospective respondents with mobile phone number were selected up to 300 users to be sent a SMS containing link to the online questionnaire with
consideration of SMS sending cost by LAPOR Meanwhile, around 5000 prospective
1
The items can be seen in the full questionnaire in Appendix A due to space limitations
40
respondents with user account were given the questionnaire’s link by email. The questionnaires were distributed from 16
th
July-28
th
July 2014 and 118 responses were collected.
On the other hand, informal semi-structured interview was used to guide data collection for triangulation
to ensure information reliability gathered from various perspectives. The interviews consisted of six
open-ended questions see Appendix B and were performed via e-mail and Skype to save time and resources Robson 2011; Collis
Hussey 2014. Data were gathered from two key persons in LAPOR team who know
best about LAPOR 3.4.2 Validity and Reliability
Validity and reliability test is important to ensure the extent to which the questionnaire can measure what it should be and the extent to which the questionnaire gives consistent
results on repeated survey Malhotra Birks 2007. Validity was assessed by examining content validation
while reliability was performed by comparing cronbach’s alpha.
Content validation procedure was performed by two experts in LAPOR team who are knowledgeable about the constructs to make sure they are appropriate to be used in case
study context Straub 1989. They were asked to review whether there is any inconsistency between items and conceptual definition, and evaluated the
representativeness and adequacy of the dimensions Lynn 1986 and readability of the questionnaire. There were
some key points from experts’ review see Appendix A for full questionnaire:
1. According to them, the information provided by SMS channel just includes
simple report and its automatic feedback which is limited only up to 160 characters while the full report and its follow-up are sent in the form of link.
Thus, in order to prevent bias perception from respondent, items SQ6 and IQ3 were removed.
2. Item IQ4 were changed into ‘Sufficiency’ since, as previous reason, there is
concern about the character limitation on SMS-based service.
41
3. Items UIU1 and UIU2 were removed since they do not differentiate between
reportcritique and aspirationideainput on national developmentpublic
services delivery issues. Furthermore, they are similar to UIU3 since it is assumed that user access LAPOR for the purpose of reporting only, not for
reading other people’s reports and doing nothing, especially for SMS-based service.
4. Item UIU3 also needs to be explained clearly especially for SMS-based service
case. The reliability test
was conducted by comparing cronbach’s alpha for each component measures. The measure is considered reliable if its cronbach’s alpha is greater than 0.7
Hair et al. 2006. As summarised in Table 7, the result shows that all measures are
reliable.
Table 7 Reliability Test
42
3.5 Data Analysis Data analysis was carried out three times based on research questions. All analyses used
conceptual frameworks explained in section 2.4 and 2.5 as a guideline. The documents listed in Appendix D and some interviews
were analysed to get better understanding about the current condition of m-government implementation for the first analysis.
Further, since LAPOR is a m-government initiative which focus on increasing participation, the evaluation of its participation level is also discussed by matching the
gathered information with participation level characterisation explained in chapter 2.4.1. The findings were analysed qualitatively and presented in the form of description.
As for the second analysis, the quantitative data from questionnaire were tabulated and interpreted by using descriptive statistics i.e. mean and standard deviation to describe
some crucial aspects of a set of data as a group by using SPSS 20.0 Wiersma Jurs 2009; Robson 2011. The mean and standard deviation of each indicator, dimension and
the overall success were calculated to help interpretation. Mean determines the success range of the indicator, dimension and overall system success while standard deviation
shows how the data disperse around mean. The overall evaluation was then performed based on the success category made by the author adapted from Heeks 2002: total
success 5-6, moderate successfailure 3-4, and total failure 1-2. This evaluation was enriched by interview findings for triangulation of the questionnaire results.
Furthermore, Spearman correlation was used to see whether quality dimensions and user satisfaction are correlated with useintention to continual use which is inferred as further
participation expectation, and to see the correlation between quality dimensions and user satisfaction as intermediary to usecontinual usage. All assumptions for Spearman
correlation had been met: the data used are continuous and non-parametric variables and there was monotonic relationship between two variables. The interpretation for
Spearman’s correlation coefficient ρ has value -1, +1, and 0 indicating strong negative, strong positive, and no correlation, respectively see Table 8.
43
Table 8 Spearmans Correlation Coefficient Statstutor 2014
The third analysis also used descriptive statistics where mean determines the most and least benefits perceived by citizens while standard deviation shows how the data
disperse around mean. Moreover, some comments from citizens and interviews from LAPOR interviewees were also analysed to supplement the questionnaire results.
3.6 Summary This research aims to explore m-government adoption in Indonesia. In order to achieve
Kategori