Discussion Directory UMM :Journals:Journal of Operations Management:Vol18.Issue4.Jun2000:
because of their particular position in the organiza- Ž
. tion Phillips and Bagozzi, 1986 . The use of multi-
ple informants provides researchers with a means of Ž
assessing the degree of informant bias O’Leary-
. Kelly and Vokurka, 1998 . To date, most studies
have used a single internal informant in the collec- tion of their data.
In addition, several existing studies have used interviews as a means of collecting data. Reports on
most of these did not indicate whether the interviews Ž
were structured or informal. Informal or unstruc- .
tured interviews would tend to rely more heavily on researchers’ interpretations of responses in order to
derive measurement values, and thereby increase the potential to introduce their own biases into the study.
A way to avoid this would be to use a structured interview, which would increase the uniformity of
responses across respondents and possibly lessen the amount of bias in the measurement. Other methods
for reducing informant bias include the use of an unbiased outside observer to collect data, the use of
Ž archival data e.g., COMPUSTAT or governmental
. data , or the use of a combination of multiple data
collection methods. These issues should be addressed in order to increase the validity of future research
findings.
3.4. Unit of analysis Many of the studies were conducted at the single
Ž .
Ž business unit SBU level e.g., stand-alone firms,
. autonomous divisions , and two of the studies in-
volved basic level manufacturing flexibility variables Ži.e., the individual processes that make up the pro-
. duction process . The use of a SBU as a unit of
analysis raises several important issues. The first issue involves the degree of homogeneity of plant
flexibility within a SBU. Several studies at the plant level which involved multiple plants within a com-
pany have shown that there is nonuniform flexibility
Ž .
across the plants Upton, 1995 . For studies that
measure the flexibility at the SBU level, it should not be assumed that flexibility is constant across differ-
ent production processes. Using the plant as a unit of analysis has its own
limitations, specifically the ability to assess the effect of manufacturing flexibility on firm performance
Ž .
e.g., ROI, profitability, sales growth . This limita- tion stems from the complications associated with
accurately allocating individual plant contributions to firm level performance measures. An alternative
Ž .
would be to focus on plant level or operational performance measures, such as unit costs, delivery
reliability, and defect rates. Analysis of the influence of the different manufacturing flexibility dimensions
on operational performance measures would provide valuable insight into their specific contributions and
limitations to the organization. Unfortunately, none of the plant level studies, with the exception of
Ž .
Suarez et al. 1996 , addressed these issues. 3.5. The effects of statistical power
Statistical power refers to the probability of reject- ing the null hypothesis when the null is false. In
many studies, some of the null hypotheses are not rejected, as was the case with most of the manufac-
turing flexibility studies. This can occur for many reasons, such as the theory behind the study is
erroneous, the null is correct, or the statistical power
Ž is insufficient to reject the null hypothesis i.e., the
. null is false but the results indicated that it is true .
Ž .
For example, both Ettlie and Penner-Hahn 1994 Ž
. and Suarez et al. 1996 emphasized that they did not
find any relationships between different manufactur- ing flexibility dimensions and either cost or quality
variables. Although these are noteworthy results, they also could be due to a lack of statistical power
in their analyses. Both of these studies were based on small sample sizes, which have been shown to greatly
Ž reduce the power of analysis Kraemer and Thie-
. mann, 1987 .
None of the empirical studies reviewed here as- sessed the power associated with their statistical
analyses and, therefore, the failure to reject the null hypotheses should be interpreted with caution. Until
the results of power analyses are regularly reported, it will be difficult to correctly interpret null findings.