A Meta-Evaluation of Taiwan Ministry of Education's National Technology Institutes Evaluation: A Study of Evaluation Team's and Stakeholders' Judgements on the Evaluation Practice

Abstract

A meta-evaluation of the Taiwan Ministry of Education's 1990 National Technology Institutes Evaluation practices was conducted. The major focus of the meta-evaluation was to compile pertinent information and to make comparisons of performance relative to the utility, feasibility, propriety, and accuracy of the Taiwan Ministry of Education's 1990 National Technology Institutes Evaluation practices as perceived by the evaluation team members (evaluators) and the stakeholders (the evaluated). The evaluation team and stakeholders were also asked to assess the importance of 30 Program Evaluation Practice Standards for the evaluation. Data were collected through mailed questionnaires and informal interviews. Information gleaned from this study were based on responses received from the 1990 Taiwan National Technology Institutes Evaluation team members and the stakeholders including institute presidents and academic program leaders. Results of the study provided the basis for improving the evaluation practices of the Taiwan National Technology Institutes Evaluation including recommendations for improving the evaluation model, policies, procedures, and practices.

Results of the study revealed that:

1. The evaluation team and stakeholders held similar beliefs regarding the importance of the 30 Program Evaluation Practice Standards for the 1990 Taiwan National Technology Institutes Evaluation. The Program Evaluation Practice Standards were perceived as important ideals for the orientation of the process and practice of evaluation in Taiwan.

2. The evaluation team and stakeholders gave similar assessments as to the utility, feasibility, propriety, and accuracy of the 1990 Taiwan National Technology Institutes Evaluation practice.

Based upon analyses of the data, the findings indicated that the evaluation system employed by the Taiwan Ministry of Education produces outcomes that are overall acceptable to both the evaluators and the evaluated. As the result, recommendations were offered and reviewed by a panel of experts in Taiwan.