An evaluation model for career information delivery systems

Abstract

No uniform plan has been developed to evaluate career information delivery systems or to collect data from the various systems. Out of this context, a theoretical evaluation model was developed by which internal or external evaluators of career information delivery systems may develop evaluation strategies.

The proposed model offers a comprehensive approach to the study and evaluation of career information delivery systems. A symbolic representation and narrative description of the various aspects of the proposed model are presented. Three groups of data sources have been identified to make significant contributions for immediate and longitudinal studies and include: (1) users (students and clients); (2) user site personnel (staff/counselors); and (3) administrators. The coordinated and interrelated parts of career information delivery systems are identified as (1) the organization and management structure, (2) information development, (3) information delivery, (4) user services, (5) economic efficiency, and (6) user impact. The model is flexible enough to allow for a wide variety of evaluation strategies and can be divided, as appropriate, into several phases.

Furthermore, a sample evaluation study on a major component of the evaluation model, information delivery, was implemented on the 1981 Virginia Career Information Delivery System microfiche. The data for this study was collected by three methods: (1) a questionnaire to obtain user reactions and demographic information, (2) a questionnaire to obtain site information and, (3) on site interviews with structured questions to gather information in a less formal method.

The purpose of this phase of the study was to illustrate proper application of one phase of the model which addressed the seventeen performance evaluation criteria identified by NOICC and thirteen additional items specific to state data collection identified by this writer.

It is believed that this model will serve as an overall framework for future and more comprehensive studies, and in the end will improve career information delivery systems.