Virginia Tech
    • Log in
    View Item 
    •   VTechWorks Home
    • ETDs: Virginia Tech Electronic Theses and Dissertations
    • Doctoral Dissertations
    • View Item
    •   VTechWorks Home
    • ETDs: Virginia Tech Electronic Theses and Dissertations
    • Doctoral Dissertations
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Examining the Evaluation Capacity, Evaluation Behaviors, and the Culture of Evaluation in Cooperative Extension

    Thumbnail
    View/Open
    Vengrin_CA_D_2016.pdf (2.727Mb)
    Downloads: 993
    Date
    2016-01-28
    Author
    Vengrin, Courtney Ahren
    Metadata
    Show full item record
    Abstract
    Evaluation is a burgeoning field and remains fairly young by most standards. Within Cooperative Extension, evaluation practices have been implemented at a variety of levels given that evaluation is mandatory for much of the funding Cooperative Extension receives. With evaluation in high demand, it is expected that most Extension educators are performing some levels of evaluation as a routine part of their jobs. In order to perform the required evaluations, an Extension educator must exhibit some level of knowledge and skill regarding evaluation. While much research to date has been done on the level of evaluation within the organization, there is a lack of understanding regarding the evaluation competencies that Extension educators must possess and the culture of evaluation within the organization. This study set out to examine the evaluation competencies, culture, and evaluation behaviors within Cooperative Extension. Utilizing an online survey format and quantitative methodology, a widely accepted set of evaluation competencies were examined for their importance within Cooperative Extension. A panel of 13 experts was selected to examine the competencies and it was determined than all competencies in the list were necessary for Extension educators to exhibit in their jobs. The list of competencies was then combined with a subscale regarding culture and a subscale based on the Theory of Planned Behavior (Ajzen, 1991). A total of 419 Extension educators in four Extension systems participated in the study, with 222 generating usable data for a response rate of 13%. The highest and lowest skill level for the competencies were determined by Extension educators self-reporting. Perception of importance of each competency was examined and the highest and lowest importance rankings were determined. These were compared to the rankings of importance by the expert panel. A path analysis was conducted by modifying the Theory of Planned Behavior model and multiple regression analysis. Mean weighted discrepancy scores were calculated to determine the differences in skill level and perception for each of the competencies. The subscale of culture was examined for potential areas of Evaluation Capacity Building (ECB) within the organization. Results show that while there was much agreement between the expert panel and Extension educators regarding the importance of competencies, experts ranked all competencies as important while Extension educators did not. The results of the path analysis determined intention and perceived behavioral control explained 3.9% of the variance in the evaluation behavior exhibited by skill. Subjective norm and attitude explained 11.8% of the variance within intention. Perceived behavioral control, attitude and culture accounted for 13.1% of the variance in subjective norm. Culture and perception accounted for 7.1% of the variance in attitude. Perception, program area, college major, location, training in evaluation, degree level and years of experience explained 28% of the variance within evaluation culture. Finally, recommendations for practice and future research were made based on these findings.
    URI
    http://hdl.handle.net/10919/64513
    Collections
    • Doctoral Dissertations [15809]

    Related items

    Showing items related by title, author, creator and subject.

    • Thumbnail

      A Meta-Evaluation of Taiwan Ministry of Education's National Technology Institutes Evaluation: A Study of Evaluation Team's and Stakeholders' Judgements on the Evaluation Practice 

      Lee, Bruce Tien-Lung (Virginia Tech, 1995-05-05)
      A meta-evaluation of the Taiwan Ministry of Education's 1990 National Technology Institutes Evaluation practices was conducted. The major focus of the meta-evaluation was to compile pertinent information and to make ...
    • Thumbnail

      The two-way gender bias in management evaluations and decision making: evaluations of managers vs. evaluations of grievants 

      Luthar, Harsh K. (Virginia Tech, 1993-08-20)
      This study consisted of two field experiments and examined how managerial evaluations may be influenced by the gender and gender-role behavior of the person being evaluated. Literature streams in the domains of leadership, ...
    • Thumbnail

      A Study and Project-Based Evaluation of the Software Engineering Evaluation System (SEES) 

      Arthur, James D.; Frakes, William B.; Gupta, Sanjay; Cannon, Martha; Groener, Markus K.; Khan, Zakia (Department of Computer Science, Virginia Polytechnic Institute & State University, 1997-02-01), TR-97-06
      The purpose of this document is to describe the design and execution of the quasi-experiment conducted in the Department of Computer Science, Virginia Tech, in accordance with the procedures described in the document "An ...

    If you believe that any material in VTechWorks should be removed, please see our policy and procedure for Requesting that Material be Amended or Removed. All takedown requests will be promptly acknowledged and investigated.

    Virginia Tech | University Libraries | Contact Us
     

     

    VTechWorks

    AboutPoliciesHelp

    Browse

    All of VTechWorksCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

    My Account

    Log inRegister

    Statistics

    View Usage Statistics

    If you believe that any material in VTechWorks should be removed, please see our policy and procedure for Requesting that Material be Amended or Removed. All takedown requests will be promptly acknowledged and investigated.

    Virginia Tech | University Libraries | Contact Us