Assessing systems thinking: A tool to measure complex reasoning through ill-structured problems

TR Number
Date
2018-06
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract

An increasingly important aim of higher education is to develop graduates capable of addressing complex, interdependent problems. Systems thinking is a critical interdisciplinary skill that describes the cognitive flexibility needed to collaboratively work on problems facing society. Although institutions of higher education are asked to develop systems thinkers and many programs strive towards such an aim, mechanisms to assess this competency are lacking. This paper (1) presents a framework for operationalizing systems thinking competency, and (2) shares a novel scenario-based assessment tool based on the framework. The paper describes the iterative development of the community-level problem scenario and associated scoring rubric based on a set of 93 student responses. Appendices contain the full tool consisting of the problem scenario, scoring rubric, and other guiding documents to enable others to adopt the tool for research purposes or to assess student outcomes from university programs.

Description
Keywords
Systems thinking, Problem-solving, Ill-structured problems, Complex problems, Wicked problems, Assessment tool, Scenario-based assessment, Rubric, College-wide learning outcomes
Citation