Multi-Method Approach to Understand Pilot Performance in a Sociotechnical Aviation System

This research examined human-machine performance in a General Aviation (GA) environment under dynamic conditions using a combination of field study and laboratory experimentation. Using this combination of methods, the functional system of pilots performing a landing approach (both instrument and visual) with a Cessna 172 to the Roanoke Regional Airport (ROA) was described and analyzed. In the field study, data collection was guided by an integrative method based on macroergonomics (ME) and distributed cognition (DC), allowing the cognitive aspects of a sociotechnical system to be treated as equally important as the organizational components. Also of interest was how pilot performance was affected by the introduction of nighttime and deteriorating weather conditions to this GA environment. Few statistically significant differences were found between pilots who flew by visual flight rules (VFR) and those who flew by instrument flight rules (IFR) or within each of these pilot groups in terms of objective flight performance. However, there were several significant differences between VFR and IFR pilots and within each pilot group in terms of workload and especially situation awareness across conditions; situation awareness for VFR pilots was found to be significantly reduced compared to situation awareness for IFR pilots in nighttime and deteriorating weather conditions (p < 0.05).

In addition to these statistical findings and the methodological contribution of a joint systems/cognitive method, contributions of this dissertation include a greater understanding of the GA pilot/cockpit system and a systems-oriented cognitive model of this aviation environment as described by the ME/DC method for both VFR and IFR pilots. Further, procedural comparisons were performed between the flight simulator and the actual Cessna 172 used in the field study to increase our understanding of how to improve the validity associated with using simulators in research. Findings from both the laboratory and field studies in this research support new designs and technologies envisioned for future aviation systems that would assist the pilot during a landing approach such as weather information systems, head-up displays, synthetic vision, three-dimensional auditory displays, increased automation, and communications filters. Potential future applications of this research are also explored.