Heterogeneous Decision-Making in Socio-Technical Systems Methodologies for Efficiency Measurement and Decision Analysis with Mixed Data
| dc.contributor.author | Mohsenirad, Saman | en |
| dc.contributor.committeechair | Triantis, Konstantinos P. | en |
| dc.contributor.committeemember | Van Aken, Eileen Morton | en |
| dc.contributor.committeemember | Ghaffarzadegan, Navid | en |
| dc.contributor.committeemember | Topcu, Taylan Gunes | en |
| dc.contributor.committeemember | Godfrey, Joseph Richard | en |
| dc.contributor.department | Industrial and Systems Engineering | en |
| dc.date.accessioned | 2025-10-24T08:00:11Z | en |
| dc.date.available | 2025-10-24T08:00:11Z | en |
| dc.date.issued | 2025-10-23 | en |
| dc.description.abstract | This dissertation advances the performance evaluation of complex socio-technical systems (STSs) by integrating systems theory with methodological innovations in Data Envelopment Analysis (DEA). Traditional DEA models, while robust in assessing relative efficiency across multiple inputs and outputs, implicitly assume homogeneity among decision-making units (DMUs) and precise, ratio-scaled data. These assumptions fall short when confronted with the realities of STSs, which are characterized by behavioral heterogeneity, contextual variability, mixed-scale and imprecise data, and emergent performance shaped by environmental conditions. Recognizing these challenges, this research reconceptualizes DEA within a systems-theoretic framework and proposes four interrelated methodological advancements that address the epistemological and practical limitations of conventional performance analysis. The first contribution introduces a novel statistical framework for testing heterogeneity among DMUs using slack-based diagnostics and nonparametric inference. This approach empirically verifies whether observed units operate under a shared technology, providing a rigorous foundation for clustering, meta-frontier analysis, and group-specific benchmarking. The second contribution develops a multivariate fuzzy DEA methodology that enables the inclusion of ordinal, categorical, and imprecise data through the integration of Multiple Factor Analysis (MFA), fuzzy set theory, and clustering algorithms. This model enhances interpretability and robustness in efficiency evaluation under data ambiguity and contextual complexity. Third, the dissertation proposes a hybrid SEM–DEA framework to estimate and adjust for environmental influences on performance. Structural Equation Modeling (SEM) is used to quantify both direct and indirect effects of contextual variables on inputs and outputs, allowing for what-if scenario modeling and fairer cross-unit comparisons. The fourth and final contribution incorporates a behavioral modeling dimension by applying machine learning techniques—specifically Random Forests and decision tree analysis—to predict household evacuation behavior in response to Hurricane Irma. It highlights adaptive decision-making under uncertainty and the value of linking behavioral insights with performance analysis. Empirical demonstrations focus on disaster evacuation as a prototypical socio-technical system, where decision-making interacts with infrastructure, resource constraints, and diverse perceptual frameworks. Across all contributions, this research maintains a commitment to interpretability, diagnostic clarity, and systems alignment. By situating DEA within a broader systems paradigm and extending its methodological repertoire, this dissertation offers a unified analytical lens to capture efficiency, contextual sensitivity, and behavioral realism. The resulting framework provides both theoretical insight and practical tools for evaluating performance in complex, human-centered environments—advancing the applicability of efficiency analysis in engineering, policy, and socio-technical design. | en |
| dc.description.abstractgeneral | Performance evaluation, and the search for improvement, often relies on relative analysis, comparing how well different groups perform given their resources and outcomes. When environments are reasonably similar, the better-performing groups provide benchmarks for designing more effective operations. However, performance is often shaped by varying external factors, which undermine the validity of relative optimization. Through the lens of socio-technical systems, it becomes clear that performance emerges from the interaction of individuals with unique characteristics and the infrastructures they depend on. Emergency response systems like disaster evacuation illustrate this problem in practice, because evacuation performance is vital yet highly uneven. On the surface, households that leave early and relocate safely seem to perform better than those that evacuate late or with difficulty. But this apparent difference may reflect unequal conditions: some households may have cars, fuel, and reliable information, while others face outages, shortages, or mobility limits. If performance is judged only by outcomes, success may be attributed to efficiency when it is really the result of advantage, and delays may be attributed to poor choices when they stem from constraints. This misinterpretation can distort improvement efforts, focusing on copying the "best performers" instead of addressing the systemic barriers that prevent others from evacuating effectively. Viewed more broadly through the lens of socio-technical systems, performance evaluation encounters three major challenges. First, outcomes are shaped by both internal capabilities and external constraints, making it difficult to know whether differences reflect true efficiency or simply unequal conditions. Second, the data available to capture performance are rarely straightforward: alongside objective records, much of the evidence comes from subjective evaluations, which introduce uncertainty and imprecision. Third, identifying opportunities for improvement requires more than comparing outcomes; it calls for understanding the behavioral decisions that households and organizations make under complex conditions, and the factors that drive those decisions. Unless these challenges are addressed, performance comparisons risk being misleading, attributing inefficiency where the real problem is environmental constraint or systemic disadvantage. This dissertation addresses these challenges by rethinking how relative analysis is conducted in complex systems. First, it develops a statistical test to determine when groups can be meaningfully compared, so differences caused by external conditions are not mistaken for differences in capability. Second, it introduces methods for incorporating mixed and uncertain data, ensuring that valuable but non-numerical information, such as survey ratings or subjective evaluations, is systematically included in performance analysis. Third, it extends performance evaluation to account for uncontrollable conditions, such as infrastructure disruptions, so that comparisons reflect what decision-making units can actually influence rather than the circumstances imposed on them. Finally, it links performance analysis with behavioral modeling by applying predictive methods to household evacuation during Hurricane Irma, showing how shortages of fuel, transportation, and utilities shaped families' ability to evacuate in a timely and safe manner, and how these decision patterns connect directly to overall system performance. By confronting the problems of unequal conditions, imperfect data, and the role of behavioral decisions, this research builds a more realistic foundation for relative performance evaluation. It provides tools to distinguish what stems from internal capability versus what is driven by external circumstances, and to explain how decisions are shaped under complex conditions. This, in turn, creates a stronger basis for system optimization and improvement. The results offer insights that can guide emergency planning, infrastructure design, and policy development in contexts where outcomes depend on the interplay of human behavior and technical capacity. | en |
| dc.description.degree | Doctor of Philosophy | en |
| dc.format.medium | ETD | en |
| dc.identifier.other | vt_gsexam:44711 | en |
| dc.identifier.uri | https://hdl.handle.net/10919/138651 | en |
| dc.language.iso | en | en |
| dc.publisher | Virginia Tech | en |
| dc.rights | In Copyright | en |
| dc.rights.uri | http://rightsstatements.org/vocab/InC/1.0/ | en |
| dc.subject | Performance Evaluation | en |
| dc.subject | Socio-Technical Systems (STSs) | en |
| dc.subject | Heterogeneity | en |
| dc.subject | Mixed and Imprecise Data | en |
| dc.subject | Evacuation Decision Modeling | en |
| dc.title | Heterogeneous Decision-Making in Socio-Technical Systems Methodologies for Efficiency Measurement and Decision Analysis with Mixed Data | en |
| dc.type | Dissertation | en |
| thesis.degree.discipline | Industrial and Systems Engineering | en |
| thesis.degree.grantor | Virginia Polytechnic Institute and State University | en |
| thesis.degree.level | doctoral | en |
| thesis.degree.name | Doctor of Philosophy | en |