Human-centered Ambient Artificial Intelligence In Smart Buildings
| dc.contributor.author | He, Tianzhi | en |
| dc.contributor.committeechair | Jazizadeh Karimi, Farrokh | en |
| dc.contributor.committeemember | Lourentzou, Ismini | en |
| dc.contributor.committeemember | Lee, Sang Won | en |
| dc.contributor.committeemember | Garvin, Michael J. | en |
| dc.contributor.department | Civil and Environmental Engineering | en |
| dc.date.accessioned | 2025-08-28T08:00:35Z | en |
| dc.date.available | 2025-08-28T08:00:35Z | en |
| dc.date.issued | 2025-08-27 | en |
| dc.description.abstract | This dissertation advances human-centred Ambient Artificial Intelligence (AmI) by investigating three dimensions of context awareness, including user persona, building operations, and human states, as key components of an envisioned integrated smart built environment framework. First, a nationwide survey (N =307) quantified how demographics, prior smart home experience, and personal values shape users adoption of smart devices and their acceptance of smart building automation levels. A recommender system employing machine learning models was studied and achieved 92% accuracy and F1 score in predicting users' preferred configurations and control modes, demonstrating that user persona-driven modeling can inform adaptive configuration of smart buildings. Second, a large language model-enhanced Building Energy Management (BEM) AI agent was studied as an integration of perception, reasoning, and action modules. Evaluated on a proposed benchmark comprising 120 natural-language queries across four residential datasets, the agent achieved 86% accuracy in device control, 74% in device scheduling, 77% in multi-step energy analysis, while indicating potential for improvement in cost management (49%). Furthermore, statistical analyses showed that the proposed AI agent framework generalizes well across different buildings. These results establish a benchmark for LLM-based energy agents and highlight trade-offs between reasoning depth and computational resource requirements. Third, a comprehensive dataset—comprising two laboratory-based datasets and one real-world field dataset with varied data collection complexities—was used to investigate wearable sensor–based detection of stress as a complex human state. Eight classical machine learning classifiers and four state-of-the-art LLMs were compared using pre-processed six different biosignal inputs. On the WESAD laboratory dataset, machine learning models achieved up to 96%/94% (Accuracy/F1), while GPT-4.1 reached a comparable 91%/87% using few-shot prompting. For the more complex WDDISSE lab dataset, Gradient Boosting attained 82%/78%, and GPT-4.1 followed with 79%/73%. In the field-based WorkStress3D dataset, SVM performed best at 78%/76%, with Gemini-2.5-Pro at 74%/74%. In cross-dataset lab-to-field generalizability analyses, a fine-tuned Gemini-2.5-Flash model achieved 78%/77% performance, outperforming other cross-dataset ML and LLM baselines. The findings suggest that using statistical summary features and z-score scaling data pre-processing methods, as well as prompt engineering (Chain-of-Thought, Few-shot) and fine-tuning, can consistently improve LLM performance. Taken together, the findings on these foundational components inform future research directions for a context-aware, human-centric, and embedded Ambient Intelligence (AmI) system. The data compilation and processing methods, proposed modular architectures, and evaluation protocols studied in this dissertation may provide a reproducible foundation for future research on context-aware Ambient Artificial Intelligence in smart built environments. | en |
| dc.description.abstractgeneral | Imagine a smart building that not only responds to user commands but also learns user routines, senses the emotional state, and quietly adjusts itself to support a healthier, more efficient, and more comfortable lifestyle. That vision, identified as Ambient Artificial Intelligence (AmI), drives the research in this dissertation. We address three central questions. Who are the people living in smart buildings, and what levels of automation and what kinds of smart devices do they actually prefer? What does the building know about its own operations, such as lighting, thermostats, and energy usage, and how can Artificial Intelligence leverage that knowledge to help occupants? And how can wearable sensors, like wristbands that track heart rate and skin temperature, detect stress so the AmI can respond accordingly to support the user? To explore the first question, we surveyed over 300 people through online questionnaires. Findings revealed a strong preference for "semi-automatic" automation control that offers suggestions to users with confirmation for execution rather than full automation, with preferences shaped by age, experience with technology, and personal belief and values. These insights informed the development of a recommender system that predicts users' preferences for smart building configurations with a tested 92% accuracy. To answer the second question, we built a prototype building energy management AI agent powered by large language models (LLMs). When tested on typical user queries such as analyzing energy usage, estimating coss, controlling devices, or scheduling tasks to reduce cost, the system achieved over 80% accuracy. The findings also highlighted current limitations of the AI agent in multi-step reasoning for energy management and cost estimation tasks. The third component of this work addressed human state (specifically stress) detection in real-world settings. By evaluating two laboratory datasets, including one with standardized conditions and another with more diverse participants and complex stressors, alongside a real-world daily-life dataset, we found that traditional machine learning models perform well in controlled environments but degrade as variability increases. Large language models achieve performance close to traditional machine learning models, with a slight drop in peak accuracy, but offer stronger generalization in complex and real-world settings. In generalizability tests, a supervised fine-tuned LLM achieved approximately 75% accuracy on the real-world dataset, outperforming both traditional machine learning and baseline LLM approaches. Together, these projects integrate user profiles and preferences, building operational characteristics, and physiological sensing into a unified vision of human-centered and context-aware intelligent environments. They point toward future smart buildings that understand their occupants, communicate naturally, and intervene at the right moments, whether by dimming lights for relaxation, optimizing appliance schedules to save energy, or suggesting a calming exercise after a stressful workday. The developed tools, datasets, benchmarks, and design guidelines produced through this research aim to accelerate the transition from today's smart buildings to tomorrow's human-centered ambient artificial intelligence. | en |
| dc.description.degree | Doctor of Philosophy | en |
| dc.format.medium | ETD | en |
| dc.identifier.other | vt_gsexam:44470 | en |
| dc.identifier.uri | https://hdl.handle.net/10919/137596 | en |
| dc.language.iso | en | en |
| dc.publisher | Virginia Tech | en |
| dc.rights | Creative Commons Attribution 4.0 International | en |
| dc.rights.uri | http://creativecommons.org/licenses/by/4.0/ | en |
| dc.subject | Ambient Artificial Intelligence | en |
| dc.subject | Smart Buildings | en |
| dc.subject | Building Energy Management | en |
| dc.subject | Large Language Models | en |
| dc.subject | Wearable Sensors | en |
| dc.title | Human-centered Ambient Artificial Intelligence In Smart Buildings | en |
| dc.type | Dissertation | en |
| thesis.degree.discipline | Civil Engineering | en |
| thesis.degree.grantor | Virginia Polytechnic Institute and State University | en |
| thesis.degree.level | doctoral | en |
| thesis.degree.name | Doctor of Philosophy | en |