Browsing by Author "Scales, Glenda R."
Now showing 1 - 20 of 21
Results Per Page
Sort Options
- Adult Literacy for Incarcerated Adults: Using a community approach and peer-mentors to create access to Open Educational ResourcesScales, Glenda R.; Walz, Anita R. (2022-09-08)Invited presentation for the Correctional Services Literacy and Reading Symposium, Drakenstein Correctional Centre, Western Cape, South Africa.
- Application of Human-computer Interaction Theories to Information Design on Internet PortalsRao, Sushma (Virginia Tech, 2002-07-11)Internet portals are increasingly becoming a primary source of information. A portal is a gateway to information on the Internet or a hub from which users may locate relevant information (Strauss, 2000). Because university Web sites have various user classes, universities are beginning to adopt the portal concept for their Web sites. The study conducted aimed to determine the effect of tailoring information content and presentation style on a university Web portal. User ratings of information design on three metrics and user task performance measures of time and errors were compared for four prototypes. Three prototypes were built on the basis of user requirements and two Human-computer Interaction (HCI) theories and one was a replica of an existing academic information portal. The three metrics were derived from the HCI theories. The contributions of the study are a determination of user acceptance of and user performance with the tailored presentation styles and three metrics derived from HCI theories that can be used to compare alternative information presentation styles for portals. An important contribution is the remote data collection technique that was used in the study and a time-stamping technique that recorded clicks on hyperlinks.
- The Attitudes of African American Middle School Girls Toward Computer Science: Influences of Home, School, and Technology UseRobinson, Ashley Renee (Virginia Tech, 2015-05-13)The number of women in computing is significantly low compared to the number of men in the discipline, with African American women making up an even smaller segment of this population. Related literature accredits this phenomenon to multiple sources, including background, stereotypes, discrimination, self-confidence, and a lack of self-efficacy or belief in one's capabilities. However, a majority of the literature fails to represent African American females in research studies. This research used a mixed methods approach to understand the attitudes of African American middle school girls toward computer science and investigated the factors that influence these attitudes. Since women who do pursue computing degrees and continue with graduate education often publish in Human-Computer Interaction (HCI) in greater proportions than men, this research used an intervention to introduce African American middle school girls to computational thinking concepts using HCI topics. To expand the scope of the data collected, a separate group of girls were introduced to computational thinking concepts through Algorithms. Data were collected through both quantitative and qualitative sources, and analyzed using inferential statistics and content analysis. The results show that African American middle school girls generally have negative attitudes toward computer science. However, after participating in a computer science intervention, perceptions toward computer science become more positive. The results also reveal that four factors influence the attitudes of African American middle school girls toward computer science, such as the participation in an intervention, the intervention content domain, the facilitation of performance accomplishments, and participant characteristics like socioeconomic status, mother's education, school grades, and the use of smart phones and video game consoles at home.
- The Career Goal-Setting Processes of Black Woman Engineering MajorsDeLoach, Adrien D. (Virginia Tech, 2020-06-09)Despite widespread efforts to reduce inequities in the science, technology, engineering, and mathematics (STEM) job market, huge disparities remain for both African Americans and women in those sectors of employment. Extant literature affirms that Black women encounter various challenges when pursuing STEM careers. More specifically, the research on Black women in engineering focuses primarily on their experiences in academia and does not include their experiences as undergraduates transitioning into the industry workforce. To address these gaps in the literature, this study explored the career goal-setting (CGS) processes of Black woman engineering majors (BWEMs) through qualitative inquiry. Using a phenomenological approach, the researcher implemented a two-interview sequence with five Black/African American women enrolled in their final year of a baccalaureate engineering program at a predominantly White institution (PWI) in the southeast. Possible selves theory (Lee and Oyserman, 2009; Strauss, Griffin, and Parker, 2012) served as the framework for the guiding research questions and interview protocol, which were designed to capture the essence of the participants' experiences as they respectively engaged in setting career goals. The findings revealed that the participants' CGS processes encompassed a series of cognitive steps, which included their thoughts about goal-setting in general, exploring engineering careers, making adjustments academically, finding an area of career specialization, and dealing with anxiety related to the challenges they encountered as engineering majors. In addition, possible selves theory was used to explain how the participants' understanding of their experiences in current contexts influenced who they wanted to become in future work conditions.
- Community College Students Taking Online Courses: The Student Point-of-ViewHarbeck, Julia Dedrich (Virginia Tech, 2001-01-24)This study is a qualitative examination of community college students' experiences taking on-line courses. The study addresses the research question, "How do community college students construct their on-line experiences?" In order to answer this question, the following foci were examined: What are the characteristics of students taking online courses?, Why are they taking on-line courses?, What are facilitative or debilitative dimensions or features that promote or inhibit success in on-line courses?, and, How does the community college infrastructure support students taking web-based courses? The results of the study were grouped into 4 categories: Interpersonal Support, Student Characteristics, Course Issues, and Infrastructure Support. All but 2 of the findings of the PRCC Study are supported by research. The first factor not mentioned in the literature is that some students choose to take a course on-line if they are not interested in the content of the class. The second finding not implicated in the research is that electronic distractions of Instant Messaging™ and the lure of surfing the Web seem to be more debilitating than interruptions from other sources such as family and work. Other implications of this study involve concerns that are common to both on-line and on-site instruction, as well as the connection between constructivism and on-line learning. Facilitative and debilitative dimensions or features that promote or inhibit success in on-line courses imply that faculty and institutions need to be adapting to the demands of teaching and learning on the Web. Implications of the Study examine improvements to the study and ideas for future research.
- A Cross-Cultural Examination: Effects of Reward Systems and Cultures on Low Severity Risk-Taking Behavior in ConstructionThongsamak, Sasima (Virginia Tech, 2007-09-04)The overall research objective was to identify the effects of reward systems (rewards and a penalty) on risk-taking behavior and performance (quality and time) of construction workers from different cultures (American, Asian, and Latin American cultures). This research used the sociotechnical system as the underlying, guiding scientific framework. The research found that Americans and Latin Americans had higher risk-taking behavior than Asians (p<0.01). No difference in risk-taking behavior was found between Americans and Latin Americans (p<0.05). Although culture may influence individuals' risk-taking behavior, the results from this study showed that risk-taking behavior could be altered and suppressed by providing individuals with the proper safety training, education, and safety equipment. Customized safety training for people from different cultures would be useful because the culture elements that contribute to high risk-taking behavior could be addressed. The results also showed that the effects of reward systems on risk-taking behavior were not statistically significant (p>0.1). One possibility that no difference was found may be because the tasks used in this study did not contain enough possibility for participants to take more risk. The effects of reward systems on risk-taking behavior may have been reduced by the low possibility of risky behavior. It is suspected that if the tasks contained more opportunities for participants to take risk, differences in risk-taking behavior would have been significant. The researcher concluded that risk perception is situation-specific and has an influence on the individual's risk-taking behavior on that particular situation but cannot be used to predict risk-taking behavior. Also, general locus of control and general self-efficacy cannot be used to predict risk-taking behaviors. These findings are consistent with many studies that explore locus of control (Iversen & Rundmo, 2002; Rolison & Scherman 2002; Crisp & Barber, 1995), and many researchers that suggested self-efficacy is situation specific (Murdock et al., 2005; Martin et al., 1995; Perraud, 2000; Slanger & Rudestam, 1997). This study also found no relationship between risk-taking behavior and productivity, for both time and quality.
- Designing a business reengineering information system with performance support concepts: a description of the system analysis processScales, Glenda R. (Virginia Tech, 1995)This naturalistic case study investigated a business reengineering project at a large company located in the Northeast. Because the Human Resources (HR) department had downsized, decision makers within HR began investigating the feasibility of customizing a purchased HR Information System. To ensure that the new HR information system was usable by all employees, project leaders wanted to include performance support concepts into the customization of the system. The main focus of my research was investigating the major issues associated with incorporating performance support principles into a system development life-cycle model. The analysis of these data included a qualitative approach where I described the critical events relating to performance support system development that occurred on the project. In addition, I used the diffusion of innovation theory to analyze and interpret the data. Results indicated that there were major inconsistencies with the term "performance support" and the need for implementing performance support solutions on the project. Some Information Technology team members realized the importance of incorporating performance support into the system development life-cycle. However, because of the tight time frame for customizing the software with performance support concepts, several members of the Information Technology team believed that incorporating performance support for the initial release was unreasonable. For the initial release of the new HR information system the role of the Performance Support team shifted from seeking performance support solutions towards pursuing traditional training solutions for teaching employees how to use the HR information system.
- Development and Evaluation of a Decision Support Tool to Incorporate Redundancy in the Development of Instructional MaterialsCox II, Larry Alenda (Virginia Tech, 2024-04-25)Novice Instructional Designers (IDs) often struggle to perform at the same level as experts. Specialized knowledge and experience are needed to discover the challenges and device appropriate solutions. Scaffold, guides, and heuristics can help novice when needing to perform tasks that require specialized knowledge. One common instructional design task requiring specialized knowledge is the development of instructional materials. Instructional message design (IMD) is a problem solving process to improve the quality of instructional materials through the application of research based principles. As this process is often not covered in novice IDs training, they will encounter more issues while attempting to address the challenges that come with creating instructional materials. Using a developmental study, a decision support tool was created to assist novice IDs with applying IMD, specifically the redundancy principle due to its ability to improve the communication within the materials. This study describes the operationalization of the principle, the design and development of the tool, expert review and revisions made based on their feedback, and the implications from the development of such a tool.
- The Effects of Gender Grouping and Learning Style on Student Curiosity in Modular Technology Education LaboratoriesDraper, Sonya R. (Virginia Tech, 2004-09-15)This study investigated whether in a modular technology education (MTE) classroom, gender groupings and learning styles predicted degree of curiosity. Based on the assumption that gender grouping and learning style are factors that influence the degree of curiosity of both individuals and teams, it was hypothesized that a student's learning style (i.e., Accommodating, Converging, Diverging, and Assimilating) and gender grouping (girl/girl, boy/boy, and girl/boy) at the module would be essential elements to consider when measuring the degree of curiosity of learners in MTE classrooms. During a meeting with the deputy superintendent and the technology education supervisor in a mid-sized, suburban public school district in Virginia, three MTE teachers from different schools were identified to participate in this study in the spring of 2004. The sample for this study consisted of middle school students (n = 116; 22 girls and 94 boys, grades 6-8) enrolled in technology education classes using Synergistic SystemsTM modules. Students completed three consecutive MTE activities. This study was conducted in the technology education classroom in three different middle schools. Schools were classified as School A, B or C. Students selected technology education as an elective subject. Kolb's Learning Style Inventory (LSI), Version 3 was used to identify students' preferred learning style. The My Point of View (MyPOV) instrument adapted by Brusic and based on Leherissey's instrument, the State Epistemic Curiosity Scale (SECS), was used to measure individual degree of curiosity. The MyPOV instrument was administered three times; once after each module. Data was analyzed using a multiple linear regression analysis. Descriptive statistical analysis revealed that boys (81%; n = 94) continue to outnumber girls (19%; n = 22) in technology education classrooms. Participants (n = 101) preferred the following learning styles as identified by the LSI: Accommodating (35%), learning from "hands-on" experience, followed by Diverging (25%), preferring to brainstorm ideas, Assimilating (24%), interested in abstract ideas and concepts, and Converging (17%), rather deal with technical tasks and problems. Mean curiosity scores for students were analyzed by school. Results revealed scores from School B were lower than students at Schools A and C as measured by the MyPOV instrument. Mean curiosity scores for students were also analyzed by gender, learning style, and gender grouping. Statistics revealed that scores for girls were higher than boys. An independent-samples t-test was done to evaluate the difference between the means of the genders. According to the analyses, the tests were not significant, t(108) = .932, p = .353 (Score 1), t(110) = 1.282, p = .202 (Score 2), and t(104) = 1.564, p = .121 (Score 3). Overall scores for girl/girl groupings were higher than girl/boy and boy/boy groupings, and scores for girl/boy groupings were higher than boy/boy groupings. A one-way analysis of variance was conducted to evaluate whether the gender grouping means differed significantly from each other. According to the analyses, the F-tests revealed no significant differences in gender groupings, F(2, 97) = 1.65, p = .198 (Score 1), F(2, 95) = .50, p = .608 (Score 2), and F(2, 92) = 1.84, p = .165 (Score 3). Additionally, curiosity scores for students by learning styles showed that participants that preferred to deal with technical tasks and problems or Converging had the highest scores followed by Assimilating, Accommodating and Diverging. A multiple regression analysis was conducted to test if there was a significant relationship between the pairing of students of different gender groupings and different learning styles in the prediction of degree of curiosity. The F-tests revealed that the linear combination of gender groupings and learning styles for the three schools were not significantly related to degree of curiosity, R2 = .09, adjusted R2 = .04, F(5, 86) = 1.65, p = .155 (Score 1), R2 = .09, adjusted R2 = .04, F(4, 79) = 1.84 , p = .130 (Score 2), and R2 = .02, adjusted R2 = -.03, F(4, 73) = .382, p = .821 (Score 3). The t-tests analyses indicated that the Converging learning style, t(79) = 2.06, p =.043, in Score 2 was the only significant predictor variable with this sample. Although it seems that learning style and gender grouping might predict degree of curiosity in MTE laboratories, this assumption was not supported by this study.
- The Effects of Perceived Organizational Support on Training and Safety in Latino and Non-Latino Construction WorkersArtis, Sharnnia (Virginia Tech, 2007-07-20)Workplace safety, if not managed appropriately, can result in human and economic tolls. The need to establish and maintain a safe working environment has probably never been more important. Despite a mounting emphasis on safe work practices, the Bureau of Labor Statistics (BLS) reported a total of 5,702 fatalities in the United States in 2005. Among these fatalities, Latino workers, defined as both foreign-born and native-born (U.S.-born) workers of Latino ethnicity (BLS, 2006; Dong and Platner, 2004), accounted for 16% of those fatalities (BLS, 2006). Researchers are increasingly acknowledging that organizational factors are important in workplace safety (Hofmann, Jacobs, and Landy, 1995; Hurst, Bellamy, Geyer, and Ashley, 1991). However, there is a lack of cross-cultural comparison in this area. With the continuing increase in Latino construction workers and the level of injuries and fatalities, little attention has focused on the comparison of employment relationships between Latino and non-Latino construction workers and their supervisors and work environment. Therefore, this research endeavor used social exchange theory to examine the role of organizational factors in small construction firms to help explain why Latino workers have a disproportionate number of construction casualties compared to their non-Latino counterparts and to design a safety training program to help reduce the number of injuries, accidents, and fatalities in the workplace. The results of this is research endeavor demonstrated that both Latino and non-Latino and Latino groups had relatively equal perceptions of organizational support and distributive justice implying that Latinos and Latinos have identical support needs or that the construction firms' practices meet the support the workers need regardless of ethnicity. In addition, the study found ethnic group differences for safety climate, safety behavior, and cultural dimensions, which may contribute to the disproportionate number of fatalities for Latino workers. After uncovering group differences, this study tested the affect of training on perceived organizational support, distributive justice, safety climate, and safety behavior. This research demonstrated that providing training, of any type, as a source of perceived organizational support increases workers' perception of organizational support. Additionally, the study concluded that embedded sources of perceived organizational support in the training program increase workers' perceptions of distributive justice and safety climate. As a result, guidelines to improve workers' perception of organizational support and safety climate were created. Since high perceptions of safety climate are linked to less risky safety behaviors, embedding perceived organizational support into training programs can have an indirect affect on the workers' safety behavior. For that reason, improving the safety behavior of workers and the workers' perception of a safe work environment can lead to reduced accidents, injuries, and fatalities in the construction industry.
- The Evaluation of University-Community Engagement Scholarship Within the College Level Promotion and Tenure ProcessBaker, Della A. (Virginia Tech, 2001-05-07)The purpose of this qualitative case study was to describe the evaluation of university-community engagement scholarship through the college level promotion and tenure process at Southeastern University and to determine the value of faculty engagement as scholarship through that process. This study also examined useful criteria for judging such scholarship. In designing this study, three research methods were employed. Those methods were (a) interviews with faculty and department heads within the College of Education, and other university administrators at Southeastern University; (b) a review of university documents germane to the promotion and tenure process; and (c) an examination of dossier comment forms about a fictional dossier. Data were transcribed, coded, and categorized using content analysis. A role-ordered matrix was designed to display the perceptions and attitudes of the participants interviewed regarding the evaluation of engagement scholarship within the College of Education at Southeastern University. A conceptually clustered matrix was used to display empirical data that related by theme. A case dynamics matrix was used as an attempt to link consequential processes. An event network was helpful in displaying relationships among the respondents regarding the promotion and tenure process. This network depicted the people within that process and the flow of major communication that affects the promotion and tenure process. This study resulted in a model of engagement scholarship and a model for promoting engagement within a university setting. Findings from this study included a list of criteria offered by the resondents that paralleled those proposed by Glassick et al (1997). Perceived values of engagement scholarship were mixed and depended on whether such scholarship produced publications, grants, and contracts. This study might be useful for persons being evaluated for university-community engagement scholarship and for those evaluating university-community engagement scholarship in university setting.
- Factors Influencing the Faculty Adoption of Web Media Objects: Identification and RecommendationsJohnson, Kayenda T. (Virginia Tech, 2001-12-19)The current and increasing advances in computer technology has afforded more ubiquitous use of multimedia design for information presentation. This research addresses university faculty's use of web media objects: text, images/graphics, animation, audio and video (Oracle, Inc., 1996) for their course instruction. The framework used to assess the inclusion of web media objects in university course instruction was Rogers' (1995) Diffusion of Innovations model. The innovation was the inclusion of web media objects into university course instruction. The innovation was diffused through a faculty development workshop. It was determined that three factors influenced a faculty member's decision to adopt and implement the innovation: technology, pedagogy, and presentation style. Quantitative, qualitative, and observational data were used to draw conclusions about the influential factors associated with adoption of the innovation. This research resulted in a number of pertinent outcomes. Those outcomes included: information regarding faculty members' perceptions towards the innovation adoption, adoption barriers and general lessons learned, potential design guidelines for advanced multimedia training developers and training support systems, and recommendations for improving the adoption of web media objects for university course instruction. Results revealed that innovation characteristics: compatibility, trialability, relative advantage and observabilty are most important to consider for the adoption of web media objects for university course instruction. Discussion includes recommendations for improving faculty perception regarding these innovation characteristics and other related issues.
- Impact of Organizational Context Factors on Individuals' Self-Reported Knowledge Sharing BehaviorsNandy, Vaishali (Virginia Tech, 2015-05-04)The proliferation of teams and team-based activities emphasizes the need to understand knowledge sharing behaviors in order to facilitate team performance. Knowledge sharing in teams is valuable and indispensable for both academic and corporate organizations in order to meet and manage team effectiveness. Knowledge is driven by people who behave in different ways based on their environment and its accompanying factors. Considering what factors facilitate knowledge sharing behaviors in teams within an academic environment is an important benchmark for knowledge management researchers and instructional designers. Instructors and professors plan various thorough and organized collaborative opportunities for teams in their classrooms to encourage knowledge sharing. Similarly, understanding the specific factors of a collaborative context before setting team procedures better facilitates knowledge sharing behaviors. Therefore, the research problem addressed in this study was to predict what contextual factors promote perceptions toward knowledge sharing behaviors in students enrolled in graduate courses from a business school, as measure by a self-reported questionnaire. Prior studies on student teams state that team climate and leadership contributes to student knowledge sharing behavioral patterns. These studies emphasize the importance of recognizing specific factors that function with climate and leadership to contribute towards knowledge sharing behaviors and attitudes toward knowledge sharing; this would allow instructional designers to more fully understand the process. Furthermore, other studies related to team knowledge sharing behaviors reported certain specific factors, like organizational context, interpersonal and team characteristics, and cultural characteristics as crucial in influencing knowledge sharing behaviors. Specifically, in regard to team context, existing studies mentioned five factors - climate, leadership, rewards and incentives, structure, and support - that encourage knowledge sharing behaviors and attitude towards knowledge sharing in teams. Thus, in this study, the researcher investigated team climate, leadership, rewards and incentives, task structure, and task support to determine in what manner these factors influence student knowledge sharing behaviors as well as attitudes toward knowledge sharing in graduate business courses. This study used the quantitative methodologies. Multiple regression and correlation analysis were used to measure students' self-reported perceptions of what contextual factors impacted their knowledge sharing behaviors and attitudes toward knowledge sharing during team project work. The findings of this study show that in the studied context, students reported that task structure affected their knowledge sharing behaviors more than the rest of the identified factors. Correspondingly, rewards and incentives impacted their attitudes toward knowledge sharing behaviors. The findings also indicate negative correlations of team climate and leadership with attitudes toward knowledge sharing. Correspondingly, this study delineates certain implications for instructional designers for assisting knowledge sharing behaviors in teams. The study results contribute to the body of literature that suggest the importance of motivating and supporting detailed task structure and procedures for promoting knowledge sharing behaviors in student teams.
- Learning Analytics: Understanding First-Year Engineering Students through Connected Student-Centered DataBrozina, Stephen Courtland (Virginia Tech, 2015-12-03)This dissertation illuminates patterns across disparate university data sets to identify the insights that may be gained through the analysis of large amounts of disconnected student data on first-year engineering (FYE) students and to understand how FYE instructors use data to inform their teaching practices. Grounded by the Academic Plan Model, which highlights student characteristics as an important consideration in curriculum development, the study brings together seemingly distinct pieces of information related to students' learning, engagement with class resources, and motivation so that faculty may better understand the characteristics and activities of students enrolled in their classes. In the dissertation's first manuscript, I analyzed learning management system (LMS) timestamp log-files from 876 students enrolled in the FYE course during Fall 2013. Following a series of quantitative analyses, I discovered that students who use the LMS more frequently are more likely to have higher grades within the course. This finding suggests that LMS usage might be a way to understand how students interact with course materials outside of traditional class time. Additionally, I found differential relationships between LMS usage and course performance across different instructors as well as a relationship between timing of LMS use and students' course performance. For the second manuscript, I connected three distinct data sets: FYE student's LMS data, student record data, and FYE program survey data that captured students' motivation and identity as engineers at two time points. Structural equation modeling results indicate that SAT Math was the largest predictor of success in the FYE course, and that students' beginning of semester engineering expectancy was the only significant survey construct to predict final course grade. Finally, for the third manuscript I conducted interviews with eight FYE instructors on how they use student data to inform their teaching practices. Ten themes emerged which describe the limited explicit use of formal data, but many instructors use data on an informal basis to understand their students. Findings also point to specific, existing data that the university already collects that could be provided to instructors on an aggregate, class-level basis to help them better understand their students.
- Motivation, Usability and Their Interrelationships in a Self-paced Online Learning EnvironmentHu, Ying (Virginia Tech, 2008-08-29)This study addressed how usability improvement and motivational design affect learners' motivation and learning performance in a self-paced, online learning environment. The study also investigated the interrelationships between commonly-used usability measures and the motivation measures based on Keller's ARCS model. A two-phase study approach was used. In Phase I, an existing self-paced, online safety training tutorial was used as the baseline. Two alternative designs were developed with improved usability and motivational design based on the ARCS model. In Phase II, the effects of the three interface designs were evaluated through a three-group, generalized randomized block covariate design experiment. A total of seventy-two college students (48 males and 24 females) participated in the usability testing and the online training session using one of the interface designs. Both quantitative and qualitative data were collected and analyzed. Results suggested a significant interface design effect on learner motivation. Learners who used the interface design with both usability improvement and motivational design applied (the UM group) showed the highest level of motivation. In particular, the attention level of the learners in the UM group was significantly higher than the baseline group. Results also indicated motivation differences between genders. Females showed higher scores than males in overall motivation score and in each of the four subscales of attention, relevance, confidence, and satisfaction. No significant difference in learning performance was found among the three treatment groups using different interface designs. None of the usability or motivation measures was a significant predictor of learning performance. Small to medium positive correlations were found between usability satisfaction and three motivation measures, i.e., attention, relevance and satisfaction. Content analysis identified a number of interface design components to be relevant to learners' motivation components: overall appearance, graphics/multimedia, text appearance, page layout, navigation, and paging/scrolling. Implications and design recommendations for online tutorial interface design were discussed. Additional discussion was provided regarding the online learning environment and the integration of usability, motivation, and instructional design and technology.
- NLP in Engineering Education - Demonstrating the use of Natural Language Processing Techniques for Use in Engineering Education Classrooms and ResearchBhaduri, Sreyoshi (Virginia Tech, 2018-02-19)Engineering Education is a developing field, with new research and ideas constantly emerging and contributing to the ever-evolving nature of this discipline. Textual data (such as publications, open-ended questions on student assignments, and interview transcripts) form an important means of dialogue between the various stakeholders of the engineering community. Analysis of textual data demands consumption of a lot of time and resources. As a result, researchers end up spending a lot of time and effort in analyzing such text repositories. While there is a lot to be gained through in-depth research analysis of text data, some educators or administrators could benefit from an automated system which could reveal trends and present broader overviews for given datasets in more time and resource efficient ways. Analyzing datasets using Natural Language Processing is one solution to this problem. The purpose of my doctoral research was two-pronged: first, to describe the current state of use of Natural Language Processing as it applies to the broader field of Education, and second, to demonstrate the use of Natural Language Processing techniques for two Engineering Education specific contexts of instruction and research respectively. Specifically, my research includes three manuscripts: (1) systematic review of existing publications on the use of Natural Language Processing in education research, (2) automated classification system for open-ended student responses to gauge metacognition levels in engineering classrooms, and (3) using insights from Natural Language Processing techniques to facilitate exploratory analysis of a large interview dataset led by a novice researcher. A common theme across the three tasks was to explore the use of Natural Language Processing techniques to enable the computer to extract meaningful information from textual data for Engineering Education related contexts. Results from my first manuscript suggested that researchers in the broader fields of Education used Natural Language Processing for a wide range of tasks, primarily serving to automate instruction in terms of creating content for examinations, automated grading or intelligent tutoring purposes. In manuscripts two and three I implemented some of the Natural Language Processing techniques such as Part-of-Speech tagging and tf-idf (text frequency-inverse document frequency) that were found (through my systematic review) to be used by researchers, to (a) develop an automated classification system for student responses to gauge their metacognitive levels and (b) conduct an exploratory novice led analysis of excerpts from interviews of students on career preparedness, respectively. Overall results of my research studies indicate that although the use of Natural Language Processing techniques in Engineering Education is not widespread, although such research endeavors could facilitate research and practice in our field. Particularly, this type of approach to textual data could be of use to practitioners in large engineering classrooms who are unable to devote large amounts of time to data analysis but would benefit from algorithmic systems that could quickly present a summary based on information processed from available text data.
- Process, Preference and Performance: Considering Ethnicity and Socio-Economic Status in Computer Interface Metaphor DesignJohnson, Kayenda T. (Virginia Tech, 2008-03-24)This research addresses a problem that centers on the persistent disparities in computer use and access among racial minorities, particularly African-Americans and Latinos, and persons of low socio-economic status (SES) here in the USA. "Access" to computer technology maintains a dual meaning. Access may refer to having a computer and software available for use or it may refer to having a computer interface that effectively facilitates user learning. This study conceptualizes "access" as the latter — having an interface that facilitates user learning. One intervention for this problem of access, from a Human Factors perspective, is in recognizing and accounting for culture's influence on one's cognition. Both qualitative and quantitative approaches were integrated to effectively determine a process for engaging typically marginalized groups, interface metaphor preferences of African-Americans, and user performance with varying types of interface metaphors. The qualitative aspects of this study provided a basis for understanding how entry was obtained into the participants' community and for obtaining richer descriptions of user successes and challenges with the various interface designs. The researcher developed a culturally valid interface design methodology, i.e., Acculturalization Interface Design (A.I.D.) methodology, which was used to identify meaningful computer interface metaphors for low SES African-Americans. Through the A.I.D. methodology and an associated field study, a group of African-American novice computer users determined that the home, the bedroom and comfort were meaningful computer interface metaphors to integrate into a letter writing task. A separate group of African-Americans performed benchmark tasks on an interface design that utilized the home, bedroom and comfort metaphors or Microsoft Word 2003. The African-American group performed significantly better on the novel interface than on Microsoft Word 2003 for several benchmark tasks. Qualitative analyses showed that low acculturation African-Americans were particularly challenged with those same tasks. Regression analyses used to determine the relationship between psychosocial characteristics and user performance were inconclusive. Subject matter experts (SME), representing low SES Latinos, discussed potential learnability issues for both interface designs. Furthermore, results from the African-American group and the SMEs highlight the critical importance of using terminology (i.e., verbal metaphors) and pictorial metaphors that are culturally and socially valid.
- The Relationship between Organizational Culture, Usability, and Instructional Technology AcceptanceKothaneth, Shreya (Virginia Tech, 2012-09-05)The advent of technology has put a number of institutions in a state of reform (Wolcott, 1997). In fact, it was predicted that technology would completely transform higher education by the end of the twentieth century (Sculley, 1989). Aside from the demographic make-up of the majority of current students (Howe & Strauss, 2000), moving away from the traditional lecture-format to one with the integration of instructional technology can enhance the teaching/learning environment (Bolger & Sprow, 2002). However, instructional technology has still not been completely integrated into the higher education curriculum and students reported that only about 20 % of instructors were found to use technology effectively ("How Students Rate Instructors' Use of Information Technology in Courses", 2011). Educators continue to face a number of barriers to adoption and many institutions are still investigating ways to provide a more effective learning and teaching environment using efficient use of instructional technology. This research used the College of Engineering at Virginia Tech as a test bed and conducted a set of three studies following a mixed methodology. The first study elicited both quantitative and qualitative data from faculty members who used instructional technology in the classroom. Structural equation modeling was used to examine the relationships between organizational culture, usability, and instructional technology acceptance and found a significant, positive relationship between usability and instructional technology acceptance, and a positive relationship between organizational culture and instructional technology acceptance. The second study gained more insight into the relationship by collecting qualitative data in the form of focus group interviews. Results of Study 2 indicated that collaborative and innovative organizational cultures, coupled with instructional technologies that have low learnability, high efficiency, high effectiveness, and high satisfaction can facilitate instructional technology acceptance. Based on the results, a set of recommendations to facilitate instructional technology acceptance were developed. The third and final study consisted of a summative evaluation of the recommendations by a panel of experts using the Delphi technique. The overall outcome of this research effort was the development of recommendations and guidelines to facilitate instructional technology acceptance and the description of a comprehensive framework for effective instructional technology use.
- Towards the Development, Application, and Evaluation of the Student Success - Oriented System Design MethodologyGilbert, Tracee Walker (Virginia Tech, 2010-12-03)For over 70 years, researchers have been attempting to unravel the complexities associated with enhancing student success in higher education (Berger & Lyon, 2005). This research has resulted in a better understanding of why some students decide to leave while others persist on to graduation. Despite a sizable body of knowledge that has identified the various factors associated with student success in higher education, little work has been devoted to translating the various theoretical findings into specific strategies that will guide institutions in improving student success outcomes (Tinto, 2005; Tinto & Pusser, 2006). This study, therefore, represents a unique attempt to bridge the gap between research and practice. Specifically, it integrates relevant findings on student success with a growing body of knowledge on system design and performance improvement in order to address the following pressing need: How can institutional leaders in higher education translate theoretical concepts into actionable solutions that will facilitate student success? In order to provide a concrete course of action for institutional leaders to design practices that meaningfully impact student success, this dissertation describes the development, application, and evaluation of a Student Success-Oriented System Design (S2OSD) methodology. The proposed methodology shifts the focus from trying to understand why students leave or stay, which is a well-researched topic in the literature, to examining how to satisfy student needs in ways that will improve student success outcomes. By doing so, this study focuses on assessing, understanding, and satisfying student needs within the context of student success theoretical perspectives. Moreover, this research proposes a methodology that institutions can use to tailor their practices to fit the unique needs of their students (Berger & Lyon, 2005). In summary, this research study was devised to achieve the following goals: • Develop a research process that combines empirical and design methods in order to create, apply, and evaluate a system design methodology; • Develop a guiding framework that provides practitioners with a set of mutually reinforcing principles, which is supported by a methodology designed to meet student needs; • Develop a participatory design method and supporting tools to execute each phase of the methodology; • Develop a performance-based evaluation framework to evaluate the usability of the S2OSD methodology; and • Develop a validated questionnaire to assess engineering student success needs.
- Understanding Student Interactions Through Learning Analytics from an Online Engineering Case Study CourseWest, Paige Meredith (Virginia Tech, 2021-05-14)Student interactions in learning environments are vital for learning development. The growth of online learning in higher education has led stakeholders to question how to identify student interactions with course material and increase the quality and value of the learning experience. This research focused on leveraging existing learning analytics from the Canvas Learning Management System (LMS) to identify course interactions and make data-informed course design decisions. Learning analytics were collected from 113 students in three course sections of an online construction management course. Three surveys were also distributed to each course section to gather the students' perceptions of the learning methods and their interactions for assistance. An exploratory graphical analysis visually depicted student interactions in the online course through the students' hourly and weekly interaction levels, page visits, and discussion board activity. A paired t-test was used to statistically compare the survey responses on the students' perceptions of the learning methods. The learning analytics results showed the students' interaction levels peaked in the afternoon and evening hours, and their weekly interactions and page visits lessened after the midterm exam. Additionally, based on Pearson's correlation test, the discussion board interactions significantly correlated with student performance. Lastly, the surveys showed that students found watching the lecture videos and reading the lecture slides to be the most helpful methods when learning the course material. These results have important implications for online stakeholders as learning analytics and student perceptions can inform online course design to facilitate student, instructor, and content interactions.