1-3 of 3 results
-
The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)
PI Barbara Chaparro
PI Joseph Keebler
CO-I Mikki Phan, User Experience Researcher, Google
The purpose of this research is to develop and psychometrically validate a new instrument that comprehensively measures video game satisfaction based on key factors. The video game industry often conducts playtesting sessions in order to provide insight into players’ attitudes and preferences. However, quality feedback is difficult to obtain from playtesting sessions without a quality gaming assessment tool.
A new instrument measuring video game satisfaction, called the Game User Experience Satisfaction Scale (GUESS), with nine subscales emerged. These scales included Usability/Playability, Narratives, Play Engrossment, Enjoyment, Creative Freedom, Audio Aesthetics, Personal Gratification, Social Connectivity, and Visual Aesthetics.
The GUESS was developed and validated based on the assessments of over 450 unique video game titles across many popular genres. Thus, it can be applied across many types of video games in the industry both as a way to assess what aspects of a game contribute to user satisfaction and as a tool to aid in debriefing users on their gaming experience. Based on current best practices of scale development and validation, the project used a mixed-method design that consisted of item pool generation, expert review, questionnaire pilot study, exploratory factor analysis (N = 629), and confirmatory factor analysis (N = 729).
Results from this multistage process demonstrate that the GUESS can be administered to video game players with various gaming experience (e.g., newbie/novice, hardcore/expert) playing a variety of game genres. Ratings of all the items per factor can be averaged to obtain a score of each subscale and average scores for each subscale can be added together in order to obtain a composite score of video game satisfaction. This can aid game designers in determining aspects of a game to improve as well as emphasize to target gaming markets.
Since its development and validation, the GUESS continues to be used to understand video game satisfaction across platforms and user groups by both the GEARS and User Experience Research labs at ERAU as well as gaming labs from other universities.
This was dissertation research by Dr. Mikki Phan supervised by Dr. Barbara Chaparro and Dr. Joseph Keebler. Mikki is now a User Experience Researcher at Google in Mountain View, CA. For more information, see Phan, M. H., Keebler, J. R., & Chaparro, B. S. (2016). The Development and Validation of the Game User Experience Satisfaction Scale (GUESS). Human Factors, 58(8), 1217-1247 and http://www.wired.co.uk/article/science-can-now-determine-how-good-any-video-game-is . Contact Barbara.Chaparro@erau.edu to obtain the GUESS instrument.
Mikki Phan, PhDCategories: Graduate
-
Meta-Analyses of the Effects of Standardized Handoff Protocols on Patient, Provider, and Organizational Outcomes
PI Joseph Keebler
CO-I Elizabeth Lazzara
This meta-analysis attempts to understand the benefits of a structured communication process on patient, provider, and organizational outcomes. Studies have found that one of the most crucial points during a patient’s hospital stay is the transition of care between one or more providers, often referred to as a patient handoff. These brief interactions between providers are often especially vulnerable to communication breakdowns due to interruptions, omission of pertinent information by the sender or receiver of the information. To illustrate, upwards of 80% of severe, preventable medical errors have been attributed to miscommunication during handoffs. In other words, failures in communication during handoff are potentially responsible for the loss of hundreds of thousands of lives every year in the United States.
Standardized protocols – usually in the form of a short mnemonic (e.g. SBAR – situation, background, assessment, recommendation) or a longer multi-item checklist - have been required by the Joint Commission, but meta-analytic integration of handoff protocol research has not been conducted. Meta-analysis is a statistical technique that quantitatively assesses effects across multiple studies, providing a summary of the current state of the science. The overall purpose of this study was to understand the effects of handoff protocols using meta-analytic approaches. Handoff information passed during transitions of care, patient outcomes, provider outcomes, and organizational outcomes are the primary outcomes studied for this research.
Initially 4,556 articles were identified across a multitude of literature databases, with 4,520 removed. This process left a final set of 36 articles, all which included pre-/postintervention designs implemented in live clinical/hospital settings. Meta-analyses were conducted on 34,527 pre- and 30,072 postintervention data points.
Results indicate positive effects on all four outcomes: handoff information, patient outcomes, provider outcomes, and organizational outcomes. We found protocols to be effective, but there is significant publication bias and heterogeneity in the literature. Publication bias indicates that only studies with significant findings are being published, while heterogeneity indicates that studies are not being conducted the same way – usually lacking standardized metrics. These results demonstrate that handoff protocols tend to improve results on multiple levels, including handoff information passed and patient, provider, and organizational outcomes. Significant effects were found for protocols across provider types, regardless of expertise or area of clinical focus. It also appears that more thorough protocols lead to more information being passed, especially when those protocols consist of 12 or more items. This research has continued to this day, with a recent dissertation (Kristen Welsh-Webster) completed i in 2017 on implementation of handoffs in a live anesthesia unit. Keebler and Lazzara’s team are currently writing multiple grants in collaboration with local and national hospital systems to improve their handoffs and team processes surrounding care transitions.
Categories: Faculty-Staff
-
Understanding Factors that Influence Anesthesia Handoffs
PI Elizabeth Lazzara
CO-I Joseph Keebler
Communication is an essential aspect of quality patient care in modern medicine, yet mishaps in communication during handoffs (i.e., the transition of a patient between two or more providers) happen frequently. The purpose of this project was to understand the factors that influence handoffs between anesthesia providers and clinicians within the post anesthesia care unit.
Handoffs are ubiquitous in hospital settings and frequently occur before and after surgery (i.e. the perioperative setting). Because patient care in the perioperative setting is contingent upon communication between providers, it is important the handoff between surgical and post-surgical units occurs efficiently and efficaciously to ensure relevant patient information is being transferred. To ameliorate errors associated with handoffs, there is a national call for standardization (i.e., protocols). Although there has been progress in this domain, handoff research remains problematic. Protocols are often developed unscientifically, research methods lack rigor, and studies rarely compare protocols against one another. Additionally, many studies do not focus on contextual variables (e.g., noise or turn taking) or individual differences that could influence handoff efficiency.
To address this gap, this study utilized qualitative and quantitative methods to develop an innovative, customized, data-driven handoff protocol, implemented the protocol into a live perioperative setting, and evaluated it in comparison to the previously established handoff protocol, SBAR (Situation, Background, Assessment, and Recommendation).
We designed the handoff protocol using literature from the medical field, interviews, and a card sorting technique (a method to determine how experts organize their knowledge). Based on this data, we generated a protocol (i.e., Flex 12) and corresponding learning/training materials. We trained participants on Flex 12 using information- and practice-based strategies as well as feedback. More specifically, participants listened to a lecture on handoffs, had the opportunity to perform handoffs, and received feedback regarding their performance of those handoffs. To determine its effectiveness, the Flex 12 was tested using a pre-post within-subjects design, which means that all participants were measured before and after the Flex 12 was implemented.
Although handoff protocol was not significant with regards to handoff efficiency, noise and turn taking was significant. In other words, handoffs were less efficient when there was more noise from equipment or staff and when providers had more turns during their conversation. Finally, the use of the protocol impacted provider’s attitudes and cognitions. For example, providers perceived less authority between one another when the protocol was used.
Despite being a small study at one site, it does present evidence that other contextual factors should be considered to better understand handoffs. Factors, such as noise and turn-taking, do influence handoff outcomes (i.e., handoff efficiency). Considering the time demands placed on healthcare providers, it is critical to understand and maximize efficiency while maintaining safety.
Categories: Faculty-Staff
1-3 of 3 results