1-2 of 2 results
-
Gold Standards Training and Evaluator Calibration of Pilot School Check Instructors
PI Paul Cairns
CO-I Andrew Dattel
A key component of air carrier advanced qualification programs is the calibration and training of instructors and evaluators and assurance of reliable and valid data in support of such programs. A significant amount of research is available concerning the calibration of air carrier evaluators, but no research exists regarding the calibration of pilot school check instructors. This study was designed to determine if pilot school check instructors can be calibrated against a gold standard to perform reliable and accurate evaluations.
Calibration followed the principles and theories of andragogy and adult learning and teaching, including an emphasis on the cognitive domain of learning, learner-centered instruction, and human resource development. These in combination with methods commonly used in aviation instruction aimed to increase the effectiveness of the calibration. Discussion of these combinations is included. A specific method for delivery of the calibration was provided along with a complete lesson plan. This study used a one-group pretest-posttest design. A group of 10 pilot school check instructors was measured before and after receiving rater calibration training. Statistical measures included raw inter- and referent-rater agreement percentages, Cohen’s kappa and kappa-like statistics for inter- and referent-rater reliability, Pearson product-moment correlations for sensitivity to true changes in pilot performance, and a standardized mean absolute difference for grading accuracy. Improvement in all the measurements from pretest to posttest was expected, but actual results were mixed. However, a holistic interpretation of the results combined with feedback from the check instructors showed promise in calibration training for pilot school check instructors. A thorough discussion of the limitations and lessons learned from the study, recommendations for pilot schools, and recommendations for future research is included.Categories: Graduate
-
Pilot Acceptance of Personal, Wearable Fatigue Monitoring Technology: An Application of the Extended Technology Acceptance Model
PI Rachelle Strong
CO-I Dahai Liu
The research problem of pilot fatigue has been referenced as a causal factor for aircraft accidents in many United States National Transportation and Safety Board (NTSB) accident reports; however, the United States Code of Federal Regulations 14 CFR Part 117, Flight and Duty Limitations and Rest Requirements for Flight Crew Members, does not provide a tangible means of measuring fatigue for aircraft crew members. This problem is relevant to the airline industry and the travelling public because pilot fatigue is preventable as a causal factor in aviation accidents, and pilots need an accurate way to measure it. Adoption of a technology-based solution has been recommended by the NTSB.
The purpose of this study was to determine the factors that affect United States certified airline transport pilots’ behavioral intention to use personal, wearable fatigue monitoring technology (FMT), such as a Fitbit or Apple Watch, to assess their personal fatigue levels. FMT could potentially be used to help meet pilots’ legal requirement to be aware of their personal fatigue levels, per 14 CFR Part 117. The theoretical framework for this study is the Extended Technology Acceptance Model, and the research question is: What factors affect pilots’ behavioral intention to use personal, wearable fatigue monitoring technology, and to what degree? There were ten hypotheses tested that corresponded to different relationships in the model.
The data for this study was collected using an online survey distributed to certified airline transport pilots in the United States, in which the survey questions corresponded to observed variables pertaining to each of the eight factor constructs in the model. The data was analyzed using confirmatory factor analysis (CFA) and structural equation modeling (SEM) techniques to test the hypotheses. The results of the study contributed to the theoretical body of knowledge by demonstrating that a modified version of the Extended Technology Acceptance Model was applicable to U.S. airline transport pilot behavioral intention to use FMT. Six of the ten original hypotheses were supported, and four were not supported.
It was determined that the primary factors that positively affect a pilot’s behavioral intention to use FMT are perceived usefulness and perceived ease of use. Perceived usefulness is positively affected by the external factors of job relevance, results demonstrability, and perceived image or social status, which act as secondary factors positively influencing behavioral intention to use FMT. A tertiary factor influencing behavioral intention to use FMT is subjective norms, which positively influence perceived image, thus positively affecting perceived usefulness and intention to use FMT. Output quality, subjective norms, and perceived ease of use were determined to not have a statistically significant effect on pilots’ perceived usefulness of FMT, and subjective norms were determined not to have a statistically significant effect on pilots’ behavioral intention to use FMT.
The practical significance of this study is that pilots find FMT devices most useful when it is applicable to their jobs, provides tangible results, and increases their social status perception. It is beneficial if others around them think they should use FMT, and that if they use FMT, their social status perception increases. Practical solutions to increase the likelihood of pilot FMT device usage should include wearable device applications that provide features that directly apply to the pilot profession, report data in ways that make sense to pilots, and also make the pilot look and feel stylish. Nearly 87 percent of pilots already wear a watch while flying, and over 40 percent of pilots already wear some form of FMT for personal use, so the challenge going forward is to make the right improvements to the devices to increase usage. Such improvements may include new aviation-themed applications that appeal to pilots and provide results that can help them make more informed decisions, while simultaneously improving the aesthetic to drive an increase in social pressures to wear the FMT devices regularly.
Categories: Graduate
1-2 of 2 results