Obsolescence: Evaluating an Educational Serious Game on Artificial Intelligence Impacts to Military Strategic Goals
Date of Award
Master of Science in Cyber Operations
Department of Electrical and Computer Engineering
Mark G. Reith, PhD
Artificial Intelligence (AI) threatens to bring significant disruption to all aspects of military operations. This research develops a Serious Game (SG) and assessment methodology to provide education on the mindsets required for engaging with disruptive AI technologies. The game, Obsolescence, teaches strategic-level concepts recommended to the Department of Defense (DoD) from a compilation of reports on the current and future state of AI and warfighting. The methodology for assessing the educational value of Obsolescence addresses common challenges such as subjective reporting, control groups, population sizes, and measuring abstract or high levels of learning. The games proposed educational value is tested using a pre-and post-test format against a baseline established by official sources and experts in the fields of AI and strategic planning. The assessment includes metrics based on both self-reported learning and measurements of changes to participant responses to LO-related questions post-gameplay. The experiment found a strong correlation between the measured learning and participants' self-reported learning, and both metrics confirm that Obsolescence achieves its educational goals. This research includes the steps necessary to utilize the assessment methodology and presents recommendations both for Obsolescence and for future research in the field of educational game assessment.
DTIC Accession Number
Kokotajlo, Timothy C., "Obsolescence: Evaluating an Educational Serious Game on Artificial Intelligence Impacts to Military Strategic Goals" (2022). Theses and Dissertations. 5368.