Authors | Riis, C., Antunes, F., Bolic, T., Gurtner, G., Camara Pereira, F. and Lima Azevedo, C. |
---|
Abstract | Fast-time simulation constitutes a well-known and long-established technique within the Air Traffic Management (ATM) community. Due to the overwhelming complexity at both airspace and ground operations levels, simulation modeling is a commonly employed approach to study and assess real-world ATM systems. However, it is often the case that simulation input and output spaces are underutilized, limiting the full understandability, transparency, and interpretability of the obtained results. In this paper, we propose a methodology that combines simulation metamodeling and SHapley Additive exPlanations (SHAP) values, aimed at uncovering the intricate hidden relationships among the input and output variables of a simulated ATM system in a rather practical way. Whereas metamodeling provides explicit functional approximations mimicking the behavior of the simulators, the SHAP-based analysis delivers a systematic framework for improving their explainability, thereby enhancing the overall understanding of the interactions among the variables of interest. We illustrate our approach using a state-of-the-art ATM simulator across two case studies in which two delay-centered performance metrics are analyzed w.r.t. seven input variables. The results show that the proposed methodology can effectively make simulation and its results more explainable, facilitating the interpretation of obtained associated emergent behavior, and additionally opening new opportunities towards novel performance assessment processes within the ATM research field. |
---|