Cover not available
Article published In:
Interaction Studies
Vol. 24:3 (2023) ► pp.335–361

Water, lava, and wind

Lessons learned for field robotics and human factors research during real world disasters

ORCID logo | Texas A&M University
| University of Wisconsin-Madison
| Texas A&M University

Small unmanned aerial systems (sUAS) are used more regularly and widely in disaster response. Like other personnel involved in disaster response, the sUAS pilots work for long periods, experience extreme stress and fatigue. They often arrive at the disaster fatigued (due to long drives to get there). However, unlike other personnel in this domain, there is little research on the effects of fatigue on sUAS pilots. Our experiences with a series of three real-world deployments highlight the challenges of conducting human factors research during disaster response and recovery. We specifically present lessons learned from having participant researchers embedded in three disasters with the sUAS pilot teams. These lessons result in a set of feasible and non-interruptive methods and metrics for conducting human factors research during field events. Preliminary results and recommended next steps are presented.

Keywords: human-robotic interaction, field studies, small uncrewed aerial systems
Article outline
  • 1.Introduction
  • 2.Methods and results
    • 2.1Commonalities observed across each disaster event
    • 2.2Operator fatigue measures and methods
  • 3.Hurricane Harvey – a flooding disaster
    • 3.1Methods
      • Participants
      • Measures and protocol
    • 3.2Compliance and feasibility lessons learned
  • 4.Kilauea – a lava disaster
    • 4.1Methods
      • Participants
      • Measures and protocol
    • 4.2Lessons learned
  • 5.Michael – A wind disaster
    • 5.1Methods
      • Participants
      • Measures and protocols
    • 5.2Lessons learned
  • 6.Findings for field data collection
    • 6.1Metrics and measures
    • 6.2Effective data collection
  • 7.Summary
  • Acknowledgements
  • References
Published online: 15 February 2024
DOI logo
https://doi.org/10.1075/is.22048.per
References (43)
Adams, J., Hart, L., McBride, J., Merrick, D., & Murphy, R.
(2018) Use of small unmanned aerial Systems for Tactical Response during Kilauea volcano lower east rift zone event. 2018 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR). DOI logoGoogle Scholar
Åkerstedt, T., & Gillberg, M.
(1990) Subjective and objective sleepiness in the active individual. International journal of neuroscience, 52 (1–2), 29–37. DOI logoGoogle Scholar
Alexander, D. A., & Klein, S.
(2009) First responders after disasters: a review of stress reactions, at-risk, vulnerability, and resilience factors. Prehospital and Disaster Medicine, 24 (2), 87–94. DOI logoGoogle Scholar
Arsintescu, L., Kato, K. H., Cravalho, P. F., Feick, N. H., Stone, L. S., & Flynn-Evans, E. E.
(2019) Validation of a touchscreen psychomotor vigilance task. Accident Analysis & Prevention, 126 1, 173–176. DOI logoGoogle Scholar
Basner, M., & Rubinstein, J.
(2011) Fitness for duty: A 3 minute version of the Psychomotor Vigilance Test predicts fatigue related declines in luggage screening performance. Journal of occupational and environmental medicine/American College of Occupational and Environmental Medicine, 53 (10). DOI logoGoogle Scholar
Basner, M., Mollicone, D., & Dinges, D. F.
(2011) Validity and sensitivity of a brief psychomotor vigilance test (PVT-B) to total and partial sleep deprivation. Acta astronautica, 69 1, 11–12. DOI logoGoogle Scholar
Benedek, D. M., Fullerton, C., & Ursano, R. J.
(2007) First responders: mental health consequences of natural and human-made disasters for public health and public safety workers. Annu. Rev. Public Health, 28 1, 55–68. DOI logoGoogle Scholar
Burke, J., & Murphy, R.
(2004) Human-robot interaction in USAR technical search: Two heads are better than one. RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No. 04TH8759).
Burke, J. L., Murphy, R. R., Coovert, M. D., & Riddle, D. L.
(2004) Moonlight in Miami: Field study of human-robot interaction in the context of an urban search and rescue disaster response training exercise. Human–Computer Interaction, 19 (1–2), 85–116. DOI logoGoogle Scholar
Burke, J. L., Murphy, R. R., Riddle, D. R., & Fincannon, T.
(2004) Task performance metrics in human-robot interaction: Taking a systems approach.Google Scholar
Casper, J., & Murphy, R. R.
(2003) Human-robot interactions during the robot-assisted urban search and rescue response at the world trade center. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 33 (3), 367–385. DOI logoGoogle Scholar
Casper, J. L., & Murphy, R. R.
(2002) Workflow study on human-robot interaction in USAR. Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No. 02CH37292). DOI logoGoogle Scholar
Fernandes, O., Murphy, R., Adams, J., & Merrick, D.
(2018) Quantitative Data Analysis: CRASAR Small Unmanned Aerial Systems at Hurricane Harvey. IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), 1–6. DOI logoGoogle Scholar
Fernandes, O., Murphy, R. R., Merrick, D., Adams, J., Hart, L., & Broder, J.
(2019) Quantitative Data Analysis: Small Unmanned Aerial Systems at Hurricane Michael. IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), 116–117. DOI logoGoogle Scholar
Harris, A.
(2018) Eruption crisis at Kilauea Caldera (Big Island of Hawaii, USA). Bulletin of Volcanology, 80 (8), 66. DOI logoGoogle Scholar
Hart, S. G., & Staveland, L. E.
(1988) Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in Psychology (Vol. 521, pp. 139–183). Elsevier.Google Scholar
Hopko, S., Wang, J., & Mehta, R.
(2022) Human Factors Considerations and Metrics in Shared Space Human-Robot Collaboration: A Systematic Review. Frontiers in Robotics and AI, 9 1. DOI logoGoogle Scholar
Hopko, S. K., Khurana, R., Mehta, R. K., & Pagilla, P. R.
(2021) Effect of Cognitive Fatigue, Operator Sex, and Robot Assistance on Task Performance Metrics, Workload, and Situation Awareness in Human-Robot Collaboration. IEEE Robotics and Automation Letters, 6 (2), 3049–3056. DOI logoGoogle Scholar
Kaplan, S., Karklis, L., & Tierney, L.
(2018, May 17 2018) Where the Earth is erupting on Hawaii’s Big Island. The Washington Post.Google Scholar
Karthikeyan, R., McDonald, A., & Mehta, R. K.
(2023) Stress Detection During Motor Activity: A Comparison of Neural and Physiological Biomarkers in Older Adults. IEEE Transactions on Affective Computing. 14 (3), 2224–2237. DOI logoGoogle Scholar
Korshøj, M., Krustrup, P., Jørgensen, M. B., Prescott, E., Hansen, Å. M., Kristiansen, J., Skotte, J. H., Mortensen, O. S., Søgaard, K., & Holtermann, A.
(2012) Cardiorespiratory fitness, cardiovascular workload and risk factors among cleaners; a cluster randomized worksite intervention. BMC Public Health, 12 (1), 1–9. DOI logoGoogle Scholar
Mehta, R. K., & Agnew, M. J.
(2012) Influence of mental workload on muscle endurance, fatigue, and recovery during intermittent static work. European journal of applied physiology, 112 (8), 2891–2902. DOI logoGoogle Scholar
Mehta, R. K., Nuamah, J., Peres, S. C., & Murphy, R. R.
(2020) Field methods to quantify emergency responder fatigue: lessons learned from sUAS deployment at the 2018 Kilauea Volcano eruption. IISE transactions on occupational ergonomics and human factors, 8 (3), 166–174. DOI logoGoogle Scholar
Mehta, R. K., Peres, S. C., Kannan, P., Rhee, J., Shortz, A. E., & Mannan, M. S.
(2017) Comparison of objective and subjective operator fatigue assessment methods in offshore shiftwork. Journal of loss prevention in the process industries, 48 1, 376–381. DOI logoGoogle Scholar
Mueller, S. T., & Piper, B. J.
(2014) The psychology experiment building language (PEBL) and PEBL test battery. Journal of neuroscience methods, 222 1, 250–259. DOI logoGoogle Scholar
Murphy, R. R.
(2004a) Human-robot interaction in rescue robotics. IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), 34 (2), 138–153. DOI logoGoogle Scholar
(2004b) Trial by fire [rescue robots]. IEEE Robotics & Automation Magazine, 11 (3), 50–61. DOI logoGoogle Scholar
(2012) A decade of rescue robots. 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems. DOI logo
(2014) Disaster robotics. MIT press. DOI logoGoogle Scholar
(2019) Humans and robots in off-normal applications and emergencies. International Conference on Applied Human Factors and Ergonomics.Google Scholar
Murphy, R. R., & Burke, J. L.
(2005) Up from the rubble: Lessons learned about HRI from search and rescue. Proceedings of the Human Factors and Ergonomics Society Annual Meeting. DOI logoGoogle Scholar
(2008) From remote tool to shared roles. IEEE Robotics & Automation Magazine, 15 (4), 39–49. DOI logoGoogle Scholar
Orr, T., Heliker, C., & Patrick, M.
(2012) The ongoing Puʻu ʻŌʻō eruption of Kīlauea Volcano, Hawaiʻi – 30 years of eruptive activity. US Geol. Surv. Fact Sheet, 3127 (6).Google Scholar
Peschel, J. M., & Murphy, R. R.
(2012) On the human–machine interaction of unmanned aerial system mission specialists. IEEE Transactions on Human-Machine Systems, 43 (1), 53–62. DOI logoGoogle Scholar
Pontifex, M. B., McGowan, A. L., Chandler, M. C., Gwizdala, K. L., Parks, A. C., Fenn, K., & Kamijo, K.
(2019) A primer on investigating the after effects of acute bouts of physical activity on cognition. Psychology of Sport and Exercise, 40 1, 1–22. DOI logoGoogle Scholar
Preisser, A. M., Zhou, L., Garrido, M. V., & Harth, V.
(2016) Measured by the oxygen uptake in the field, the work of refuse collectors is particularly hard work: Are the limit values for physical endurance workload too low? International Archives of Occupational and Environmental Health, 89 (2), 211–220. DOI logoGoogle Scholar
Reid, G. B., & Nygren, T. E.
(1988) The subjective workload assessment technique: A scaling procedure for measuring mental workload. In Advances in psychology, 52 1, 185–218. DOI logoGoogle Scholar
Sebastian, T., Lendering, K., Kothuis, B., Brand, N., Jonkman, B., van Gelder, P., Godfroij, M., Kolen, B., Comes, T., & Lhermitte, S.
(2017) Hurricane Harvey Report: A fact-finding effort in the direct aftermath of Hurricane Harvey in the Greater Houston Region.Google Scholar
Shortz, A. E., Hoyle, W. S., Peres, S. C., & Mehta, R. K.
(2018) Fatigue indicators of 12-hour day and night shifts in simulated offshore well control scenarios. Proceedings of the Human Factors and Ergonomics Society Annual Meeting.
Shultz, J. M., & Galea, S.
(2017) Mitigating the mental and physical health consequences of Hurricane Harvey. Jama, 318 (15), 1437–1438. DOI logoGoogle Scholar
Sikder, M. S., Ahmad, S., Hossain, F., Gebregiorgis, A. S., & Lee, H.
(2019) Case study: rapid urban inundation forecasting technique based on quantitative precipitation forecast for Houston and Harris county flood control district. Journal of Hydrologic Engineering, 24 (8), 05019017. DOI logoGoogle Scholar
Zhu, Y., Jankay, R. R., Pieratt, L. C., & Mehta, R. K.
(2017) Wearable sensors and their metrics for measuring comprehensive occupational fatigue: A scoping review. Human Factors and Ergonomics Society Annual Meeting, Austin, TX, USA.
Zomeren, M. V., Peschel, J. M., Mann, T., Knezek, G., Doebbler, J., Davis, J., Hammond, T. A., Oomes, A. H., & Murphy, R. R.
(2009) Human-robot interaction observations from a proto-study using SUAVs for structural inspection. Proceedings of the 4th ACM/IEEE international conference on Human robot interaction. DOI logo
Cited by (1)

Cited by 1 other publications

Peres, S. Camille, Robin M. Murphy & Ranjana K. Mehta
2023. 2023 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), ► pp. 1 ff. DOI logo

This list is based on CrossRef data as of 4 july 2024. Please note that it may not be complete. Sources presented here have been supplied by the respective publishers. Any errors therein should be reported to them.