FAA Human-Systems Integration Branch (ANG-E5B) 2025-Electronic-Institutional-Review-Board-Usability-Evaluation

Electronic Institutional Review Board (eIRB) Usability Evaluation

Full Text:	Pdf (1.25 MB)
Document Number:	DOT/FAA/TC-25/32
Publication Date:	11-2025
Authors:	Elena St. Amour Priscilla Wark

St. Amour, E., & Wark, P. (2025). Electronic Institutional Review Board (eIRB) usability evaluation (DOT/FAA/TC-25/32). Atlantic City International Airport, NJ: Federal Aviation Administration William J. Hughes Technical Center for Advanced Aerospace.

Abstract

The Federal Aviation Administration (FAA) conducted a usability evaluation of the first iteration of a newly proposed Electronic Institutional Review Board (eIRB) system at the William J. Hughes Technical Center for Advanced Aerospace. The study assessed how effectively and efficiently the system supports researchers in registering protocols, completing IRB submission forms, and submitting documentation for IRB review while maintaining compliance with federal human-subjects regulations and protections for Personally Identifiable Information (PII).

Nine federal employees from the Technical Center, the Department of Transportation Volpe Center, and the Civil Aerospace Medical Institute participated in a structured, task-based evaluation using a think-aloud protocol. Participants interacted with three core system pages and completed four representative tasks, followed by the System Usability Scale (SUS) and supplemental questionnaires. Results indicated above-average overall usability, with a mean SUS score of 76.9, while also identifying specific issues related to navigation, functionality, instructional clarity, and document upload workflows.

Findings informed a set of design and functionality recommendations aimed at improving user experience, reducing confusion, and aligning the system with user mental models and FAA Human Factors Design Standards. The evaluation supports continued development of the eIRB system as a modernization effort to streamline IRB submissions, improve document organization, and strengthen compliance with the Common Rule and FAA Order 9500.25C.