Goal of the analysis:
Ensure that a medical device’s design, instructions, and interface minimize user error and optimize safety, effectiveness, and patient experience. Validate that the device can be used as intended by the target population under real-world conditions.
Data required:
- Device design specifications and user interface details
- User profiles (for example, healthcare professionals, patients, caregivers) and use environment descriptions
- Previous usability data or complaints related to device use
- Risk management documentation identifying critical tasks and potential user-related hazards
- Prototypes or final production units for testing
- Applicable standards and guidelines (for example, IEC 62366, FDA human factors guidance)
Detailed step-by-step instruction on how to conduct the analysis:
- Identify user groups and use environments. Determine who will be interacting with the device (e.g., physicians, nurses, patients) and in what settings (hospital, home).
- Define critical tasks and potential errors. Map out each user interaction, focusing on tasks that, if performed incorrectly, could lead to harm or device malfunction.
- Conduct initial formative studies. Use mockups or early prototypes to gather feedback on usability and identify major user interface issues before finalizing the design.
- Develop usability test protocols. Outline specific test objectives, success criteria, and data collection methods (e.g., observer notes, video recording).
- Recruit representative participants. Ensure that test participants match the skill level, demographics, and familiarity with similar devices of the intended user population.
- Perform structured usability testing. Have participants complete critical tasks in realistic scenarios. Collect quantitative (e.g., success rates, time on task) and qualitative (e.g., frustration points) data.
- Analyze and prioritize findings. Identify recurring issues, error patterns, or near-misses. Determine which problems pose the greatest risk to user or patient safety.
- Iterate design improvements. Revise the device interface, labeling, or instructions to address identified usability challenges. Conduct additional testing as needed.
- Execute a final summative test. Validate that updated designs meet predefined acceptance criteria for usability and safety, especially in critical tasks.
- Document and integrate results. Compile findings in a usability engineering file that supports regulatory submissions and informs future design iterations.
Format of the output of analysis:
- A written usability engineering report summarizing user research, test methods, findings, and design changes
- Test protocols, data collection tools, and raw performance data (e.g., error rates, completion times)
- A risk analysis matrix mapping usability issues to potential harm and mitigation strategies
- An executive summary highlighting key design improvements, user feedback, and compliance with human factors standards
How to interpret results:
- High success rates for critical tasks, minimal user errors, and positive feedback indicate strong usability and a lower risk of adverse events.
- Repeated difficulties or confusion across multiple users suggest design shortcomings requiring iterative improvements or clearer instructions.
- Real-world testing conditions, such as stress or multitasking, can reveal issues overlooked in idealized lab scenarios.
Steps a company can take to improve on this measure:
- Involve representative end-users early in the design process to capture authentic needs and expectations.
- Iterate rapidly, using formative evaluations to catch user interface flaws before costly design freeze points.
- Align risk management processes with human factors findings, ensuring that usability issues with high potential harm are addressed first.
- Provide comprehensive user training materials (e.g., videos, quick-start guides) and gather feedback continuously after product launch.
- Maintain a living usability file to inform design updates, post-market surveillance, and future device generations.
