Skip to content
Open navigation

4 Ways Simulation Can Assess Foundational Competencies

Learn how simulation can be a powerful tool for ensuring readiness for residency in medical education.

quote-icon.png
“What will we expect all future physicians to be able to do, know, and value when they leave medical school - regardless of their future specialty?”1

 

If you’re in undergraduate medical education, you may know that the Association of American Medical Colleges (AAMC), the American Association of Colleges of Osteopathic Medicine (AACOM), and the Accreditation Council for Graduate Medical Education (ACGME) are working together to create a set of foundational competencies for undergraduate medical education programs in the U.S. Due to be released in early 2024, these medical school competencies will aim to improve the transition to residency.2 To help inform the development of the foundational competencies, members of the medical education community have contributed their input on the skills they believe are essential.3

In this article, we discuss 4 of these skills and how simulation can help you teach and assess them to ensure that you’re preparing your learners to provide safe, effective patient care upon their transition to residency.

1. Translate knowledge to clinical practice

sirc-nln-subhero.jpg

According to the Accreditation Council for Graduate Medical Education (ACGME), the goal of assessing learners’ application of medical knowledge is to assess their ability to apply that knowledge to clinical problem-solving and clinical reasoning – the process where clinicians observe, collect, and interpret data to diagnose and manage patients.4 This ability to transfer knowledge to practice is critical for safe and effective patient care – but has shown to be a struggle for many learners.5

In a survey of 123 Clerkship Directors in Internal Medicine, the majority of respondents felt that most students enter their clerkships with only poor to fair knowledge of key clinical reasoning concepts.6 And, most respondents agreed that a structured curriculum in clinical reasoning should be taught throughout the 4 years of medical school.7

Simulation has been touted as an essential tool in assessing clinical reasoning thanks to its ability to measure the "whole task" – or the full range of clinical reasoning components, from information gathering to differential diagnosis to management and treatment.8 Whole-task assessments are essential for providing learners with formative feedback to foster clinical reasoning.9

Simulation assessment tip:
Ensuring your learners can successfully apply their knowledge to patient care will require offering many opportunities to practice and master this skill across the curriculum. Simulation lends the ability to do this in a safe, consistent environment. To measure and track learner progress longitudinally, consider enlisting the help of a simulation management system. SimCapture can collect and organize your performance data to yield trends and insights that can help you adjust your teaching as needed.

2. Take a patient history and conduct a physical assessment.

nextgen-harvey-male-doctor-subhero.jpg

This skill aligns with Core Entrustable Professional Activity (EPA) 1: Gather a History and Perform a Physical Examination.10 Developed by the Association of American Medical Colleges (AAMC) in 2014, the EPAs are a set of behaviors that graduating medical students should be able to perform with indirect supervision upon entry to residency.11

In a 2017 survey of Internal Medicine program directors, 97% of respondents said this is one of their top 3 essential EPAs for new residents to possess on their first day.12

According to the AGCME, simulation is becoming increasingly important as part of mastery-based learning for patient care skills, including taking a patient history and conducting physical assessment.13 Mastery learning, when paired with deliberate practice, has been shown to yield significant educational outcomes.14

"The old adage, 'see one, do one, teach one' should be replaced by ‘see a lot, practice a lot, reflect a lot, and practice more.'"

- Dr. Sandrin van Schaik, MD, PhD
Kanbar Center for Simulation and Clinical Skills, University of California San Francisco Medical School15

One specific type of physical assessment that especially illustrates the importance of deliberate practice is cardiopulmonary assessment. This complex exam demands the integration of inspection, palpation, and auscultation in the context of initial symptoms and the patient’s history.16

One study looked at 4th year medical students’ bedside cardiology skills.17 Students engaged in deliberate practice of cardiac findings with computer-based teaching modules linked to cardiopulmonary simulator Harvey. They nearly doubled their baseline scores post-test – in half the time as the comparison group, who practiced using customary ward work such as teaching rounds. This study illustrates that simulation technology that engages learners in deliberate practice of clinical skills results in significant improvements in a relatively short time, with little faculty involvement.18

Simulation assessment tip:
Deliberate practice is vital to helping learners master their skills in taking a patient history and conducting a physical assessment – but not every student prefers to practice and learn in the same environment. Consider utilizing a simulator that allows learners to deliberately practice skills like cardiopulmonary assessment in an instructor-led, peer-to-peer, or self-directed environment – while also providing feedback and yielding performance data on their skill development.

3. Work collaboratively on an interprofessional team

simcapture-resusci-anne-subhero.jpg

This skill aligns with Core Entrustable Professional Activity (EPA) 9: Collaborate as a Member of an Interprofessional team.19

Teamwork and collaboration are considered “soft” skills – even though they are anything but soft in reality.20 Effective teamwork enhances safety, efficiency, and quality of patient care.21

The Joint Commission’s 2022 Annual Review of Sentinel Event Data indicated that communication breakdowns (including not establishing a shared understanding or mental model across care team members or no or inadequate team communication of crucial information) continue to be the leading factor contributing to sentinel events.22

A well-designed simulation scenario allows students to learn how to work well together without posing any risk to actual patients. At the University of Missouri, teams of students from the medical, health management, pharmacy, respiratory therapy, and nursing schools participate in a simulation of an emergency department during a flu epidemic. Students are observed not only on what they’re doing but on how well they work together.23

"In the classroom, this interprofessional stuff is nice, but here [in simulation] [they realize] they really need each other to meet patients’ needs."

- Dr. Linda Headrick, M.D., Senior Associate Dean for Education
University of Missouri-Columbia School of Medicine24

Simulation assessment tip:
According to the ACGME, it is especially critical to use a multisource feedback (MSF) approach when assessing interprofessional teamwork.25 This approach provides multiple perspectives, which may offer a more holistic assessment of skills.26 You may want to consider making this process easier with a video debriefing tool like SimCapture, which provides video recordings along with annotations, allowing multiple faculty to view footage and assess learners.

4. Differentiate emergency from non-emergency

Simx-pressphoto.jpg

This skill aligns with Core Entrustable Professional Activity (EPA) 10: Recognize a Patient Requiring Urgent or Emergent Care and Initiate Evaluation and Management.27

New residents are often the first to respond in an acute care setting or to be notified about an abnormal lab or deteriorating patient.28 Yet research has shown that fourth-year medical students are less prepared to handle unstable patients than patients with non-acute conditions.29 This could be due in part to the reality that most students don’t encounter enough emergent conditions in patient encounters during an emergency medicine rotation.30

And, certain emergent conditions (especially cardiac arrest) are much less likely to be encountered.31

Simulation can expose students to realistic emergent conditions that they might not otherwise encounter without any impact on patients in an actual emergency. And, it adds standardization to training by ensuring that every learner gets the same experience.

Many organizations are turning to Virtual Reality (VR) medical simulation for its ability to immerse learners in real-world environments that allow them to practice recognizing emergencies. And, it provides training on multiple skills, including teamwork – an area especially critical in a time-critical emergency. In this virtual world, a student can encounter a patient with chest heaviness, recognize that the patient requires urgent care, and initiate evaluation and management while engaging actual team members, before moving on to managing a full cardiac arrest – all in a single scenario.

For Linda Boyd, D.O., Vice President for Academic Affairs and Dean at West Virginia School of Osteopathic Medicine, one of the most important strengths of VR simulation is its ability to give learners practice in communicating effectively – particularly with patients’ families. “Since medicine is much more than just giving the right drugs and doing the right tests, being able to interact in a realistic and complex scenario is valuable for medical students learning their craft,” she says.32

Simulation assessment tip:
VR simulations can help you increase opportunities for deliberate practice of emergency recognition and other key skills like teamwork. To help with assessment, you may want to consider a VR platform that offers robust performance data – including reports of critical actions performed and timestamps of when they happened. These tools can make it easier to review performance with your learners, provide meaningful feedback, and track their progress over time.

Let’s talk about how we can help you leverage simulation for teaching and assessing foundational competencies.

We will handle your personal contact details with care as outlined in Laerdal's Privacy Policy.

We will handle your personal contact details with care as outlined in Laerdal's Privacy Policy.

References

  1. Developing Foundational Competencies for Undergraduate Medical Education: A Summary of Community Feedback. (2023). Association of American Medical Colleges (AAMC). Retrieved from https://image.email.aamc.org/lib/fe8e13727c63047f73/m/5/c0ea5328-1d56-41a1-a4f8-018d4eacdf75.pdf
  2. Ibid.
  3. Ibid.
  4. Holmboe, E.S., MD & Iobst, W.F., MD. (2020). Assessment Guidebook. Accreditation Council for Graduate Medical Education (ACGME). Retrieved from https://www.acgme.org/globalassets/pdfs/milestones/guidebooks/assessmentguidebook.pdf
  5. Porter-Stransky, K. A., Gibson, K., VanDerKolk, K., Edwards, R. A., Graves, L. E., Smith, E., & Dickinson, B. L. (2022a). How medical students apply their biomedical science knowledge to patient care in the family medicine clerkship. Medical Science Educator, 33(1), 63–72. https://doi.org/10.1007/s40670-022-01697-5
  6.  
  7. Rencic, J., Trowbridge, R. L., Fagan, M., Szauter, K., & Durning, S. (2017). Clinical reasoning education at US medical schools: Results from a national survey of internal medicine clerkship directors. Journal of General Internal Medicine, 32(11), 1242–1246. https://doi.org/10.1007/s11606-017-4159-y
  8. Ibid.
  9. Daniel, M., Rencic, J., Durning, S. J., Holmboe, E., Santen, S. A., Lang, V., Ratcliffe, T., Gordon, D., Heist, B., Lubarsky, S., Estrada, C. A., Ballard, T., Artino, A. R., Sergio Da Silva, A., Cleary, T., Stojan, J., & Gruppen, L. D. (2019). Clinical reasoning assessment methods: A scoping review and practical guidance. Academic Medicine, 94(6), 902–912. https://doi.org/10.1097/acm.0000000000002618
  10. Ibid.
  11. Obeso, V., Brown, D., Aiyer, M., Barron, B., Bull, J., Carter, T., Emery, M., Gillespie, C., Hormann, M., Hyderi, A., Lupi, C., Schwartz, M., Uthman, M., Vasilevskis, EE., Yingling, S., & Phillipi, C. (2017). Core Entrustable Professional Activities for Entering Residency: Toolkits for the 13 Core EPAs – Abridged. American Association of Medical Colleges. Retrieved from https://www.aamc.org/media/20211/download
  12. Encandela, J. A., Shaull, L., Jayas, A., Amiel, J. M., Brown, D. R., Obeso, V. T., Ryan, M. S., & Andriole, D. A. (2023). Entrustable professional activities as a training and Assessment Framework in undergraduate medical education: A case study of a multi-institutional pilot. Medical Education Online, 28(1). https://doi.org/10.1080/10872981.2023.2175405
  13. Angus, S. V., Vu, T. R., Willett, L. L., Call, S., Halvorsen, A. J., & Chaudhry, S. (2017). Internal Medicine Residency Program Directors’ views of the core entrustable professional activities for entering residency: An opportunity to enhance communication of competency along the Continuum. Academic Medicine, 92(6), 785–791. https://doi.org/10.1097/acm.0000000000001419
  14. Holmboe, E.S., MD & Iobst, W.F., MD. (2020). See reference #4.
  15. McGaghie, W. C., Barsuk, J. H., & Wayne, D. B. (2015). Mastery learning with deliberate practice in medical education. Academic Medicine, 90(11), 1575. https://doi.org/10.1097/acm.0000000000000876
  16. van Schaik, S., MD, PhD. (n.d.) Deliberate Practice. Office of Research and Development in Medical Education. University of California San Francisco School of Medicine. Retrieved from https://meded.ucsf.edu/sites/meded.ucsf.edu/files/inline-files/pearls-deliberate-practice.pdf
  17. Vukanovic-Criley, J. M., Criley, S., Warde, C. M., Boker, J. R., Guevara-Matheus, L., Churchill, W. H., Nelson, W. P., & Criley, J. M. (2006). Competency in cardiac examination skills in medical students, trainees, physicians, and faculty. Archives of Internal Medicine, 166(6), 610. https://doi.org/10.1001/archinte.166.6.610
  18. Issenberg, S. B., McGaghie, W. C., Gordon, D. L., Symes, S., Petrusa, E. R., Hart, I. R., & Harden, R. M. (2002). Effectiveness of a cardiology review course for Internal Medicine residents using simulation technology and deliberate practice. Teaching and Learning in Medicine, 14(4), 223–228. https://doi.org/10.1207/s15328015tlm1404_4
  19. Ibid.
  20. Obeso, V., Brown, D., Aiyer, M., Barron, B., Bull, J., Carter, T., Emery, M., Gillespie, C., Hormann, M., Hyderi, A., Lupi, C., Schwartz, M., Uthman, M., Vasilevskis, EE., Yingling, S., & Phillipi, C. (2017). See reference #12.
  21. Kolbe, M., Goldhahn, J., Useini, M., & Grande, B. (2023). “asking for help is a strength”—how to promote undergraduate medical students’ teamwork through simulation training and Interprofessional Faculty. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1214091
  22. Havyer, R. D., Nelson, D. R., Wingo, M. T., Comfere, N. I., Halvorsen, A. J., McDonald, F. S., & Reed, D. A. (2016). Addressing the Interprofessional collaboration competencies of the Association of American Medical Colleges: A systematic review of Assessment Instruments in undergraduate medical education. Academic Medicine, 91(6), 865–888. https://doi.org/10.1097/acm.0000000000001053
  23. Sentinel Event Data 2022 Annual Review. (2023). The Joint Commission. Retrieved from  https://www.jointcommission.org/-/media/tjc/documents/resources/patient-safety-topics/sentinel-event/03162023_sentinel-event-_annual-review_final.pdf
  24. Hostetter, M. & Klein, S. (n.d.) In Focus: Modernizing Medical Education to Advance New Care Models and Foster Continuous Quality Improvement. The Commonwealth Fund. Retrieved from https://www.commonwealthfund.org/publications/newsletter-article/focus-modernizing-medical-education-advance-new-care-models-and
  25. Ibid.
  26. Holmboe, E.S., MD & Iobst, W.F., MD. (2020). See reference #4.
  27. Chaplin, T., Braund, H., Szulewski, A., Dalgarno, N., Egan, R., & Thoma, B. (2022). Multi-source feedback following simulated resuscitation scenarios: A qualitative study. Canadian Medical Education Journal. https://doi.org/10.36834/cmej.72387
  28. Holmboe, E.S., MD & Iobst, W.F., MD. (2020). See reference #4.
  29. Core Entrustable Professional Activities for Entering Residency: Curriculum Developers’ Guide. (n.d.) American Association of Medical Colleges (AAMC). Retrieved from https://store.aamc.org/downloadable/download/sample/sample_id/63/%20
  30. Malone, M., San Miguel, C., Leung, C., Danforth, D., Maicher, K., Vakil, J., Way, D., & Kman, N. (2022). 349EMF virtual reality simulation to assess EPA-10 in fourth-year medical students. Annals of Emergency Medicine, 80(4). https://doi.org/10.1016/j.annemergmed.2022.08.376
  31. Avegno, J., Leuthauser, A., Martinez, J., Marinelli, M., Osgood, G., Satonik, R., & Ander, D. (2014). Medical Student Education in emergency medicine: DO students meet the national standards for clinical encounters of selected core conditions? The Journal of Emergency Medicine, 47(3), 328–332. https://doi.org/10.1016/j.jemermed.2014.04.029
  32. Ibid.
  33. WVSOM introduces virtual reality educational component. (2021). West Virginia School of Osteopathic Medicine. Retrieved from https://www.wvsom.edu/news/2021/september/wvsom-introduces-virtual-reality-educational-component