From Evaluation to Impact: Using Data to Prepare Practice-Ready Nurses
Customer story
Customer story
PhD, RN, CHSE
Assistant Dean of Simulation for the College of Nursing
University of Tennessee Knoxville

The challenge:
Dr. Susan Hébert and her team at the University of Tennessee Knoxville knew they didn’t have the complete, reliable data they needed to fully understand student progression toward competence.
Manual workflows and paper-based checklists meant:
They had a sense of where students struggled—but without consistent, detailed data, those insights were difficult to confirm or act on.

The solution:
The team knew they needed an efficient, unified system to capture and analyze performance data that could help inform how students are prepared for practice.
They began using SimCapture, a simulation management system that would help them manage performance data more efficiently. They started with the data from their simulation scenarios. Later, they expanded into skills lab evaluation using SimCapture for Skills, bringing both environments into one system.
To support faculty during the change, they created a transition path. Some faculty continued using laminated checklists before entering data digitally, while others adapted more quickly to real-time entry.
The flexibility helped the program move forward together and ultimately reach consistent adoption, ensuring more consistent data capture.

The shift made evaluation data easier to capture and access. Dr. Hébert shared that previously, data required manual entry and management by support staff.
“It used to be that a Master’s-prepared evaluation specialist and her assistants entered all the data into a spreadsheet. SimCapture has taken a ton of work off that group of people.”
With SimCapture, data is captured at the point of evaluation and can be accessed or exported as needed.
“What happens now is once the courses are completed, I download all the mastery learning and the scenario evaluation data that we’re gathering for program outcomes,” she says. “I can quickly download those into spreadsheets.”
This allowed faculty and staff to spend less time managing data and more time reviewing and using it to support student development.

One of the earliest breakthroughs came from improving data completeness. With structured evaluations, faculty could no longer submit partially completed checklists. This reduced missing data and improved the overall reliability of evaluation results.
This shift meant the data they were reviewing became more accurate and usable. For the program, this marked a turning point. Evaluation data could now be used with confidence to better understand student performance.

Once data became reliable, Dr. Hébert and her team were able to use it in more meaningful ways.
They could analyze data including:
Instead of relying on manual spreadsheets or external support, they could quickly access the information needed to evaluate performance.
This level of analysis allowed the program to move beyond recording results to identifying patterns in performance that inform teaching and learning.
This ability to analyze performance at a deeper level would lead directly to changes in the curriculum.
The real impact came when the data revealed clear patterns.
Across cohorts, if students consistently underperformed in a specific concept within a key scenario, Dr. Hébert and the team were able to address this concern immediately.
“We need to think about application of concepts and competencies within care, because that’s what most practicing RNs at the bedside are doing,” she explains.
“We knew there were areas we needed to focus on all along. But now that we have the data to show it, it’s been really nice.”
She and her team can bring these findings to course leaders and curriculum committees. Faculty then respond by reinforcing the concepts students are having difficulty understanding to better align instruction with clinical practice.
What once would have been a general concern can be confirmed using clear, data-supported improvement designed to strengthen how students apply skills in clinical settings.
“Some people are convinced by data,” she says. “I’m a quantitative person. That’s why it’s been so nice to have this quantitative data. It is really guiding [us] now.”
“It’s informing our program needs better than we’ve ever been able to do before.”

Alongside using data to inform program decisions, the team strengthened how student competence is developed and evaluated.
They implemented structured deliberate practice labs where students:
The program also captures multiple evaluation points, including repeat attempts when students need additional practice.
SimCapture for Skills supports this by allowing performance to be documented across practice and evaluation activities and enabling different types of assessment during practice.
Within these deliberate practice labs, students also engage in peer-to-peer assessment by completing skills checklists with one another, while faculty remain present to observe performance and provide oversight when needed.
The results of the deliberate practice labs have been strong. Most students successfully complete check-offs on their first attempt.
These structures help ensure students are prepared before reaching final assessment.
Dr. Hébert explains that meaningful change required persistence. “It took us two years to make it happen,” she shares. Adoption required time, support, and consistent leadership, especially as faculty adjusted to new workflows and expectations.
“It takes somebody to champion it and stay the course,” she says.
By staying focused on the long-term goal, the program was able to establish consistent data practices across faculty.