Poster3 - 06: A RESIDENT-DRIVEN MOBILE EVALUATION SYSTEM CAN BE USED TO AUGMENT TRADITIONAL SURGERY ROTATION EVALUATIONS
Kurun Partap S Oberoi, MD, Akia D Caine, MD, Jacob Schwartzman, MD, Aziz M Merchant, MD, FACS, Anastasia Kunac, MD, FACS; Rutgers New Jersey Medical School, Department of Surgery
Background: As part of the Accreditation Council for Graduate Medical Education (ACGME) Common Program Requirements, residents must receive evaluations in key areas based on specific General Surgery Milestones. Shortcomings of the traditional computer-based evaluation system are a low completion rate and delay in completion. We hypothesized that adoption of a web-based form that could easily be transmitted on mobile devices would improve timeliness of evaluations and increase evaluations received.
Methods: Traditional milestone-based evaluations for an academic General Surgery residency program with 8 categorical residents/year were converted into a web-based form via a widely available, free, and secure application and implemented from 8/11/17 to 10/10/17. Web-based forms were created for key areas: operative procedures, bedside procedures, patient encounters, professionalism, and conference presentations. All data was transmitted confidentially to the Program Director. Attendings and residents were sent a link via e-mail/text message and emailed instructions for the mobile system. Residents were encouraged to solicit evaluations from faculty they worked with. Interim analysis was performed after 2 months of using the new system and compared to one year of data from the old system.
Results: There was no difference between the completion rate of traditional evaluations before and after the introduction of the mobile system (p=0.11). Key findings are summarized below:
| Traditional System | Mobile System | |
| Average number of monthly evaluations | 13 (±10) | 23 (±4) |
| Number of evaluators | 17 | 17* |
| Percentage of evaluations requested by residents | 0% | 37% |
| Average time to completion after end-of-rotation (in days) | 49 (±62) | 0 |
*12 unique attendings
There was a significant increase in the number of PGY5 evaluations completed on the mobile system compared to the traditional system (p=0.03).
Conclusions: A resident-driven mobile evaluation system may increase the number of monthly evaluations, may encourage participation of more faculty, increases the number of senior resident evaluations, encourages timely completion of evaluations, and does not have a negative effect on the rate of completion of traditional evaluations. A free web-based mobile evaluation system can augment traditional end-of-rotation evaluations.