Studies Currently Ongoing

Characteristics of Clinical Competency Committee (CCC) Member Milestone Level Assignments and Recommended Advancement Decisions

PI: Dan Schumacher, MD, MEd

Synopsis: Studies the relationship between individual CCC member judgments and and reported milestones and advancement decisions. Investigates whether program and CCC member factors moderate that relationship.

Status: Approved, sampling plan in development

Scholarly activity during residency: A national study of pediatric residents and program directors

PI: Erika Abramson, MD (Cornell)

Synopsis: In this study, we intend to conduct a national survey of pediatric residents and program directors in order to:

  1. Understand resident satisfaction with their current experience and barriers to conducting scholarly activity during residency.
  2. Identify what resident and program factors are associated with: scholarly productivity during residency and positive attitudes among residents towards scholarly activity during residency.
  3. Identify areas of concordance and discrepancy between residents and program directors with regard to beliefs about scholarly activity training in residency, barriers, and satisfaction with training within individual program

Status: Approved, sampling plan in development

Assessing the Association between Entrustable Professional Activities (EPAs), Competencies, and Milestones in the Pediatric Subspecialties

Collaborators: APPD LEARN, Council of Pediatric Subspecialties, American Board of Pediatrics

Synopsis: The specific objectives are 1) to determine if there is a specific milestone level that must be reached for each of the subcompetencies within a specific EPA to judge that a fellow is deemed entrustable, 2) to compare the milestone level at which fellows are deemed entrustable across the pediatric subspecialties and to determine if any specific subcompetencies are more influential in the entrustment decision than others and 3) to compare the initial overall impression of fellow level of entrustment for a given EPA made by the Fellowship Program Director with that determined by the Clinical Competency Committee (CCC) after the milestone levels for that EPA are assigned.

Status: Data collection in process

Pediatrics Milestones Assessment Collaborative (PMAC) - Module 1

Collaborators: APPD LEARN, American Board of Pediatrics, National Board of Medical Examiners

Project Director: Patricia Hicks, MD, MHPE

Synopsis: Develop a national Pediatrics Milestones-based Assessment System - an assessment system that will provide meaningful, feasible assessment evidence that can be used by the program leadership and clinical competency committee members to guide decisions for progression through increasing levels of responsibility and independence.

Status: Site enrollment and data collection in process

Validity of resident self-assessment using Pediatrics Milestones

PIs: Su-Ting Li (UC Davis) and Kimberly Gifford (Dartmouth-Hitchcock)

Synopsis: This study seeks to describe pediatric resident self-assessment of competence using the Pediatrics Milestones for 21 ACGME-selected sub-competencies, and characterize and explain variation in agreement between pediatric resident self-assessment, external assessments based on Pediatrics Milestones, and overall summative assessments of resident performance.

Status: First round data collection was completed in July 2014. Study extended for an additional year.

Past Studies

Striving for the Optimal Balance Between Service and Education

PIs: Debra Boyer, MD (Harvard), Jennifer Kesselheim, MD (Harvard)

Synopsis: Survey residents and program directors to (1) establish each cohorts' assessment of the balance of service and education in their training programs, (2) measure program directors' and residents' perceptions of the amount of service and education inherent in common scenarios encountered during pediatric residency training, and (3) elucidate definitions of service and education, endorsed by both program directors and trainees, that can serve as a useful foundation for curriculum development during residency training

Synopsis: Data collected. Analyses in process.

New Professionalism Challenges in Medical Training: An Exploration of Social Networking

PI: Jennifer Kesselheim (Harvard)

Synopsis: This study surveys pediatric trainees to explore their perceptions of and experiences with social networking sites and training program policies around social media.

Status: Data collection is complete for this study.

Assessment of Pediatrics Milestones Pilot

PI: Patricia Hicks, MD (CHOP); Steve Clyman, PhD (NBME); Alan Schwartz, PhD (UIC)

Synopsis: In partnership with the NBME, this study seeks to test the feasibility of a set of assessment instruments constructed from nine Pediatrics Milestones. Instruments are designed to inform decisions about readiness to serve in the inpatient pediatric wards, based on ratings of direct observations recorded on handheld devices. Study instruments include: structured clinical observations for rounds and history taking; a multisource feedback instrument; and, Pediatrics Milestones Classification assessment form. Study learners include interns and sub-interns, with faculty, residents, and nurses serving as raters. Features include collection of de-identified learner data in APPD LEARN, individualized learner feedback, faculty development materials for rater and feedback provider training. Outcomes from this study will be used to inform further development of the Pediatrics Milestones and APPD LEARN.

Status: Data collection ended June 2013. Data analyses and manuscript writing in progress.

The New Duty Hour Regulations--Were Changes Necessary? A Survey of Pediatric Program Directors

PI: Hilary Haftel, MD (University of Michigan)

Synopsis: This study seeks to identify what, if any, changes in Pediatric Residency Program structure were necessary to achieve compliance with the new DHR by July 2011. This specifically includes any changes to the amount or periods of resident work hours, changes in supervision, and changes in external or internal moonlighting

Status: Data collection complete.