New ABIM Survey Indicates Physician Interest in Potential Changes to MOC Assessment
Results from the survey, "Improving the MOC Assessment Experience," were presented to more than 70 leaders of medical societies attending an ABIM meeting on Friday, April 8. This week, the ABIM Board of Directors and Council are considering physician-guided recommendations about options for updating the MOC assessment process as well as a timetable to seek feedback from physicians, launch a pilot, evaluate the pilot and ultimately implement changes. ABIM will share the timetable later this spring.
Insights from the survey and from ongoing conversations with the internal medicine community are helping ABIM understand how physicians view potential assessment innovations, including using open-book assessments; testing out of a full-length high-stakes assessment; at-home or in-office assessments; and shorter, more frequent assessments.
By using a representative sample, ABIM was able to make inferences about the full population of ABIM Board Certified physicians.
Key survey findings from the representative sample (29.4% response rate):
"In our efforts to deliver a meaningful, performance-based credential that signifies something important about physicians, the survey results provide invaluable guidance as to what physicians favor in the assessment process," said Richard J. Baron, MD, President and CEO of ABIM. "These insights will empower our decision making for the future by giving us direct insight into what physicians value as future components of our evolving MOC assessment."
Dr. Baron added that additional survey analysis will inform new and ongoing engagement efforts, such as:
"Opinions from physicians gleaned through the survey will be used to frame future discussions and refine details about potential assessment ideas," said Richard G. Battaglia, MD, Chief Medical Officer of ABIM. "Results indicate that physicians are interested in exploring all of the ideas presented in the survey. ABIM will continue to engage physicians and societies to explore assessment models that are reflective of practice today."
ABIM is committed to ongoing communication with physicians through focus groups, one-on-one conversations and quarterly progress reports, in addition to updates and input opportunities through the Transforming ABIM site.
About ABIM's survey: Improving the MOC Assessment Experience
ABIM invited all diplomates with a valid e-mail address (N=195,867) to complete a brief online survey to understand how various assessment ideas might impact them. We received 9,242 responses from all invited diplomates and a 29 percent response rate from a simple random representative sample, which was sufficient to draw appropriate inferences about the population. The survey was conducted from December 2015 to March 2016. We weighted responses and performed multiple imputations to correct for non-response bias in the representative sample. There were no statistically significant differences in attitudes toward any of the exam ideas or related questions between the sample and population respondents. There were, however, some notable trend differences in attitudes in that the sample was less unsure about shorter, more frequent assessments; slightly more positive toward the 10-year exam and access to external resources during the assessment; generally less negative toward their overall satisfaction with MOC; and less negative toward ABIM's recent community engagement efforts. ABIM continues to analyze the quantitative and qualitative responses from the general population and will release those results later this spring.
For 80 years, certification by the American Board of Internal Medicine (ABIM) has stood for the highest standard in internal medicine and its 20 subspecialties and has meant that internists have demonstrated-to their peers and to the public-that they have the clinical judgment, skills and attitudes essential for the delivery of excellent patient care. ABIM is not a membership society, but a non-profit, independent evaluation organization. Our accountability is both to the profession of medicine and to the public. ABIM is a member of the American Board of Medical Specialties. For additional updates, follow ABIM on Facebook and Twitter.