Research Topics
| J R BouletSummaryAffiliation: Educational Commission for Foreign Medical Graduates Country: USA Publications
| Collaborators
|
Detail Information
Publications
A simulation-based acute skills performance assessment for anesthesia trainingDavid J Murray
Washington University Clinical Simulation Center, Washington University School of Medicine, St Louis, Missouri 63110, USA
Anesth Analg 101:1127-34, table of contents. 2005..IMPLICATIONS: A trainee's skill in managing critical events can be assessed using a multiple scenario simulation-based performance evaluation...
Review article: assessment in anesthesiology educationJohn R Boulet
Foundation for Advancement of International Medical Education and Research, Philadelphia, PA 19104 2685, USA
Can J Anaesth 59:182-92. 2012..Although many of the competencies are difficult to define and measure specifically, advances in assessment techniques have provided more opportunities to gather meaningful performance data...- The international medical graduate pipeline: recent trends in certification and residency trainingJohn R Boulet
Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania, USA
Health Aff (Millwood) 25:469-77. 2006..More detailed longitudinal analyses are required to better understand the interwoven issues of physician supply, consumers' needs, and the role of IMGs in the U.S. health care system... - The effect of task exposure on repeat candidate scores in a high-stakes standardized patient assessmentJohn R Boulet
Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104, USA
Teach Learn Med 15:227-32. 2003..Failing candidates often make multiple attempts on licensure and certification examinations. For performance-based assessments, where available test material is often limited, overlap in examination content is frequently inevitable... - Reliability and validity of a simulation-based acute care skills assessment for medical students and residentsJohn R Boulet
Research and Evaluation, Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania 19104 2685, USA
Anesthesiology 99:1270-80. 2003..The purpose of this study was to develop and test simulation exercises and associated scoring methods that could be used to evaluate the acute care skills of final-year medical students and first-year residents... - Assessing the written communication skills of medical school graduatesJohn R Boulet
Research and Evaluation, Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104 2685, USA
Adv Health Sci Educ Theory Pract 9:47-60. 2004..The relationship of PN scores with other related ability measures and select candidate characteristics provides additional evidence to support the validity of the written exercise... - Assessing the ability of medical students to perform osteopathic manipulative treatment techniquesJohn R Boulet
National Board of Osteopathic Medical Examiners, Chicago, Ill, USA
J Am Osteopath Assoc 104:203-11. 2004..Additional studies that incorporate a larger sample of students and focus on modifications to the assessment tool and rating protocols are warranted... - Does composition medium affect the psychometric properties of scores on an exercise designed to assess written medical communication skills?John R Boulet
Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104 2685, USA
Adv Health Sci Educ Theory Pract 12:157-67. 2007..The results of this study suggest that the psychometric properties of the patient note scores are invariant with respect to composition method... - Investigating gender-related construct-irrelevant components of scores on the written assessment exercise of a high-stakes certification assessmentJohn R Boulet
Educational Commission for Foreign Medical Graduates ECFMG, 3624 Market Street, Philadelphia, PA 19104 2685, USA
Adv Health Sci Educ Theory Pract 10:53-63. 2005..01, effect size = 0.23). The results of this study suggest that, based on rater, SP, and candidate characteristics, the validity of the PN ratings is not compromised... - A comparison of the characteristics and examination performances of U.S. and non-U.S. citizen international medical graduates who sought Educational Commission for Foreign Medical Graduates certification: 1995-2004John R Boulet
Research and Data Resources Foundation for Advancement of International Medical Education and Research FAIMER, 3624 Market Street, Philadelphia, Pennsylvania 19104, USA
Acad Med 81:S116-9. 2006..International medical graduates (IMGs) make up a substantial part of the U.S. physician workforce. Unfortunately, little is known about the demographic and performance characteristics of these doctors, especially over time... - Checklist content on a standardized patient assessment: an ex post facto reviewJohn R Boulet
Educational Commission for Foreign Medical Graduates ECFMG, Philadelphia, PA 19104 2685, USA
Adv Health Sci Educ Theory Pract 13:59-69. 2008..Periodic review of checklist items, concentrating on their clinical importance, is warranted... - Setting defensible performance standards on OSCEs and standardized patient examinationsJohn R Boulet
Research and Evaluation, Educational Commission for Foreign Medical Graduates, Philadelphia 19104, USA
Med Teach 25:245-9. 2003..In addition, based on the prevailing literature and research, ideas for future studies and potential augmentations to current performance-based standard setting protocols are advanced... - Using National Medical Care Survey data to validate examination content on a performance-based clinical skills assessment for osteopathic physiciansJohn R Boulet
National Board of Osteopathic Medical Examiners, Chicago, Ill, USA
J Am Osteopath Assoc 103:225-31. 2003..These differences suggest that from a content perspective, a performance-based clinical skills evaluation targeted at osteopathic physicians should be characteristically different from one designed for allopathic physicians... - Quality assurance methods for performance-based assessmentsJohn R Boulet
Research and Evaluation, Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104 2685, USA
Adv Health Sci Educ Theory Pract 8:27-47. 2003..The results presented in this investigation highlight the need for well-defined training regimes, regular feedback to those involved in rating/scoring performances, and detailed statistical analyses of all scores... - Clinical skills deficiencies among first-year residents: utility of the ECFMG clinical skills assessmentJohn R Boulet
Philadelphia, PA 19104, USA
Acad Med 77:S33-5. 2002 - Assessing the comparability of standardized patient and physician evaluations of clinical skillsJohn R Boulet
Educational Commission for Foreign Medical Graduates, Philadelphia, PA, USA
Adv Health Sci Educ Theory Pract 7:85-97. 2002..These results provide evidence of the convergent validity of CSA scores... - Assessing the impact of examinee and standardized patient ethnicity on test scores in a large-scale clinical skills examination: gathering evidence for the consequential aspect of validityAndre F De Champlain
National Board of Medical Examiners, Philadelphia, PA 19104, USA
Acad Med 79:S12-4. 2004.... - Setting performance standards for mannequin-based acute-care scenarios: an examinee-centered approachJohn R Boulet
Foundation for Advancement of International Medical Education and Research, Philadelphia, Pennsylvania 19104, USA
Simul Healthc 3:72-81. 2008.... - A work-centered approach for setting passing scores on performance-based assessmentsDanette Waller McKinley
Educational Commission for Foreign Medical Graduates, USA
Eval Health Prof 28:349-69. 2005..Application and evaluation of the method are illustrated using examination materials obtained from a high-stakes certification assessment... - Using standardized patients to assess the communication skills of graduating physicians for the comprehensive osteopathic medical licensing examination (COMLEX) level 2-performance evaluation (level 2-PE)Angela C Weidner
National Center for Clinical Skills Testing, National Board of Osteopathic Medical Examiners, Conshohocken, Pennsylvania, USA
Teach Learn Med 22:8-15. 2010..Standardized patients can be trained to assess the communication and interpersonal skills of medical students and graduates... - Validation of the doctor-patient communication component of the Educational Commission for Foreign Medical Graduates Clinical Skills AssessmentG P Whelan
Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania 19104, USA
Med Educ 35:757-61. 2001.... - Are interpersonal skills ratings influenced by gender in a clinical skills assessment using standardized patients?K A Chambers
Educational Commission for Foreign Medical Graduates, Clinical Skills Assessment Program, Philadelphia, PA 19104 2685, USA
Adv Health Sci Educ Theory Pract 6:231-41. 2001..The purpose of this study was to explore possible performance differences in interpersonal skills (IPS) ratings as a function of candidate and standardized patient (SP) gender... - Evaluating the spoken English proficiency of graduates of foreign medical schoolsJ R Boulet
Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania 19104-2685, USA
Med Educ 35:767-73. 2001..This result, combined with the high reproducibility of the ratings over encounters and SPs, supports the use of trained SPs to measure spoken English skills in a simulated medical environment... - A pediatric clinical skills assessment using children as standardized patientsJ L Lane
Department of Pediatrics, Medical College of Pennsylvania and Hahnemann University, Philadelphia, USA
Arch Pediatr Adolesc Med 153:637-44. 1999.... - An examination of the relationship between clinical skills examination performance and performance on USMLE Step 2Eric S Muller
NBME, Philadelphia, PA 19104, USA
Acad Med 78:S27-9. 2003..To examine the relationship between performance on a large-scale clinical skills examination (CSE) and a high-stakes multiple-choice examination... - Relationships among subcomponents of the USMLE Step 2 Clinical Skills Examination, the Step 1, and the Step 2 Clinical Knowledge ExaminationsPolina Harik
National Board of Medical Examiners, 3750 Market St, Philadelphia, Pennsylvania 19104, USA
Acad Med 81:S21-4. 2006..This research examined relationships between and among scores from the United States Medical Licensing Examination (USMLE) Step 1, Step 2 Clinical Knowledge (CK), and subcomponents of the Step 2 Clinical Skills (CS) examination... - State of the art in standardized patient programs: a survey of osteopathic medical schoolsAnthony M Errichetti
Comprehensive Osteopathic Medical Licensing Examination Performance Evaluation USA, National Board of Osteopathic Medical Examiners, Chicago, Ill, USA
J Am Osteopath Assoc 102:627-31. 2002..Details of the 12 schools' SPPs are highlighted... - Medical education in the Caribbean: variability in medical school programs and performance of studentsMarta van Zanten
FAIMER, 3624 Market Street, Philadelphia, PA 19104, USA
Acad Med 83:S33-6. 2008..The purpose of this study was to examine the structure of medical training programs in the Caribbean and the performance of the students... - Analysis of the relationship between score components on a standardized patient clinical skills examinationMelissa J Margolis
NBME, Philadelphia, PA 19104, USA
Acad Med 78:S68-71. 2003..This work investigated the reliability of and relationships between individual case and composite scores on a standardized patient clinical skills examination... 
Simulations in the United States Medical Licensing Examination (USMLE)G F Dillon
National Board of Medical Examiners, Philadelphia, PA, USA
Qual Saf Health Care 13:i41-5. 2004..A number of new testing formats intended to further enhance assessment of critical knowledge and skills will be available in the near future...- Using standardized patients to assess the interpersonal skills of physicians: six years' experience with a high-stakes certification examinationMarta van Zanten
Research and Evaluation, The Educational Commission for Foreign Medical Graduates, Philadelphia, PA 19104, USA
Health Commun 22:195-205. 2007..These results may also generalize to other clinical skills assessments, or other evaluations that employ raters to judge communication abilities... - Educational commission for foreign medical graduates certification and specialty board certification among graduates of the Caribbean medical schoolsJohn J Norcini
Foundation for Advancement of International Medical Education and Research, 3624 Market Street, Fourth Floor, Philadelphia, Pennsylvania 19104, USA
Acad Med 81:S112-5. 2006..To determine the variability among Caribbean medical schools in the performance of their students against markers of quality... - Assessing the underlying structure of the United States Medical Licensing Examination Step 2 test of clinical skills using confirmatory factor analysisAndre De Champlain
National Board of Medical Examiners, 3750 Market Street, Philadelphia, Pennsylvania 19104, USA
Acad Med 81:S17-20. 2006.... - Overview of accreditation of undergraduate medical education programmes worldwideMarta van Zanten
Foundation for Advancement of International Medical Education and Research, Philadelphia, Pennsylvania 19104, USA
Med Educ 42:930-7. 2008..There is significant variation in the structure and quality of undergraduate medical education around the world. Accreditation processes can encourage institutional improvement and help promote high-quality education experiences... - Migration of doctors for undergraduate medical educationJames A Hallock
Educational Commission for Foreign Medical Graduates, Philadelphia, PA 19104 2685, USA
Med Teach 29:98-105. 2007..Research on physician migration typically focuses on medical school graduates, most often those seeking postgraduate training opportunities elsewhere... - Flexner's global influence: medical education accreditation in countries that train physicians who pursue residency in the United StatesMarta van Zanten
Research and Data Resources, Foundation for Advancement of International Medical Education and Research FAIMER, Philadelphia, Pennsylvania 19104, USA
Acad Med 85:324-32. 2010..In addition to global variability in content and delivery of medical education programs, systems of quality assurance oversight are not universal, and there are variations in the scope of the reviews, protocols, and standards used... - Assessing the communication and interpersonal skills of graduates of international medical schools as part of the United States Medical Licensing Exam (USMLE) Step 2 Clinical Skills (CS) ExamMarta van Zanten
FAIMER, 3624 Market Street, Philadelphia, PA 19104, USA
Acad Med 82:S65-8. 2007..The ability to communicate effectively with patients is an essential element of a physician's clinical expertise... - Correlates of performance of the ECFMG Clinical Skills Assessment: influences of candidate characteristics on performanceMarta van Zanten
The Educational Commission for Froeign Medical Graduates, Philadelphia, PA 19104, USA
Acad Med 78:S72-4. 2003..The purpose of this study was to investigate whether candidate characteristics were related to CSA pass/fail status... - Evaluating the spoken English proficiency of international medical graduates: detecting threats to the validity of standardised patient ratingsMarta van Zanten
Clinical Skills Assessment, Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104, USA
Med Educ 37:69-76. 2003..To investigate potential threats to the validity of the spoken English proficiency ratings provided by standardised patients (SPs) in high-stakes clinical skills examinations... - Detecting score drift in a high-stakes performance-based assessmentDanette W McKinley
Research and Evaluation, Educational Commission for Foreign Medical Graduates, 3624 Market Street, 4th Floor, Philadelphia, PA 19104, USA
Adv Health Sci Educ Theory Pract 9:29-38. 2004..This is essential to ensure comparability of scores and pass-fail decisions for candidates who are assessed on multiple test forms throughout the year... - The effects of task sequence on examinee performanceDanette W McKinley
Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania 19104, USA
Teach Learn Med 16:18-22. 2004..If the sequence of administration of encounters in performance-based examinations has an appreciable impact on examinee performance, the validity of any associated assessment decisions could be compromised... - The influence of ethnicity on patient satisfaction in a standardized patient assessmentMarta van Zanten
Acad Med 79:S15-7. 2004..To study possible differences in patient satisfaction ratings as a function of physician and patient ethnicity in a standardized patient (SP) performance-based assessment... - Using a standardised patient assessment to measure professional attributesMarta van Zanten
Educational Commission for Foreign Medical Graduates, Philadelphia, Pennsylvania 19104, USA
Med Educ 39:20-9. 2005..While much work has focused on defining professionalism and teaching medical students the appropriate interpersonal behaviours, relatively little research has looked at meaningful ways of assessing the relevant attributes... - U.S. citizens who graduated from medical schools outside the United States and Canada and received certification from the Educational Commission for Foreign Medical Graduates, 1983-2002Mary B McAvinue
Registration and Credentials Services, Educational Commission for Foreign Medical Graduates, Philadelphia, PA 19104 2685, USA
Acad Med 80:473-8. 2005..S. and non-U.S. citizens, who obtained their medical degrees outside of the United States and Canada, with a focus on where U.S. citizens received their medical education and how this choice has changed over time... - The changing pool of international medical graduates seeking certification training in US graduate medical education programsGerald P Whelan
Educational Commission for Foreign Medical Graduates, 3624 Market St, Philadelphia, PA 19104, USA
JAMA 288:1079-84. 2002.... - Specialty board certification among U.S. citizen and non-U.S. citizen graduates of international medical schoolsJohn J Norcini
Foundation for Advancement of International Medical Education and Research, 3624 Market Street, Fourth Floor, Philadelphia, PA 19104, USA
Acad Med 80:S42-5. 2005..This study investigated whether they differ from U.S. medical graduates (USMGs) in specialty board certification... - Attrition rates of residents in postgraduate training programsMarta van Zanten
Educational Commission for Foreign Medical Graduates, 3624 Market Street, Philadelphia, PA 19104, USA
Teach Learn Med 14:175-7. 2002..One goal of program directors is to attract and retain high-quality residents. It is therefore important to study attrition of residents to determine specific cohorts that may be less likely to complete residency training... - Scoring standardized patient examinations: lessons learned from the development and administration of the ECFMG Clinical Skills Assessment (CSA)Gerald P Whelan
Educational Commission for Foreign Medical Graduates, Clinical Skills Assessment Program, Philadelphia, PA 19104 2685, USA
Med Teach 27:200-6. 2005..The early prototype administrations of the CSA, including many operational research studies, were supported and guided by Dr Friedman Ben-David, Friedman et al. 1991, 1993, Stillman et al. 1992, and Sutnick et al. 1993, 1995... - Using factor analysis to evaluate checklist itemsDanette W McKinley
Research and Evaluation Educational Commission for Foreign Medical Graduates, 3624 Market Street, 4th Floor, Philadelphia, PA 19104, USA
Acad Med 80:S102-5. 2005..The purpose of the current investigation is to illustrate the potential use of structural equation modeling (SEM) with scores from a standardized patient examination... - Summative assessment in medicine: the promise of simulation for high-stakes evaluationJohn R Boulet
Foundation for Advancement of International Medical Education and Research, Philadelphia, PA, USA
Acad Emerg Med 15:1017-24. 2008..Simulation, whether it involves standardized patients (SPs), computerized case management scenarios, part-task trainers, electromechanical mannequins, or a combination of these methods, holds great promise for high-stakes assessment... - Medical education in the Caribbean: variability in educational commission for foreign medical graduate certification rates and United States medical licensing examination attemptsMarta van Zanten
FAIMER, 3624 Market Street, Philadelphia, PA 19104, USA
Acad Med 84:S13-6. 2009..The purpose of this study was to investigate demographic characteristics and performance outcomes of Caribbean-educated physicians... - U.S. citizens who obtain their medical degrees abroad: an overview, 1992-2006John R Boulet
Foundation for Advancement of International Medical Education and Research in Philadelphia, Pennsylvania, USA
Health Aff (Millwood) 28:226-33. 2009..S. graduates. Moreover, they are more likely than non-U.S. citizens to be engaged in primary care activities. Changes in the composition of the IMG pool could affect the makeup and quality of the U.S. physician workforce... - The use of standardized patient assessments for certification and licensure decisionsJohn R Boulet
Foundation for Advancement of International Medical Education and Research J R B, Philadelphia, PA, USA
Simul Healthc 4:35-42. 2009.... - Patient note fabrication and consequences of unprofessional behavior in a high-stakes clinical skills licensing examinationJeanne M Sandella
National Board of Osteopathic Medical Examiners, Center for Clinical Skills Testing, 101 W Elm St, Suite 150, Conshohocken, PA 19428, USA
Acad Med 84:S70-3. 2009.... - Effect of first-encounter pretest on pass/fail rates of a clinical skills medical licensure examinationWilliam L Roberts
National Board of Osteopathic Medical Examiners, Inc, Conshohocken, PA, 19428 2004, USA
Adv Health Sci Educ Theory Pract 15:219-27. 2010..Results indicate that current examination administration protocols do not present a threat to the validity of test score interpretations... - Survey on the clinical skills of osteopathic medical studentsJohn R Gimpel
National Board of Osteopathic Medical Examiners, Clinical Skills Testing Center, Conshohocken, PA 19428 2075, USA
J Am Osteopath Assoc 106:296-301. 2006..These results provide additional support for requiring acceptable performance on a comprehensive clinical skills examination before admission to osteopathic graduate medical education programs... - Evaluation of the congruence between students' postencounter notes and standardized patients' checklists in a clinical skills examinationKatherine Worzala
Clinical Skills Center, Jefferson Medical College, Philadelphia, Pennsylvania 19107, USA
Teach Learn Med 20:31-6. 2008..Questions remain about the congruence between students' written notes and checklists as summaries of encounters... - Standardized patients and mechanical simulators in teaching and assessment at colleges of osteopathic medicineJohn R Gimpel
National Board of Osteopathic Medical Examiners, National Center for Clinical Skills Testing, 1010 W Elm St, Suite 150, Conshohocken, PA 19428 2075, USA
J Am Osteopath Assoc 107:557-61. 2007..A 2001 survey of 19 colleges of osteopathic medicine (COMs) revealed that standardized patient programs (SPPs) are increasingly used in osteopathic medical education. However, no new data have been published since... - The contribution of international medical graduates to diversity in the U.S. physician workforce: graduate medical educationJohn J Norcini
Foundation for Advancement of International Medical Education and Research, Philadelphia, PA 19104, USA
J Health Care Poor Underserved 19:493-9. 2008..To describe the ethnicity/race and gender distribution of the international medical graduates (IMGs) qualified to enter graduate medical education (GME) and those who are actually in GME... - Modeling longitudinal performances on the United States Medical Licensing Examination and the impact of sociodemographic covariates: an application of survival data analysisAndre De Champlain
National Board of Medical Examiners, 3750 Market Street, Philadelphia, Pennsylvania 19104, USA
Acad Med 81:S108-11. 2006..This study models time to passing United States Medical Licensing Examination (USMLE) for the computer-based testing (CBT) start-up cohort using the Cox Proportional Hazards Model... - Simulation-based assessment in anesthesiology: requirements for practical implementationJohn R Boulet
Foundation for Advancement of International Medical Education and Research, Philadelphia, Pennsylvania 19104, USA
Anesthesiology 112:1041-52. 2010.... - Acute care skills in anesthesia practice: a simulation-based resident performance assessmentDavid J Murray
Washington University Clinical Simulation Center, Department of Anesthesiology, Washington University School of Medicine, St Louis, Missouri, USA
Anesthesiology 101:1084-95. 2004..The purpose of this study was to develop simulation exercises and associated scoring methods and determine whether these scenarios could be used to evaluate acute anesthesia care skills... - Effects of case characteristics on encounter time in a high-stakes standardized patient examinationDanette W McKinley
Acad Med 81:S61-4. 2006..CONCLUSIONS: The extent to which examination content is balanced from administration to administration ensures a mix of cases that provides adequate time limits for examinees... - Performance of residents and anesthesiologists in a simulation-based skill assessmentDavid J Murray
Washington University Clinical Simulation Center, Washington University School of Medicine, St Louis, Missouri 63110, USA
Anesthesiology 107:705-13. 2007..The purpose of this study was to determine whether an inventory of simulated intraoperative scenarios provided a reliable and valid measure of anesthesia residents' and anesthesiologists' skill... - Evaluating the management of septic shock using patient simulationEinar Ottestad
Department of Anesthesia, Stanford University School of Medicine, Stanford, CA, USA
Crit Care Med 35:769-75. 2007..Develop a scoring system that can assess the management of septic shock by individuals and teams... - Developing performance-based medical school assessment programs in resource-limited environmentsAna Lia Vargas
National University of Cuyo, Mendoza, Argentina
Med Teach 29:192-8. 2007.... - Introduction of patient video clips into computer-based testing: effects on item statistics and reliability estimatesSteven A Lieberman
Acad Med 78:S48-51. 2003..Using patient video clips to evaluate examinees' skills in interpreting physical examination findings is possible with computer-based testing, but the psychometric properties of video-based questions are unknown... - Comparing traditional and computer-based training methods for standardized patientsAnthony Errichetti
Institute for Clinical Competence, New York College of Osteopathic Medicine, Northern Blvd, PO Box 8000, Old Westbury, NY 11568 8000, USA
Acad Med 81:S91-4. 2006..The purpose of this study was to compare a traditional SP training technique with one that was based on computer-based delivery of case materials and checklist-based scoring criteria...