Skip to main content

Assessment Program Supervisor - School Of Medicine

Primary Location Pasadena, California Schedule Full-time Shift Day Salary $98700 - $127710 / year
Job Number 1378158 Date posted 09/06/2025
Submit Interest
Job Summary:

The Assessment Program Supervisor is responsible for managing the assessment program to generate and optimally utilize assessment data at the Kaiser Permanente Bernard J. Tyson School of Medicine (KPSOM). This includes informing decisions about student achievement, supporting students in their academic progress, and providing insights into curriculum and assessment strengths and gaps to faculty, administrators, and students.   This role trains faculty on assessment data, conduct analysis, promotes equity, inclusion and diversity in the assessment program and support educational scholarship This role will interface with Information Technology(IT)  in the design and maintenance of analytics to support assessment-related efforts.

Essential Responsibilities:

  • Provide support for faculty development through assessment data interpretation and utilizing assessment data and dashboards in the Curriculum as a Whole review, Phase Reviews, and other curricular evaluation efforts
  • Coordinate and execute Competency Committee Review Processes for each Phase, including faculty development, data preparation and presentation, process review, and meeting facilitation
  • In collaboration with IT, contribute to the ongoing development and maintenance of assessment related dashboards, including ensuring the creation and integrity of data flowing into the system from the Learning Management System (LMS) and other sources, and participating in the design of new dashboards and enhancements to the existing system
  • Provide staff and faculty development to support the creation of accurate and aligned assessment data
  • Researches and monitors trends in health professions and medical education assessment design and methodologies, and communicates findings to the Office of Assessment and Evaluation (OAE) leadership.
  • Monitor project plan execution, addressing barriers and collaborating with OAE leadership to ensure necessary resources and timely completion, escalating concerns as needed
  • Collaborate on the writing and production of the Medical Student Performance Evaluation letters (MSPE) and ensure effective project management
  • Manage OAE support for National Board of Medical Examiners (NBME) products, including exams, testing blueprints, conduct web-based item review meetings with faculty, and inform course reviews process
  • Oversee the preparation and provision of assessment data for reviews of courses, Phases and the Curriculum as a Whole
  • Conduct analyses of assessment data as directed by OAE leadership for equity, validity, reliability, time trends, and curricular evaluation
  • Coordinate and present student performance data, analyses, and visualizations for various academic and oversight teams, committees, and curricular governance bodies
  • Oversee the timely in-house cataloguing and analysis of NBME score reports and annual summaries, and the uploading of NBME program level assessment data into the Learning Management System
  • Ensure data management systems comply with regulatory requirements and institutional data governance guidelines
  • Provide consultation and support as able to Objective Structured Clinical Examination (OSCE) assessment system and data analysis
  • Supervises and coordinates daily activities of designated work team by monitoring the execution and completion of action items and work assignments; ensures all policies and procedures are followed.
  • Aligns team efforts and standards, and measures progress in achieving results; determines and carries out processes and methodologies; resolves escalated issues as appropriate.
  • Solicits and acts on performance feedback; provides team members with feedback; and mentors and coaches to drive performance improvement
  • Pursues professional growth; provides training and development to talent for growth opportunities; supports execution of performance management guidelines and expectations. Implements, adapts, and stays up to date with organizational change, challenges, feedback, best practices, and processes.
  • Participates in curriculum and planning meetings, as needed, presenting relevant assessment data  
  • Serve on other KPSOM workgroups and committees
Basic Qualifications:

Experience


  • Minimum three (3) years of experience in education, preferably in medical, health professions, or higher education

  • Minimum two (2) years of experience in assessment principles/methods and educational measurement techniques including formative and summative assessments, and quantitative and qualitative approaches

  • Minimum two (2) year of experience in a leadership role with or without direct reports


Education


  • Bachelors degree in education related area OR four (4) years of experience in a directly related field.

  • High School Diploma or General Education Development (GED) required.


License, Certification, Registration


  • N/A



Additional Requirements:


  • Experience in student performance and other data sets appropriate for historical and comparative analyses in program evaluation and medical education research projects

  • Basic understanding of psychometric properties in educational assessments

  • Familiar with curriculum development or academic administration, preferably in medical or health professions education

  • Experience in using educational technology and/or assessment software

  • Advanced proficiency in Excel, Word, PowerPoint, and other Microsoft suite tools

  • Experience with statistical software packages (SAS, SPSS, STAT, R Programming Language), preferred

  • Experience with data collection tools and survey platforms (Qualtrics, Survey Monkey, MedOasis, E*Value, MedHub, Explorance Blue)

  • Experience with writing technical reports, including results of qualitative and quantitative analyses

  • Experience with internet-based communication and collaboration platforms (e.g., MS Teams, Zoom, GoToMeeting, WebEx, Skype, etc.)

  • Ability to apply qualitative analysis principles (e.g., inductive and deductive coding approaches, constant comparative method, etc.)

  • Knowledge of database architecture principles

  • Knowledge of current and emerging trends in medical education, preferred

  • Demonstrated skill in training adults

  • Service-oriented in support of faculty, staff, and students

  • Strong written, verbal, presentation, and interpersonal skills

  • Organized self-starter, with strong time management skills, detail oriented

  • Ability to manage competing priorities in a fast-paced environment

  • Analytical decision-making skills required to complete activities/tasks with minimal supervision

  • Ability to become familiar with new topics quickly and meet challenging deadlines amidst multiple priorities. Orientation to collaborating with others and synthesizing information from multiple interested parties into a coherent work product.



Preferred Qualifications:


  • Five (5) years of program assessment and process improvement experience, preferably in medical education, health professions, higher education, or social sciences.

  • Masters degree in Education or related field, preferred.

Primary Location: California,Pasadena,Green Street/IDS Scheduled Weekly Hours: 40 Shift: Day Workdays: Mon, Tue, Wed, Thu, Fri Working Hours Start: 08:00 AM Working Hours End: 05:00 PM Job Schedule: Full-time Job Type: Standard Worker Location: Flexible Employee Status: Regular Employee Group/Union Affiliation: NUE-PO-01|NUE|Non Union Employee Job Level: Individual Contributor Department: SCHOOL OF MEDICINE - Assessment and Evaluation - 9201 Pay Range: $98700 - $127710 / year Kaiser Permanente is committed to pay equity and transparency. The posted pay range is based on possible base salaries for the role and does not include the value of our total rewards package. Actual pay determined at offer will be based on years of relevant work experience, education, certifications, skills and geographic location along with a review of current employees in similar roles to ensure that pay equity is achieved and maintained across Kaiser Permanente. Travel: Yes, 10 % of the Time

Kaiser Permanente is an equal opportunity employer committed to fair, respectful, and inclusive workplaces. Applicants will be considered for employment without regard to race, religion, sex, age, national origin, disability, veteran status, or any other protected characteristic or status.

Submit Interest

Expected Employee Conduct >

Navigating the Hiring Process

We're here to support you!

Having trouble with your account or have questions on the hiring process?

Please visit the FAQ page on our website for assistance.

Need help with your computer and browser settings?

Please visit the Technical Information page for assistance or reach out to the web manager at kp-hires@kp.org.

Do you need a reasonable accommodation due to a disability?

Reasonable accommodations may be available to facilitate access to, or provide modifications to the following:

  • Online Submissions
  • Pre-Hire Assessments
  • Interview Process

If you have a disability-related need for accommodation, please submit your accommodation request and someone will contact you.

Join Our Talent Network
Explore This Location
View Stories and Resources

Jobs For You

You have no recently viewed jobs

You currently have no saved jobs

A Women standing near wall

Join Our Talent Community

Join our Talent Network today to receive email notifications about our career opportunities that match your skills.

Sign Up