Position Overview

The Assessment System Analyst collaborates with Undergraduate Medical Education leadership, course and clerkship directors, and faculty on the development of clinical assessments (e.g., EPAs), objective structured clinical examinations (OSCEs), and simulation. This person will assist in the implementation of testing software, will collaborate on building exams, and work with dashboards and assessment systems and software, including Item Response Theory and computer adaptive testing (CAT).

The Assessment System Analyst will be knowledgeable and experienced in the use of statistical and analytic software such as SPSS, R, Python, etc. and be able to conduct statistical and qualitative data analyses.

The Assessment System Analyst will train and support students, faculty, and staff on the use of medical school assessment tools. This person will serve as a contact point with collaborators in the office of information technology on issues related to assessment systems and software.

Duties/Responsibilities

30%: Development of Clinical Assessments

• Analyze and refine the Clinical Skills Assessment (CSA) protocol
• Assemble EPA assessment data and reports as requested
• Communicate effectively with students, staff, faculty, clerkship directors and leadership on the results of data analysis

30%: Develop and Maintain Dashboards and Assessment Systems

• Prepare data tables, charts, statistical significance
• Analyze and interpret data tables, charts, statistical significance, dashboards using software such as SPSS, R, Python
• Prepare narrative reports

20%: Implementation and Management of Testing Software

• Manage ExamSoft item analysis
• Explore the use of Fastest for potential use in (CAT)

10%: Collaborate on Building Exams

• Consult with Foundational Course directors, instructional designers and instructors regarding effective test construction and results of item analysis for continuous improvement
• Advise Clerkship Directors

10%: Maintain Clinical Exams

• Analyze results of objective structured clinical examinations (OSCEs) and collaborate with faculty and assessment colleagues to refine OSCEs based on data

Required Qualifications

• BA/BS in psychology, education, or related fields with expertise in assessment and measurement, psychometrics, statistics, data analytics, or related areas and two years of work experience, or master's degree
• Experience administering and analyzing assessments

Preferred Qualifications

• Master's degree in psychology, education, or related fields with expertise in assessment and measurement, psychometrics, statistics, data analytics, or related areas
• Training and experience in educational evaluation and measurement and/or research and assessment.
• Work experience in assessment and evaluation, preferably in medical education
• Proficiency with data analysis and data handling, storage and cleaning.
• Ability to utilize automated statistical programs
• High degree of proficiency in the construction and utilization of database, spreadsheet, word processing applications and other data analysis tools along with basic statistical analysis skills.

Committed to innovation and diversity, the Medical School educates physicians, scientists, and health professionals; generates knowledge and treatments; and cares for patients and communities with compassion and respect. We value excellence, inclusiveness, collaboration, and discovery.

The mission of the regional campus located in Duluth is to be a national leader in improving healthcare access and outcomes in rural Minnesota and American Indian/Alaska Native (AI/AN) communities. In partnership with CentraCare, the regional campus in St. Cloud offers a wide range of patient experiences throughout students' education in Greater Minnesota and prepares them to become exceptional clinicians and leaders for rural and immigrant populations.

Founded in 1888, the University of Minnesota Medical School has three campuses. A four-year MD program and the MD/PhD program are located on the Twin Cities campus in addition to MD programs at regional campuses in Duluth and St. Cloud.

Working at the University

At the University of Minnesota, you'll find a flexible work environment and supportive colleagues who are interested in lifelong learning. We prioritize work-life balance, allowing you to invest in the future of your career and in your life outside of work.

The University also offers a comprehensive benefits package that includes:

• Competitive wages, paid holidays, and generous time off
• Continuous learning opportunities through professional training and degree-seeking programs supported by the
• Low-cost medical, dental, and pharmacy plans
• Healthcare and dependent care flexible spending accounts
• University HSA contributions
• Disability and employer-paid life insurance
• Employee wellbeing program
• Excellent retirement plans with employer contribution
• Public Service Loan Forgiveness (PSLF)
• Financial counseling services
• Employee Assistance Program with eight sessions of counseling at no cost

Please visit the for more information regarding benefits.

Applications must be submitted online. To be considered for this position, please click the Apply button and follow the instructions. You will be given the opportunity to complete an online application for the position and attach a cover letter and resume.

Additional documents may be attached after application by accessing your "My Job Applications" page and uploading documents in the "My Cover Letters and Attachments" section.

To request an accommodation during the application process, please e-mail employ@umn.edu or call (612) 624-8647.

The University recognizes and values the importance of diversity and inclusion in enriching the employment experience of its employees and in supporting the academic mission. The University is committed to attracting and retaining employees with varying identities and backgrounds.

The University of Minnesota provides equal access to and opportunity in its programs, facilities, and employment without regard to race, color, creed, religion, national origin, gender, age, marital status, disability, public assistance status, veteran status, sexual orientation, gender identity, or gender expression. To learn more about diversity at the U:

Any offer of employment is contingent upon the successful completion of a background check. Our presumption is that prospective employees are eligible to work here. Criminal convictions do not automatically disqualify finalists from employment.

The University of Minnesota, Twin Cities (UMTC)

The University of Minnesota, Twin Cities (UMTC), is among the largest public research universities in the country, offering undergraduate, graduate, and professional students a multitude of opportunities for study and research. Located at the heart of one of the nation's most vibrant, diverse metropolitan communities, students on the campuses in Minneapolis and St. Paul benefit from extensive partnerships with world-renowned health centers, international corporations, government agencies, and arts, nonprofit, and public service organizations.

At the University of Minnesota, we are proud to be recognized by the Star Tribune as a Top Workplace for 2021, as well as by Forbes as Best Employers for Women and one of America's Best Employers (2015, 2018, 2019, 2023), Best Employer for Diversity (2019, 2020), Best Employer for New Grads (2018, 2019), and Best Employer by State (2019, 2022).