Evaluation Analyst

Press continue to see content specific to your location.

Hong Kong

Evaluation Analyst

British Columbia

CAD 80,000 - 100,000

Staff - Non Union

Job Category: M&P - AAPS Job Profile: AAPS Salaried - Institutional Analysis, Level A Job Title: Evaluation Analyst Department: Evaluation Support | Evaluation Studies | Faculty of Medicine Compensation Range: $5,791.00 - $8,323.42 CAD Monthly

Posting End Date: March 6, 2025

Note: Applications will be accepted until 11:59 PM on the Posting End Date.

At UBC, we believe that attracting and sustaining a diverse workforce is key to the successful pursuit of excellence in research, innovation, and learning for all faculty, staff and students. Our commitment to employment equity helps achieve inclusion and fairness, brings rich diversity to UBC as a workplace, and creates the necessary conditions for a rewarding career.

Job Summary:

The Evaluation Analyst will work closely with the Evaluation Specialists and Associates and the Data Intelligence and Reporting Analyst to support large scale evaluations of programs and initiatives within the Education Portfolio of the Faculty of Medicine. They will provide the necessary data and reports to support decision-makers. They will conduct ad-hoc evaluation and research as needed. They will develop data collection instruments, conduct data collection and analyses of quantitative and qualitative data. The position will also design and implement automated reporting of data analysis using R coding and prepare succinct, informative reports for decision-makers.

Organizational Status:

The Evaluation Studies Unit (ESU) was established in 2004 to provide program evaluation and strategic reporting services to support planning and decision-making within the UBC Faculty of Medicine (FoM). ESU provides comprehensive, rigorous and objective data to assist stakeholders in the on-going development and improvement of programs. The Unit is organizationally placed within the Education Portfolio of the FoM, and is mandated to evaluate the effectiveness, quality, comparability, and impact of educational programs, provide supporting data for accreditation, and meet organizational and government reporting needs.

The Evaluation Analyst will report to the Evaluation Manager. They will collaborate with the Data Intelligence and Reporting Analyst, Evaluation Specialists, and Evaluation Associates on key tasks and deliverables that support their projects. They will also interact with faculty and staff from the FoM and attend and participate in committees, working groups and planning meetings as assigned.

Work Performed:

1. Work with complex datasets to analyze, summarize and report key findings.
2. Conduct qualitative (e.g. thematic) and quantitative (e.g. descriptive, inferential) data analyses, using NVIVO, SPSS, and R.
3. Develop data visualizations using knowledge of graphic design principles and provide expert advice to staff in the appropriate selection and application of techniques using PowerBI and/or Tableau.
4. Interpret results and create data visualisations for evaluation reports and summaries for use by leadership and decision-makers.
5. Design and generate optimal solutions for automated reporting of data using R.
6. Research, identify, and analyze appropriate data sources, determining data limitations that apply.
7. Design survey instruments and process, screen, check, code and analyse the resultant data.
8. Develop, deploy and monitor response rates to data collection instruments.
9. Research, develop and make recommendations for new and improved processes and procedures for data collection and analysis.
10. Prepare presentations and key findings briefings for decision-makers.
11. Plan and coordinate tasks to ensure efficient administration, organization and integration of data collection and analyses across the unit.
12. Respond to student, staff and faculty inquiries related to assigned work.
13. Contribute to the development and improvement of unit processes to increase their efficiency and effectiveness.
14. Work with team members to address workload and resourcing issues to manage timelines and expectations.
15. Perform other duties as required to ensure the successful completion of assigned work.

Consequence of Error/Judgment:

This position should be able to work independently for the most part, having been assigned tasks by the Evaluation Manager that have been agreed with the Evaluation Specialists and Associates and the Data Intelligence and Reporting Analyst. They are accountable for the accuracy and timely delivery of their work. This individual would be expected to obtain the necessary data and create the analyses without supervision. Data and analyses produced by them will be reviewed by the senior team members they are supporting. Mistakes discovered at this stage could result in lost time, and perhaps the wholesale revision of the analysis. Errors can have significant negative impacts on the achievement of the strategic goals and commitments of the Education Portfolio within the Faculty of Medicine.

Supervision Received:

The Evaluation Analyst reports to the Evaluation Manager. They collaborate with the evaluation lead for assigned projects to agree deliverables, timelines and provide regular status updates to team members.

Supervision Given:

No supervision given.

Minimum Qualifications:
Undergraduate degree in a relevant discipline. Minimum of two years of related experience, or the equivalent combination of education and experience.

- Willingness to respect diverse perspectives, including perspectives in conflict with one’s own.

- Demonstrates a commitment to enhancing one’s own awareness, knowledge, and skills related to equity, diversity, and inclusion.

Preferred Qualifications:

• Education in data science, statistical analysis, analytics, evaluation, education, health or social sciences or graduation from a technical college or institute.
• Demonstrated experience in data gathering and the analysis and interpretation of qualitative and quantitative data is essential.
• Computer experience and a high degree of competency with Microsoft Office (especially Excel) and data analysis software (e.g. SPSS, NVivo, R) is also required.
• High degree of competency in R programming and experience of practical application of R in a professional environment preferred.
• Professional experience in program evaluation is an asset but not a requirement.
• Ability to be thorough, accurate, and have a high level of attention to detail.
• Highly skilled in distilling large amounts of information quickly and accurately into a succinct report for stakeholders.
• Excellent, proven interpersonal and intercultural, oral and written communication skills and organizational planning abilities.
• Ability to effectively project manage the collection and analysis of multiple and simultaneous data streams.
• Experience working with multiple stakeholders in a complex environment.
• Ability to compose correspondence, reports, presentations, and other written materials using clear concise business English.
• Ability to prioritize and work effectively under pressure to meet deadlines.
• Ability to exercise sound judgment and make recommendations to resolve issues.
• Ability to identify and resolve problems and issues.
• Ability to develop and maintain cooperative and productive working relationships.
• Ability to work independently and demonstrate initiative.
• Ability to work in a fast-paced team environment.
• Demonstrated ability to build, manage and maintain high-quality and productive relationships across cultural differences.
• Demonstrated ability to actively create and sustain respectful and inclusive environments.
• Demonstrated ability to work collaboratively and interact with empathy, understanding, and humility with people from diverse backgrounds and with diverse identities, perspectives, and behaviors.
• Commitment to upholding the Faculty of Medicine’s values of respect, integrity, compassion, collaboration, and equity.