Big Data Engineer

Job Purpose

In Great Eastern, the Data Business Partner team enables data practitioners with Data and Analytics platforms as Business owners of the platforms. We build data platforms to realize the full value of our data. We seek an experienced Big Data Engineer to join our growing data engineering and analytics team. The right candidate will have strong knowledge of Big Data Engineering and proven ability to strategize the implementation of data and analytics capabilities on a data platform (on premise and cloud) — from conception through release and production. The ideal candidate will be a strong data engineer; be willing to wrangle data, optimize data systems and products, and build them from the ground up. Experience with the insurance industry or Cloud technology (AWS / Google) would be an advantage.

The Job

The Big Data Engineer will work across IT, Data Management and Governance, Visual Analytics, Data Scientists, and key Business users to deliver business analytics contextual datasets and data products that enable data-driven businesses.

• Architect end-to-end solution for business analytics product (dashboards or statistical model) from acquiring data, contextualizing data for business analytics, and integrating the product with business processes.
• Adopt the best data engineering practices to design and build reliable data marts in the Hadoop ecosystem for planning, reporting, and analytics.
• Work closely with business stakeholders, data scientists, and data analysts to communicate data requirements, collect data, and validate the quality of data products.
• Collaborate with business stakeholders, data scientists, and data analysts to align logics of key metrics, and to ensure code logics correctly reflect the latest business definitions.
• Maintain and optimize data pipelines to ensure all data are up to date with data accuracy and integrity.
• Business process owner for onboarding business users and data products onto the data platform and the data pipelines that feed into dashboards or statistical models.
• Work across various stakeholders to ensure smooth production deployment of data pipelines and adherence to data governance policies.
• Proactively identify and suggest solutions to improve the data engineering process.

Our Requirements

• Desired Experience
  • Bachelor’s Degree in Computer Engineering, Computer Science, Mathematics, Software Engineering, equivalent fields, or proven experience in data engineering.
  • Stakeholder Management – Conversant in Business terms and ability to resolve and explain data analytics issues with Business users and other concerned stakeholders.
  • 3 - 5 years of experience in Business Intelligence / Data Analytics field. An analytics practitioner with proven experience in delivering data-driven business solutions and data-driven process augmentation.
  • The candidate must have demonstrated experience working with varied forms of data infrastructure inclusive of relational databases such as SQL, Hive, Impala, Cloudera, Hadoop, Spark.
  • Hands-on experience with large volumes of data using SQL, Spark, Hadoop, or other big data ecosystems is preferred.
  • Process-oriented, and able to translate complex problems into logical and repeatable processes and diligently document the proposed technical solution.
  • Prior experience in creating and managing data models, ETL, and data platform migration is preferred.
  • Understanding of banking, insurance, and financial services is preferred.

• Technical Skillset
  • 3 - 5 years of working experience in SQL / Hive QL / Impala.
  • 3 - 5 years of programming experience in preferred languages Python / R / Java.
  • 3 - 5 years of experience in data engineering work on Big Data Technology (Hortonworks / Cloudera).
• Team Player
  • Able to work with specialists in different disciplines to formulate data solutions.
  • Able to work under pressure with or without supervision.
  • Able to work collaboratively as part of a team.

About Great Eastern

Established in 1908, Great Eastern places customers at the heart of everything we do. Our legacy extends beyond our products and services to our culture, which is defined by our core values and how we work. As champions of Integrity, Initiative, and Involvement, our core values act as a compass, guiding and inspiring us to embrace the behaviours associated with each value, upholding our promise to our customers - to continue doing our best for them in a sustainable manner.

We work collaboratively with our stakeholders to look for candidates who exhibit or have the potential to embrace our core values and associated behaviours, as these are the key traits that we expect from our employees as they develop their careers with us.

We embrace inclusivity, giving all employees an equal opportunity to shine and play their role in exploring possibilities to deliver innovative insurance solutions.

Since 2018, Great Eastern has been a signatory to the United Nations (UN) Principles of Sustainable Insurance. Our sustainability approach around environmental, social, and governance (ESG) considerations plays a key role in every business decision we make. We are committed to being a sustainability-driven company to achieve a low-carbon economy by managing the environmental footprint of our operations and incorporating ESG considerations in our investment portfolios; improving people’s lives by actively helping customers live healthier, better, and longer; and driving responsible business practices through material ESG risk management.

To all recruitment agencies: Great Eastern does not accept unsolicited agency resumes. Please do not forward resumes to our email or our employees. We will not be responsible for any fees related to unsolicited resumes.