Data Modeler

1. Job Summary – highlight project details/what is exciting about the role:

Seeking a highly skilled Senior Engineer with extensive experience in data engineering to join our team. The ideal candidate will have a strong foundation in Databricks, PySpark, Azure Data Factory (ADF), and query optimization techniques, with a particular focus on building metadata-driven ETL pipelines. This role will be instrumental in designing, developing, and maintaining robust data pipelines that can adapt to evolving data landscapes.

2. Key Responsibilities – list what the person will be doing on a day to day basis:

1. Design, develop, and maintain scalable, metadata-driven ETL pipelines using Databricks, PySpark, and ADF.
2. Create and manage data catalogs and metadata repositories.
3. Implement automated data lineage and impact analysis to ensure data quality and traceability.
4. Optimize query performance and data processing efficiency to meet stringent SLAs.
5. Collaborate with data analysts and scientists to understand data requirements and translate them into technical solutions.
6. Troubleshoot and resolve data-related issues promptly.
7. Mentor and guide junior team members in data engineering best practices.

3. Job Requirements
As per the 2006 Age Discrimination Act please do not specify number of years experience. Use words like Extensive, Strong, Good, Fair.

Essential Skills:
Azure Databricks, PySpark, ETL

Nice to Have Skills:
ADF, Data Modelling