Data Engineer (SC Cleared)

Scrumconnect Limited; London; On-site; GBP 45,000 - 75,000

Job description

London, United Kingdom | Posted on 12/03/2025

Develop and maintain data products and a Strategic Data Platform. Data Engineering teams are responsible for the delivery and operational stability of the data products built and provide ongoing support for those products. Data Engineers work within, and contribute to, the overall data development lifecycle process as part of multi-functional Agile delivery teams focused on one or more products. Data Engineers should have the following essential skills:

Typical Data Engineering Experience required (3+ yrs):

1. Strong knowledge and experience:
   Azure Data Factory and Synapse data solution provision
2. Power BI
3. Python
4. PySpark
   (Preference will be given to those who hold relevant certifications)
5. Proficient in SQL.
6. Knowledge of Terraform
7. Ability to develop and deliver complex visualisation, reporting and dashboard
   solutions using tools like Power BI.
8. Experience of data modelling and transforming raw data into datasets and
   extracts.
9. Experience of working in a large project /scale complex organisation and
   knowledge of migrating legacy capabilities.
10. Experience in Agile.
11. Ability to perform data profiling and quality measurements, ensure data
    quality/accuracy, knowledge of structured and unstructured data concepts,
    developing automated data ingest routines, workflows/mappings and data
    exploitation patterns and data analysis.
12. Ability to analyse and collect information and evidence, identify problems and
    opportunities, and ensure recommendations fit with strategic business
    objectives.
13. Experience of building team capability through role modelling, mentoring, and
    coaching.
14. Ability to manage relationships with non-technical colleagues and can work in
    collaborative environments.