Data Engineer (SC Cleared)

Scrumconnect Limited; London; On-site; GBP 50,000 - 90,000

Job description

London, United Kingdom | Posted on 12/03/2025

Develop and maintain data products and a Strategic Data Platform. Data Engineering teams are responsible for the delivery and operational stability of the data products built and provide ongoing support for those products. Data Engineers work within, and contribute to, the overall data development lifecycle process as part of multi-functional Agile delivery teams focused on one or more products. Data Engineers should have the following essential skills:

Typical Data Engineering Experience required (3+ yrs):

1. Strong knowledge and experience:
   Azure Data Factory and Synapse data solution provision
2. Power BI
3. Python
4. PySpark
5. (Preference will be given to those who hold relevant certifications)
6. Proficient in SQL.
7. Knowledge of Terraform
8. Ability to develop and deliver complex visualisation, reporting and dashboard solutions using tools like Power BI.
9. Experience of data modelling and transforming raw data into datasets and extracts.
10. Experience of working in a large project/scale complex organisation and knowledge of migrating legacy capabilities.
11. Experience in Agile.
12. Ability to perform data profiling and quality measurements, ensure data quality/accuracy, knowledge of structured and unstructured data concepts, developing automated data ingest routines, workflows/mappings and data exploitation patterns and data analysis.
13. Ability to analyse and collect information and evidence, identify problems and opportunities, and ensure recommendations fit with strategic business objectives.
14. Experience of building team capability through role modelling, mentoring, and coaching.
15. Ability to manage relationships with non-technical colleagues and can work in collaborative environments.