Senior Data Engineer

Landmarc Support Services Limited; United Kingdom; On-site; GBP 45,000 - 80,000; Full time

Job description

Job Introduction

As the Senior Data Engineer, you will be responsible for designing and delivering scalable and efficient data architectures to meet the organisation's evolving data needs. This role will oversee the development of a semantic data model, ensuring seamless collaboration with Data Analysts as they push their requirements from your team. The Senior Data Engineer will integrate data quality measures into all phases of the data lifecycle, establishing a proactive approach to data integrity and reliability. As the senior technical leader of the data engineering team, you will ensure that the organisation's ETL (Extract, Transform and Load) processes adhere to best practices, while leading the team and ensuring data availability and pipeline orchestration. You will also be an integral participant of the data platform cloud migration, and will be prepared to embark on a journey with the team to upskill and develop rapidly, whilst also keeping our legacy systems up and running.

Main Responsibility

• Develop and maintain semantic data models that meet the analytical requirements of Data Analysts.
• Collaborate closely with Data Analysts to ensure the models are accurate, flexible, and efficient for business reporting.
• Design and implement data quality frameworks to ensure consistency, accuracy, and reliability of data throughout the pipeline.
• Incorporate automated data validation and monitoring tools to detect and resolve data quality issues.
• Lead and mentor the data engineering team, providing technical guidance and career development opportunities.
• Own and optimise ETL workflows, ensuring scalability, performance, and reliability.
• Implement best practices for data ETL processes.
• Oversee the orchestration and automation of all data pipelines, ensuring data is ingested, processed, and delivered in a timely manner.
• Support Architecture and Engineering colleagues in defining integration requirements to enable effective data flow.
• Ensure proper logging, monitoring, and error-handling mechanisms are in place for all data pipelines.
• Continuously monitor and report on key data quality metrics, providing insights to both technical and business stakeholders.
• Proactively identify opportunities to improve data quality and pipeline efficiency.
• Keep up with industry best practices and emerging trends, especially in the areas of cloud technologies, ML, and AI, and incorporate them into data strategies where appropriate.

The Ideal Candidate

• Experience with cloud data platforms such as Azure, AWS, or GCP.
• Familiarity with machine learning and AI concepts, with a basic understanding of how to integrate these technologies into data engineering workflows.
• Able to demonstrate leadership of data engineering.
• Experience in managing or participating in data platform migrations, particularly to the cloud.
• Knowledge of additional data integration tools, such as Apache Airflow or other orchestration tools.
• Experience of integration (via APIs).
• Experience of working within Product Teams and connecting within a wide IT team.
• Experience working in an Agile or DevOps environment, with knowledge of CI/CD pipelines.
• Experience with data governance frameworks and ensuring compliance with data privacy regulations (e.g., GDPR).
• Knowledge of Python or other programming languages commonly used in data engineering.
• Certification in relevant data engineering or cloud platforms (e.g., Azure Data Engineer, AWS Certified Data Analytics, or Databricks certification).
• Experience with GIS data would be advantageous.

Package Description

Landmarc will provide you with a competitive salary; in addition to this, we also offer the following main benefits, amongst many others:

Pension

Landmarc offers all employees an opportunity to join our company stakeholder pension scheme, whereby the company will contribute up to 8% of the employee's salary.

Holiday

Employees are entitled to 25 days' pro rata during each year of employment plus public holidays. Three extra discretionary days added to our annual leave allowances at Christmas. Annual leave allowance will increase in recognition of your continued service. Holiday purchase - purchase up to 10 more days' holiday to use throughout the year.

Other benefits

Edenred - employee savings scheme. Annual salary review, in consultation with the recognised Trade Unions. Life assurance insured for three times your annual salary, to help the loved ones. Reimbursement of professional fees and on-going training. Health Cash Plan - All employees can join. You can also add up to four children under the age of 24 to your policy. Family friendly policy. Sick pay - After 6 months of service.

* Application updates may be sent to you via email, please ensure you check your emails regularly. Please note some emails may arrive in your junk mail folder

About the Company

Landmarc provides the support services that enable Armed Forces from around the world to prepare for frontline military operations across the UK Defence Training Estate (DTE). This includes maintaining and delivering safe and sustainable infrastructure, managing and operating training areas and ranges and delivering multi-million pound projects to improve vital training assets. By joining Landmarc you will be supporting our vision to provide the best training experience we can for our Armed Forces. We are the first and only Special Purpose Vehicle to be contracted by the Ministry of Defence (MOD) as their Industry Partner on the UK Defence Training Estate and the only company that is solely dedicated to the UK DTE, delivering essential support services since 2003.