Senior Data Engineer

Senior Data Engineer (5+ Years' Experience)

Location: Midlands
Employment Type: Full-Time
Reports to: Data, Analytics, and Development Team Lead

We are seeking an experienced data engineer with strong experience across the MS Azure stack and SQL. If you have 5 years' experience and are an excellent written and spoken communicator, please get in touch.

(Please note you must have lived in the UK for 5 years to be fully security checked).

Technical Requirements Summary:

• Database Architecture: Strong understanding of database architecture and management, including staging, warehousing, and lakehouse environments.
• Programming & Query Languages: Proficiency in T-SQL, Oracle SQL, SparkSQL, DAX, M Language, and Python.
• Data Pipeline Development: Extensive experience in designing and implementing ETL pipelines.
• Microsoft Stack: Expertise with Azure data services (e.g., Azure Synapse, Azure Data Warehouse, Azure Data Factory) and on-prem SQL Server solutions. Ideally experience with MS Fabric
• API Integration: Proficient in establishing data feeds from various internal and external sources using APIs and other transfer mechanisms.

About the Role:

We are seeking an experienced and dynamic Senior Data Engineer to join our Data, Analytics, and Development team within the IT function. This role is integral to our mission of driving the effective and efficient use of data across the organization. As part of the central "hub" within our hub-and-spoke model, you will play a crucial role in managing the entire data lifecycle-from connecting to data sources, through the ETL process, to managing data warehouses and analytics.

You will be at the forefront of establishing and promoting best practices, ensuring data quality, integrity, and security, and providing guidance to a broader network of data practitioners. This is an opportunity to contribute to critical projects that maximize the value of data, influence our ways of working, and support the growth of data capabilities across the business.

Key Responsibilities:

• Data Connection: Design and implement efficient data pipelines, establishing data feeds from various internal and external sources using APIs and other mechanisms.
• Storage and Management: Architect and manage database environments for staging and storing data, ensuring adherence to best practices for data quality and security.
• Data Transformation: Develop and maintain ETL pipelines to transform raw data into formats suitable for reporting and analytics.
• Analytics: Apply algorithms, models, and advanced analytics techniques to enhance data value, including predictive, text, and image analytics.
• Best Practice Advocacy: Champion and enforce data standards and best practices across the central team and broader business network.
• Continuous Improvement: Contribute to team ways of working, offering ideas and constructive challenges to improve processes and explore new opportunities.

What We're Looking For:

• Technical Proficiency: Deep knowledge of database architecture and management, with strong experience in the Microsoft stack, including Azure and on-prem SQL Server solutions.
• Analytical Skills: Ability to design and implement complex ETL pipelines, with experience in various query languages and scripting.
• Communication: Excellent interpersonal and communication skills, capable of simplifying technical concepts for non-technical stakeholders.
• Organizational Skills: Ability to manage workload independently, lead projects, and ensure timely delivery.
• Team Collaboration: A team player who aligns with our core values of Excellence, Passion, Integrity, and Collaboration.

Nice to Have:

• Experience with Oracle databases and Oracle SQL.
• Familiarity with Microsoft Fabric and Git for version control.
• Experience with Agile methodologies, including Kanban or Sprint approaches.

Why Join Us?

Join a forward-thinking organization where your expertise will directly impact business outcomes. We offer a collaborative environment where innovation is encouraged, and your contributions will be recognized and valued.