Data Engineering Lead - Corporate Services

Responsibilities

• Guide and develop a high-performing Data Engineering team, fostering a culture of innovation, efficiency, and collaboration.
• Apply your deep expertise in Azure Data Platform and other Data Engineering tools to refine and expand our data capabilities.
• Lead the end-to-end process of designing, documenting, developing, implementing, and testing innovative prototypes that showcase the value of data.
• Oversee the development and integration of Web Apps, Function Apps, and custom user interfaces, ensuring robust data modelling, quality, governance, and security practices.
• Serve as the primary contact for all Data Engineering inquiries.

Required Skills To Be Successful

• Practical experience in constructing and refining Big Data pipelines, architectures, and datasets, optimizing for efficiency and scalability.
• Strong analytical skills, expertise with DevOps for deploying data pipelines.
• Knowledge of Data Virtualization Tools (Denodo), Auto ML Tools (DataRobot, Dataiku), Marketing Tools (Salesforce, etc.), SAP (BW/BO/ERP).
• Expertise in Azure Data Factory, Databricks, Event Hubs, Python, PySpark, SQL & No-SQL Databases, and other pivotal Big Data solutions, ensuring robust, scalable data infrastructure.

What Equips You For The Role

• Bachelor’s degree in computer science or a related field of study.
• 15+ years of IT experience in implementing complex business/transformation projects across various domains and managing internal and external teams.
• Minimum 8+ years of practical experience building and managing data pipelines with multiple source system integrations.
• Minimum 4+ years of dedicated experience in the design, development, and management of web-based data management portals and tools.
• Minimum 3+ years of experience in building and managing real-time event streaming solutions using Kafka.
• Minimum 2+ years of experience in integrating Recommendation Engine or Segmentations with customer touchpoints/channels.