Lead Data Engineer Snowflake - AirFlow - PySpark

We seek a Lead Data Engineer to join our client; a provider of AI driven workflow systems supported through a market leading Enterprise Application - Advertising Resource Management platform. This is a long term role that can be performed remote and can be either F.T.E “ Full Time Employee” or open to freelancers.

As the successful candidate, you will demonstrate proficiency and professionalism in the following.

Key Responsibilities

• Lead and mentor a team of data engineers while staying hands-on with data pipelines, architecture, and system optimization.
• Design and implement scalable data architecture.
• Build ETL data pipelines using Airflow, SnowFlake, and DBT.
• Define and enforce data partitioning, retention, governance, and security best practices.
• Collaborate with stakeholders to align data practices with business goals and foster a data-driven culture.
• Proactively drive innovation in data engineering practices and system architecture.
• Translate business needs into technical specifications and document data architecture and pipelines.

Required Skills and Experience

• 7+ years in data engineering including 2+ years in a leadership or architecture role.
• Proficiency in Airflow (+3 yrs), SnowFlake (+2 years), and DBT.
• Advanced proficiency in Python (+4 yrs), Spark, SQL, and cloud services (AWS +2 yrs).
• Experience designing and deploying large-scale Data Warehouses.
• Strong data modeling experience.
• Experience working with third-party APIs and external data sources.
• Ability to optimize system performance, ETL workflows, and data storage solutions.
• Strong communicator, capable of bridging technical and non-technical teams.

Preferred Skills

• Familiarity with adtech ecosystems (DSPs, ad servers, etc).
• Exposure to Apache Druid, AWS Glue, PySpark (our current data stack, to be replaced).
• Knowledge of design patterns and best practices for data architectures.
• Experience defining data governance.
• Familiarity with CI / CD tools.
• Excellent English communication skills, both written and verbal.

Education & Language

Bachelors required - Master’s degree in Computer Science, Data Science, or related field preferred.