Lead Data Engineer

We are looking for a Lead Data Engineer at Flip. You will be responsible for designing, building, and managing data infrastructure and pipelines to support business intelligence, analytics, and possibly machine learning applications. In this role, you will also be expected to collaborate with Data Analysts to improve and enrich the existing state of data to meet current as well as possible future use cases.

Key Responsibilities

1. Design and implement scalable, reliable, and high-performance data architectures.
2. Define data engineering best practices and strategies for data processing, storage, and retrieval.
3. Ensure data architecture aligns with business needs and long-term company goals.
4. Develop, test, and maintain ETL (Extract, Transform, Load) and ELT pipelines.
5. Optimize data processing workflows for performance and cost-efficiency.
6. Automate data ingestion from various sources (APIs, databases, streaming data, etc.).
7. Lead and mentor a team of data engineers, ensuring best practices in coding and design.
8. Collaborate with Data Analytics team and other data-driven departments (Fraud, Risk, etc.).
9. Ensure data security, privacy, and compliance with regulations.
10. Implement data lake and data warehouse solutions.

Requirements:

1. 5+ years of experience in data engineering.
2. Strong SQL skills and experience with data visualization tools (e.g., Redash, Looker, Power BI, Tableau).
3. Proficiency in Python for data pipelining.
4. Strong knowledge of GCP stacks (BigQuery, Datastream, Dataflow, Pub/Sub, etc).
5. Strong knowledge of OLAP databases (BigQuery, Cassandra, duckDB).
6. Experience with ETL/ELT tools like Apache Airflow and DBT.
7. Able to design and implement Data Warehouse based on Google BigQuery.
8. Effective communication skills for cross-team collaboration.
9. Strong leadership and team management experience.
10. Able to ingest new data structures into existing Data Warehouse.

Nice to Have

1. Knowledge of open source stacks (Debezium, Kafka, duckDB).
2. Experience in various ETL Tools (Pentaho, n8n, SSIS).
3. Experience in Cube Data Warehouse Modelling.
4. Knowledge in Google Cloud Platform stack costs and alternatives.