Data Engineer Team Lead (Malaysia)

Hi All,

We are hiring for the role of Data Engineer Team Lead with one of our direct clients in Cyberjaya, MY.

As the Data Engineer Team Lead, you will oversee the design, development, and optimization of data pipelines, ensuring seamless integration and data availability across systems. You will lead a team of data engineers, driving the execution of data strategies to support critical business decisions and operations. A key responsibility will be helping to create a unified data pipeline that serves both internal systems and external applications, ensuring data flows smoothly, securely, and in real time across all systems.

Responsibilities

1. Lead a team of data engineers to design, build, and optimize scalable data pipelines for analytics, reporting, and operational use.
2. Create and manage a unified data pipeline that integrates data from various sources, ensuring that it can be accessed efficiently by both internal and external systems, such as third-party tools or client-facing platforms.
3. Leverage low-code/no-code tools such as Fivetran, RudderStack, or similar platforms to accelerate data integrations and improve the efficiency of data workflows.
4. Collaborate with cross-functional teams to identify data needs and ensure proper data flows between systems, enabling smooth integration and high availability.
5. Manage the implementation of data governance and quality standards, ensuring data consistency and reliability across the organization.
6. Architect and oversee real-time and batch data pipelines using data streaming tools like Kafka, Pub/Sub, or equivalent, ensuring low-latency and high-performance data processing.
7. Provide technical guidance to your team, helping them troubleshoot complex data issues, optimize cost and performance, and follow best practices.
8. Stay updated on the latest data engineering technologies and best practices, especially in the areas of real-time data processing and low-code/no-code integrations, to ensure continuous improvement of the data infrastructure.
9. Coordinate with stakeholders to ensure timely delivery of data solutions that meet business needs.

What You Have

1. Bachelor's degree in computer science, data engineering, or a related field.
2. 8+ years of experience in data engineering, with at least 2 years in a leadership role.
3. Expertise in designing, building, and maintaining data pipelines and data warehouse solutions.
4. Strong knowledge of cloud platforms such as Google Cloud or AWS, and tools like BigQuery, PostgreSQL, and Airflow.
5. Proficiency in programming languages such as Python or similar, with experience in ETL/ELT processes.
6. Hands-on experience with low-code/no-code data integration tools like Fivetran, RudderStack, or similar platforms.
7. Deep understanding of real-time data streaming and data processing tools such as Kafka, Pub/Sub, or similar.
8. Experience in building unified data pipelines that serve both internal and external systems, ensuring consistent, secure data flows.
9. Experience working with both real-time and batch data processing systems.
10. Strong understanding of data governance, security, and compliance practices.
11. Excellent communication skills, with the ability to convey technical concepts to non-technical stakeholders and mentor junior team members.

What’s Good To Have

1. Experience with fintech, trading, or other data-heavy industries.
2. Knowledge of API-based integrations and working with third-party systems.
3. Knowledge of additional data streaming technologies and best practices.
4. Experience with automating data flows using low-code platforms.