Senior Data Engineer

Talent Insider is an upcoming HR Consultancy Service, founded in 2021. Our clients have been some of the leading brands in Indonesia, and this service continues to expand.

Registered in Singapore & Indonesia, we can assist with your growth plans and strategies, and continue to expand our regional presence with strong regional partners to assist our client in recruitment and branding strategy.

Job Description:

1. Connect Diverse Data Sources: This involves building bridges between various data sources, regardless of their format or location.
2. Ensure Data Consistency and Quality: Make sure data is accurate, complete, and consistent across all platforms and tools.
3. Optimize Data Pipelines for Reporting: Design and maintain data pipelines that deliver high-quality data for timely and accurate reporting.
4. Partner with Engineering and Business Teams: Work closely with other departments to build data solutions that meet their specific needs and requirements.
5. Develop Scalable and Optimized Data Solutions: Design data infrastructure that can grow and adapt to the changing needs of the business.

Job Requirements:

1. Over 1-4 years of experience with building data pipelines or data ingestion for both batch/streaming data from different sources to data warehouse/data lake.
2. Hands-on experience/knowledge with SQL/Python/Java/Scala programming; understanding of SQL is a must.
3. Experience with any cloud computing platforms like AWS (S3, Lambda functions, RedShift, Athena), GCP (GCS, Dataflow, Dataproc, Pub/Sub, BigQuery), Azure (Blob/Azure, Synapse), etc.
4. Experience/knowledge with Big Data tools (Hadoop, Hive, Spark, Presto).
5. Data pipelines & orchestration tools (Ozzie, Airflow, Nifi).