Senior Data Engineer

Job Description :

• Build data pipeline for MEA and Asia Data Platform (Matilion, Snowflake, AWS)
• Optimize data pipeline performance for MEA and Asia Data Platform
• Provide data pipeline monitoring for troubleshooting data pipeline issue
• Provide data warehouse data model using star scheme
• Create data warehouse tables in Snowflake
• Create data mart tables in Snowflake
• Create query in Snowflake
• Optimize query performance in Snowflake
• Create data validation
• Create data profiling
• Create data catalog
• Creating Jenkins job to deploy code to AWS DEEP
• Create Power BI Report
• Migration of local DWS to Spoke account

Requirements :

• Bachelor's Degree in Computer Science or any related field
• More than 5 years of experience as a Data Engineer
• Proficiency in AWS services such as Glue, Lambda, S3, Redshift
• Strong Programming skill in Python
• Experience in ETL/ELT processes and data integration techniques
• Familiarity with SQL databases
• Experience with data orchestration and workflow management tools such as Matilion and Airflow