Job Summary:
We are seeking an experienced Cloud Data Engineer to join our team, responsible for designing, building, and maintaining our cloud-based data infrastructure on AWS, Azure, or Google Cloud. The ideal candidate will have a strong background in data engineering, with expertise in cloud-based data platforms, data warehousing, and data governance.
Key Responsibilities:
1. Design, build, and maintain cloud-based data infrastructure on AWS, Azure, or Google Cloud.
2. Develop and maintain data pipelines using cloud-based data integration tools like AWS Glue, Azure Data Factory, or Google Cloud Dataflow.
3. Implement and manage data warehousing solutions using cloud-based data warehousing platforms like Amazon Redshift, Azure Synapse Analytics, or Google BigQuery.
4. Ensure data governance and quality, including data validation, data cleansing, and data normalization.
5. Collaborate with data analysts and data scientists to ensure smooth integration and deployment of data models and algorithms.
6. Develop and maintain documentation of data architecture, configurations, and procedures.
7. Participate in on-call rotations and provide 24/7 support for data infrastructure.
8. Stay up-to-date with industry trends and emerging technologies, applying knowledge to drive data innovation.
Desired Skills:
1. Experience with cloud-based data platforms like AWS, Azure, or Google Cloud.
2. Knowledge of data integration tools like AWS Glue, Azure Data Factory, or Google Cloud Dataflow.
3. Experience with data warehousing platforms like Amazon Redshift, Azure Synapse Analytics, or Google BigQuery.
4. Strong understanding of data governance and quality, including data validation, data cleansing, and data normalization.
5. Excellent communication and collaboration skills, with ability to work with cross-functional teams.
6. Experience with Agile development methodologies and version control systems like Git.
7. Knowledge of data security and compliance, including data encryption, access controls, and auditing.
Experience:
1. At least 5 years of experience in data engineering.
2. At least 2 years of experience in cloud-based data platforms and data integration tools.
3. Experience working in Agile development environments.