Data Engineer (IT Consulting)

About the job Data Engineer (IT Consulting)

On behalf of our client, an IT Consulting company that is looking to hire a Data Engineer position with details below.

Responsibilities

1. Design, develop, and maintain robust ETL processes for data transformation, quality, and reliability.
2. Build and manage data platforms based on server clusters such as Hadoop, Spark, and Kafka.
3. Utilize major cloud service providers (AWS, GCP, Azure) for data platform management.
4. Deliver high-quality, well-tested, reusable, and secure code in compliance.
5. Collaborate with cross-functional teams to understand data requirements and translate them into technical specifications.
6. Ensure data integrity and availability for various applications and stakeholders.
7. Monitor and troubleshoot data pipelines to ensure seamless data flow.
8. Continuously improve data engineering processes and practices.

Qualifications

1. Bachelor's degree in Computer Science, Information Technology, or a related major.
2. Minimum of 2 years of experience as a Data Engineer.
3. Proficiency in development languages such as Python, SQL, or other relevant languages.
4. Extensive experience in building and managing ETL processes.
5. Familiar with ETL tools such as SSIS, Pentaho, or Talend.
6. Experience in data visualization such as PowerBI, Looker Studio, or BigQuery.
7. Strong expertise in building data platforms based on server clusters (Hadoop, Spark, Kafka).
8. Familiarity with major cloud service providers (AWS, GCP, Azure).
9. Ability to deliver high-quality, well-tested, reusable, and secure code.
10. Strong technical expertise with various data sources and data types.