Engineer-Jobs in Südafrika

Reference : JHB-ZN-1

Our Client in the IT industry is looking for an AWS Data Engineer.

If you meet the below requirements, kindly send us your CV.

1. Above average experience / understanding (in order of importance):
2. Terraform
3. Python 3
4. SQL - Oracle / PostgreSQL
5. Py Spark
6. Boto3
7. ETL
8. Docker
9. Linux / Unix
10. Big Data
11. Powershell / Bash
12. BMW Cloud Data Hub (CDH)
13. BMW CDEC Blueprint
14. Experience in working with Enterprise Collaboration tools such as Confluence, JIRA, etc.
15. Experience developing technical documentation and artifacts.
16. Knowledge of data formats such as Parquet, AVRO, JSON, XML, CSV, etc.
17. Experience working with Data Quality Tools such as Great Expectations.
18. Knowledge of the Agile Working Model.
19. Any additional responsibilities assigned in the Agile Working Model (AWM) Charter.

1. Demonstrate expertise in data modelling Oracle SQL.
2. Exceptional analytical skills analysing large and complex data sets.
3. Perform thorough testing and data validation to ensure the accuracy of data transformations.
4. Strong written and verbal communication skills, with precise documentation.
5. Self-driven team player with ability to work independently and multi-task.
6. Experience building data pipelines using AWS Glue or Data Pipeline, or similar platforms.
7. Familiar with data stores such as AWS S3, and AWS RDS or DynamoDB.
8. Experience and solid understanding of various software design patterns.
9. Experience preparing specifications from which programs will be written, designed, coded, tested, and debugged.
10. Strong organizational skills.
11. Experience developing and working with REST APIs is a bonus.
12. Basic experience in Networking and troubleshooting network issues.
13. Basic experience / understanding of AWS Components (in order of importance):
14. Glue
15. CloudWatch
16. SNS
17. Athena
18. S3
19. Kinesis Streams (Kinesis, Kinesis Firehose)
20. Lambda
21. DynamoDB
22. Step Function
23. Param Store
24. Secrets Manager
25. Code Build / Pipeline
26. CloudFormation
27. Business Intelligence (BI) Experience
28. Technical data modelling and schema design ("not drag and drop")
29. Kafka
30. AWS EMR
31. Redshift

Package & Remuneration: Market Related - Monthly