Senior Data Engineer

• Develop and maintain data architecture including processes for data transformation, structures, metadata dependencies, and workload management.
• Design and implement data integrations, a data quality framework, and enhancements/new features for data warehousing, reporting, visualization, and master data management.
• Design and implement data architecture to support analytics use cases and drive internal process improvements through automation, optimization, and infrastructure redesign.
• Develop, test, and document data solutions, proactively suggesting improvements and staying current with relevant technologies.
• Analyze stakeholder requirements to implement data system enhancements and ensure solutions align with those requirements.
• Serve as a subject matter expert, leading the team in developing and maintaining CI/CD processes for data pipelines.
• Assemble and process complex datasets, including ETL jobs for continuous data flows, ensuring data consistency and managing unit test scope.
• Develop and maintain automated monitoring solutions, implement reporting and analytics infrastructure, and ensure data quality governance and security.
• Champion data system improvements, manage data set permissions, and research/recommend advancements in data warehousing, reporting, visualization, and master data.

Qualifications:

• BSc degree in Computer Science, Information Systems, Engineering, or related technical field, or equivalent work experience.
• 7 years related work experience.
• 4 years experience in Python.
• 4 years experience building and optimizing big data pipelines, architectures, and data sets.
• Experience in leading projects, i.e., migrations.
• Experience in leading data teams is highly desirable.
• Proficiency in managing the data life cycle.
• Proficiency in manipulating, processing, and architecting large disconnected data sets for analytical requirements.
• Ability to maintain and optimize processes supporting data transformation, data structures, metadata dependency, and workload management.
• Good understanding of data management principles, data quality assurance, and governance.
• Strong analytical skills related to working with unstructured datasets.
• Experience in message queuing, stream processing, and highly scalable big data data stores.
• Strong attention to detail.
• Good communication and interpersonal skills.

Additional Information:

Why work for us:

• We are fully remote! Work from anywhere in the world within a 3 hour SAST timezone.
• We have coworking spaces in Cape Town, Mauritius, Kenya, & Nigeria.
• A cutting-edge development stack is waiting for your code contribution.
• You will be working with over 80 highly skilled technical minds (and expanding).
• Backing of the international media powerhouse Ringier AG which allows us to access world-class development resources, shared knowledge, and a wealth of international business insights.
• Our teams work with a wide range of tech stacks.
• We are committed to the future growth prospects of our employees by allowing autonomy, flexibility, and an opportunity to master your respective skill.

Remote Work: Employment Type:

Key Skills: Apache Hive, S3, Hadoop, Redshift, Spark, AWS, Apache Pig, NoSQL, Big Data, Data Warehouse, Kafka, Scala