Data Engineer

We are looking for Data Engineers who can join our team to architect and build data platforms to power insight-led business solutions. We are currently working on AWS and Microsoft Azure cloud platforms, using SQL, Python, Java, .NET and other technologies.

Are you inspired to engineer enterprise-grade, scalable data platforms that solve challenging business problems? Do you want to continuously learn and grow, by working with the most talented people in South Africa? Then you will love it here!

Note: We give full consideration to every applicant’s fit to this role, so if you decide to apply and you do not hear from BSG within a maximum of a four-week period, please consider your application unsuccessful at this time.

Main Purpose of the Role:

Data Engineers work in multi-skilled teams to architect, design and build data platforms and data products. These provide insights for better decision-making and smarter business processes.

Minimum Qualifications:

• Honours or Masters’ Degree in Computer Science, Information Systems, Engineering, Physics, Mathematics, Statistics or related field
• 4 years’ experience in enterprise software development, including proficiency in SQL and Python / Java / .NET
• Awareness of Data Engineering paradigms such as data warehousing, data mesh or data vault

Experience:

• 4-8 years’ experience working in teams to build enterprise-grade software solutions
• Experience with big data tools, such as found in the Hadoop ecosystem, is advantageous
• Experience with AWS or MS Azure cloud data services is preferable

Job Objectives:

• Be an ambassador for BSG’s insight-led business solutions
• Attract talent to BSG’s Data and Analytics capability, and coach emerging Data Engineers
• Support relationship sales through expertise, analysis of our clients’ problems / opportunities and use cases, and high-level design of solution options
• Work with others to define the business problem and identify which data-driven insights and data sources will help to solve that problem
• Work with Data Scientists to identify relevant data from internal / external sources, join / transform the data and explore it for insight
• Work together with Data Scientists to build data pipelines and architect, train, validate and test advanced analytics / machine learning models, using enterprise-grade software engineering practices
• Communicate to business and technical stakeholders how and why the insights and / or models work
• Deploy models into production, on cloud (or sometimes on-premise) AI / ML / data platforms

Skills and Attributes:

• Relate to people and build productive working relationships
• Understand client business problems and identify data-driven solutions
• A clear understanding of the data engineering and data science lifecycle and its constituent parts: data exploration, data preparation, data wrangling and feature engineering, tools, analytical methods, model evaluation, deployment, and performance monitoring
• Estimate the effort, skills and dependencies to deliver data-driven solutions
• Select appropriate technologies and tools, and learn new ones
• Architect and build data pipelines, including data aggregation and transformation
• Deploy pipelines in production
• Communicate clearly to business and technical stakeholders