PPO Serve or Professional Provider Organisation Services is a healthcare management company that helps clinicians organize themselves into integrated teams, called Integrated Clinical Consortia. ICC take many forms and will eventually be all over SA. We are supported by the Foundation of Professional Development (FPD).
What we do
We support clinicians in creating, implementing and managing Integrated Clinical Consortia. We do this through a complete support infrastructure including a tailor-made toolkit and Intelligent Care System.
Why are we doing it
Building Integrated Clinical Consortia is the means to stop fragmented care in the South African Healthcare system. These teams look after the care of entire communities transforming the private healthcare system into one that can treat more people at a lower cost.
WHAT WE NEED
We are seeking a highly skilled and experienced Data Engineer to join our dynamic team. The ideal candidate should have a strong background in extracting and transforming data from various sources, including SFTP servers, APIs, and databases. Proficiency in modern data stack technologies, such as Python, BigQuery, dbt (data build tool), SQL, ELT concepts, and DevOps tools, is crucial. The successful candidate should have a minimum of 5 years of hands-on experience in data engineering.
The Data Engineer will play a crucial role in designing, implementing, and maintaining our data architecture, ensuring efficient and accurate data processing for analytics and business intelligence purposes.
WHAT WE NEED YOU TO DO:
- Collaborate with cross-functional teams to understand data requirements and design scalable data architectures.
- Develop and maintain conceptual, logical, and physical data models to support business needs.
- Evaluate and implement new data storage and processing technologies.
- ETL Development:
- Design, develop, and optimise ETL processes to extract, transform, and load data from various sources into data warehouses.
- Ensure data quality and integrity throughout the ETL pipeline.
- Monitor and troubleshoot ETL jobs to identify and resolve issues promptly.
- Database Management:
- Administer and optimise databases to ensure high performance and availability.
- Implement and maintain database security measures and access controls.
- Collaborate with database administrators to fine-tune database configurations.
- Data Integration:
- Integrate data from multiple sources, both internal and external, to provide a unified view for reporting and analysis.
- Implement data pipelines to facilitate real-time and batch data integration.
- Performance Tuning:
- Identify and address performance bottlenecks in data processing and storage.
- Optimise queries and data retrieval processes to enhance overall system performance.
- Documentation:
- Create and maintain comprehensive documentation for data architecture, ETL processes, and database configurations.
- Train and support other team members in understanding and utilizing data systems effectively.
- Collaboration and Communication:
- Work closely with analytics engineers, analysts, and business stakeholders to understand data requirements and deliver solutions.
- Communicate effectively with technical and non-technical team members to convey complex concepts in a clear and concise manner.
Qualifications and experience required
Qualifications:
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- Proven experience as a Data Engineer or in a similar role.
- Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL, SQL Server).
- Experience with big data technologies (e.g., Hadoop, Spark) and NoSQL databases (e.g., MongoDB, Cassandra).
- Proficient in ETL tools and processes.
- Familiarity with cloud-based data solutions (e.g., AWS, Azure, GCP).
- Strong programming skills in languages such as Python, Java, or Scala.
- Knowledge of data modeling and data warehousing concepts.
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration skills.
Preferred Qualifications:
- Honours/Master's degree in a relevant field.
- Certification in data engineering or related areas.
- Experience with streaming data processing.
- Knowledge of machine learning and data science concepts.
- Familiarity with version control systems (e.g., Git).
Seniority level
Not Applicable
Employment type
Full-time
Job function
Information Technology
Industries: Hospitals and Health Care