Learning And Development Coordinator

The role involves the design, development, and maintenance of the architecture that facilitates the efficient collection, storage, and processing of large datasets.

This position collaborates closely with data scientists, analysts, and software engineers to ensure that data is accessible, reliable, and well-structured for analysis and business insights.

Qualifications

1. Bachelor's in computer science, Information Technology, Data Engineering, or any related field.
2. Certified in Data Analytics
3. Advantageous - Cloud Professional Data Engineer, or Microsoft Azure Data Engineer.
4. Experience years of experience in data engineering, database management, or software development.

Duties and Responsibilities

Key Performance Areas

1. Strategic Alignment
2. Execution of the BCT Divisional plans and monitor performance thereof based on SLA.
3. Identify technology strategic opportunities to meet business needs.

Operations, Product and Customers

Data Architecture & Infrastructure Development

1. Design, develop, and maintain data pipelines for processing large-scale datasets.
2. Build and optimize data warehouses, data lakes, and ETL (Extract, Transform, Load) processes.
3. Implement data models and database schemas to improve data efficiency.
4. Ensure data systems are scalable, secure, and cost-effective.

Development and Maintenance of Data Pipelines

1. Data integration, develop ETL / ELT workflows to extract data from a variety of sources, including databases, APIs, and streaming services.
2. Automate the processes of data ingestion, transformation, and storage.
3. Troubleshoot and monitor pipeline performance and data quality issues.

Database & Storage Management

1. Optimise and manage SQL and NoSQL databases, MySQL.
2. Manage cloud-based storage solutions, including MS Azure and AWS.
3. Guarantee the integrity, consistency, and accessibility of data across various platforms.

Data Governance, Compliance and Data Security

1. Ensure privacy and security by implementing data stewardship policies (POPIA).
2. Manage and supervise encryption, authentication, and access controls.
3. Formulate strategies for data retention, recovery, and backup.

Collaborating with Various Teams

1. Collaborate closely with data scientists to guarantee that the data is appropriately organized for machine learning models.
2. Provide data analysts with well-organised and clean datasets for the purpose of reporting and visualization.
3. Collaborate with software engineers to incorporate data solutions into applications.

Automation and Optimization of Performance

1. Enhance data processing speed and efficiency by utilising big data technologies (e.g., Hadoop, Spark, etc).
2. For cloud environments, optimise storage costs and query performance.
3. Employ relevant scripting, SQL, or Python to automate repetitive duties.

Financial

1. Contribute to budget planning where required.

Risk Management

1. Respond to all data related loss notifications impacting business.

Ad Hoc Duties

1. Perform any reasonable tasks as and when required by the Line Manager or Sasria Management.