Data Engineer (Python & SQL) (CPT Hybrid)

ENVIRONMENT: BE responsible for the Investment team database architecture, data flow and data processes as the next Data Engineer sought by a fast-paced Investment Firm based in Tokai. This will include efficiently receiving, transferring, processing, analysing, and integrating 3rd party systems for investment research and business operational processes. You will require a Postgrad Degree in Computer Science/IS/Maths/Stats or similar field, have strong Python and SQL with at least 3 years’ work experience in a similar role including solid experience managing and analysing large amounts of data. You must also have experience with version control and database solutions including Git & Linux. The person will need to enjoy and follow a collaborative team approach.

DUTIES:

1. Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
2. Implement data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.
3. Collaborate with Quantitative and Analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
4. Ensure data quality and consistency by implementing data validation, cleaning, and transformation procedures.
5. Monitor and maintain the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
6. Troubleshoot and resolve data-related issues and performance bottlenecks in collaboration with the Investment teams.
7. Evaluate and integrate new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
8. Document data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system.
9. Keep up-to-date with industry trends, best practices, and emerging technologies in the field of Data Engineering.

General –

1. Assist and collaborate on team wide projects.
2. Contribute to the analytics platform to know what is required from a Data Engineering perspective.
3. Assist and investigate ad-hoc data related queries.

REQUIREMENTS:

1. University Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).

1. Up to 3 years’ experience with a specific focus in database management, data analysis and have produced ETL processes at scale are essential.
2. Strong programming skills in Python and SQL.
3. Basic understanding of financial instruments and markets.
4. Linux server administration.
5. Git version control.

ATTRIBUTES:

1. Outstanding organization skills.
2. Excellent interpersonal skills, excellent communication skills oral and written.
3. Aptitude in decision-making and problem-solving.
4. Strong work ethic, self-motivated, driven and results oriented.
5. Ability to listen and respond to new ideas, input and diverse perspectives.
6. High levels of self-confidence, assertive as well as healthy levels of EQ.
7. Energetic problem-solver.
8. Structured work style, attention to detail and accuracy is of the utmost importance.