Senior Data Engineer - Investment Data (ID: 668319) - JYOK

We are looking for a highly skilled Senior Data Engineer with extensive experience in DevOps and data engineering to join our promising client's team. In this role, you will work at the forefront of building and optimizing cutting-edge data management solutions for investment data, including developing and deploying data dashboards from scratch. As a Senior Data Engineer, you'll be responsible for leveraging Microsoft Data Fabric, Azure, and Power BI, among other technologies, to create innovative solutions and ensure the seamless integration of complex data pipelines.

Key Responsibilities:

1. Design & Development: Architect and develop scalable and robust data management solutions tailored for investment data. Build sophisticated data dashboards from the ground up using Power BI and other visualization tools to empower stakeholders with actionable insights.

2. CI/CD Pipeline Management: Lead the design, implementation, and continuous improvement of CI/CD pipelines for data integration, processing, and deployment, ensuring streamlined and efficient workflows.

3. Collaborative Development: Work closely with data engineers, data scientists, and business stakeholders to understand data requirements and ensure seamless flow and integration of data into reporting and analytics systems.

4. Automation & Optimization: Automate data processing pipelines and workflows using Python and other relevant scripting languages. Continuously monitor, analyze, and optimize the performance of data management systems.

5. Data Security & Compliance: Take ownership of ensuring data security, governance, and compliance with industry standards, focusing on protecting sensitive investment data.

6. Troubleshooting & Issue Resolution: Be the go-to expert for diagnosing and resolving issues related to data infrastructure, application performance, and data integration.

Qualifications:

1. Experience: 5+ years of experience in data engineering or a similar role, with a deep understanding of DevOps principles, data pipelines, and data infrastructure management, especially in the context of investment data.

2. Expertise in Python: Strong proficiency in Python for automating data processing and workflow management, with a focus on scalability and efficiency.

3. Microsoft Ecosystem: Expertise in Microsoft platforms such as Azure, Power BI, and Microsoft Data Fabric, with hands-on experience in building and maintaining solutions in these environments.

4. CI/CD Tools: Extensive experience with CI/CD tools such as Azure DevOps, Jenkins, or similar, with a focus on automating data integration and deployment processes.

5. Data Integration & Security: Familiarity with data integration tools and techniques, along with a strong understanding of data security, compliance, and best practices, especially in the context of handling sensitive financial and investment data.

Preferred Qualifications:

1. Advanced Technologies: Experience with advanced data platforms such as Microsoft Data Fabric or Snowflake, and familiarity with containerization and orchestration tools (Docker, Kubernetes) is highly desirable.

2. Certifications: Azure certifications or other relevant Microsoft certifications are a plus.

3. Investment Data Expertise: Experience working with investment data, financial systems, or similar data sets is highly preferred.

Interested candidates, who wish to apply for the advertised position, please email us an updated copy of your resume. We regret that only shortlisted candidates will be notified.

Job Code: JYOK