Senior Data Engineer

Cornspring; London; On-site; GBP 45,000 - 80,000

Job description

This job is brought to you by Jobs/Redefined, the UK's leading over-50s age inclusive jobs board.

Cornspring is a dynamic startup creating innovative Family Office services through a unique combination of technology and data management excellence. Our platform leverages state-of-the-art generative AI and large language models to provide unparalleled insights and efficiency to Family Office investment and accounting data.

We pride ourselves on fostering a positive work environment where we prize creativity, excellence in engineering, a powerful customer focus and attention to problem-solving through great design.

We are seeking a skilled Data Engineer with Python experience to join our Data team. Focusing on processing and validating financial datasets, you will be responsible for developing and maintaining our ETL pipelines, handling diverse data formats, and ensuring data quality and consistency. The role requires strong expertise in Python data manipulation libraries and a solid understanding of financial data structures. You'll work on automating data processing workflows while implementing robust validation and error handling mechanisms to maintain data integrity.

For this position, we require 2-3 days onsite in the Central London office.

Key Responsibilities:

• Build efficient ETL/ELT data pipelines whilst ensuring data and analytics are leveraged for future growth.
• Conduct testing on data movement, transformation code, and data components to ensure integrity, accuracy and high-quality deliverables for all data processing.
• Design and implement data solutions for new initiatives, and provide continuous oversight for existing solutions to improve quality and performance.
• Assess and integrate new data sources into pipelines to meet evolving business needs.
• Provide technical design and coding assistance to junior team members, ensuring the successful delivery of initiatives.

Requirements

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, or equivalent practical experience.
• 5+ years of data engineering experience, with leadership and mentoring skills.
• 3+ years of experience designing and maintaining ETL pipelines, integrating data (ideally financial/investment related) from multiple sources (including APIs).

Preferred Skills

• Strong proficiency in Python, SQL (PostgreSQL) and AWS technologies (S3, Lambda).
• Strong proficiency with tools and packages like Pandas, NumPy and Jupyter Notebooks.
• Expertise in building, maintaining, optimising and monitoring ETL pipelines, APIs and microservices, and ensuring robust error-handling and logging mechanisms.
• Knowledge of data governance, data security and compliance standards.
• Experience working with large datasets and complex data landscapes.
• Proficient at GitHub and CI/CD.
• Experience or interest in agile methodologies (XP, SCRUM, Kanban) and continuous integration.
• Strong data problem-solving and communication skills.
• An understanding of IaC and technologies like CloudFormation.
• Experience working within, or a solid working understanding of, the Financial Services industry is an advantage.

Benefits

• Competitive salary and benefits package.
• Being part of a revolutionary movement in Family Office technology.
• Work with cutting-edge AI and data technologies.
• Collaborate with a passionate team of innovators.
• Opportunities for professional growth and development.
• Engaging and challenging projects that make a real impact to our sector.