Data Engineer

Hey, we’re Sparta Commodities!

We are a Swiss, VC-backed scaleup with a global reach. Our mission is to digitize the commodity trading market and become the leading platform for traders in all commodities verticals. We’ve already gained significant market traction and are financially backed by Venture Investors.

Sparta currently has a fantastic opportunity for a driven and passionate Data Engineer to join our growing Data team. This is a great career opportunity for an experienced and delivery-focused Data Engineer to play a key role in refining and optimising how data from varied sources is ingested, processed, and cleansed for a leading and highly regarded business in the commodity trading space.

We are a fully remote company with a modern tech stack, and we strive for fast deployments to support the rapid growth we are experiencing, these hires are key to our continued success.

Reporting to our Head of Data, you will work alongside our data and development teams to refine and optimize our current data ingestion, ETL, and cleansing models. The responsibilities include building new data ingestion pipelines using Python, and SQL all running on AWS; data wrangling, management, and standardization; data quality analysis and cleansing; and applying best practices in software development. We plan to utilize our data to build machine learning models and uncover hidden insights, but first, we must build a good foundation to ensure our long-term success. You will have a chance to influence our cloud data infrastructure design, take ownership of end-to-end data projects, and liaise with other parts of the business to ensure we can leverage our data to create value for our clients.

About You

• You have prior experience as a Data Engineer or Software Engineer, building ETL/ELT pipelines from scratch.
• You have experience with monitoring and alerting of data ingestion jobs.
• You are an independent contributor but also enjoy leading projects and productionising solutions for complex problems.
• You thrive in a fast-paced, scale-up environment.

• You seek to continuously improve processes and find the most optimal way to solve problems.
• You can work remotely and independently, taking ownership of your work.

• You have proven English language communication skills that enable you to collaborate in a remote-first company with a diverse international workforce.

Technical Requirements

• Extensive experience with Python for data ingestion, transformation, and loading processes.
• Practical experience in AWS cloud services.
• Good understanding of relational databases.
• Proficient in monitoring and alerting for data ingestion pipelines using tools such as Datadog, focussing on ensuring high availability and reliability.
• Proficiency in using Unix / Linux at the command line to perform software development and maintenance.
• Proven experience in version control, CI/CD, unit test, integration test, functional test, and writing documentation.
• Practical experience in modern software engineering techniques and best practices.

Bonus points

• Knowledge of NoSQL databases.
• Familiarity with DevOps/MLOps practices, including automation, infrastructure as code, and CI/CD pipelines for machine learning workflows.
• Experience in real-time/streaming data ETL, leveraging technologies like Apache Kafka or AWS Kinesis for high-volume data processing.

• Working knowledge of Java, with the ability to contribute to Java-based projects or collaborate in multi-language environments.
• Experience in the trading/fintech industry.

What’s the culture like at Sparta?

At Sparta, our culture is not just a set of values written on a wall—it's a way of life. We embrace a dynamic environment where initiative is celebrated, challenges are met head-on, and innovation thrives.

We're building an environment where our employees thrive and excel in their work. Our aim is for every member of our team to take pride in their contributions. You'll collaborate with like-minded individuals who are passionate about our mission and deeply committed to crafting outstanding products and achieving success for our customers.

We operate remotely, understanding that a thriving, profitable company isn't just about being in the same location. We build our relationships through effective remote work methods and carefully planned in-person meet-ups.

What we offer:

• Fully remote working, with occasional travel to a central hub for collaborative meetings and team gatherings.

• Attractive company stock option plan.

• Regular team and company meetups.

• A real performance-led business with support for you to achieve your career goals.

• Private Medical Insurance.
• Life Insurance of 4 times your annual salary (for UK-based employees).

• Access to the optimal gear suited for your position.