Scala Data Engineer

Tenth Revolution Group; Northampton; Remote; GBP 100,000 - 120,000

Job description

Scala Data Engineer

I am working with an analytics and digital solutions consultancy that partners with clients from several different industries to unlock their potential to become truly data-driven. They work to deliver tailored, bespoke systems to fit the needs of their clients with a focus on cloud-based transformations and AI products.

You will be joining this award-winning consultancy during a period of significant growth off the back of winning new projects. They have undergone year-on-year growth and are backed by a private equity firm who are committed to continuing to help this business grow. You will work on a UK-based project but the business has continued to build on their operations in both central Europe and America.

You will be joining a project with a focus on data migration from Hadoop to the cloud, creating robust data pipelines and working with Scala, Spark, and other AWS services to process and manipulate data.

Responsibilities:

1. Develop big data solutions utilizing Hadoop and Apache Spark
2. Create, develop, and maintain robust ETL pipelines using AWS Glue and Scala
3. Design and implement Scala-based applications for the use of big data processing
4. Work with other technical members of the team to enhance the performance of code, promoting best practice at all times
5. Implement data processing and transformation workflows for both unstructured and structured data

Minimum Requirements:

1. Previous experience working as a Data Engineer utilizing Scala
2. Hands-on experience with Apache Spark and Spark-Scala
3. Experience working within the Hadoop ecosystem
4. Experience creating ETL pipelines using Scala or AWS Glue
5. Strong understanding and experience with AWS technologies such as S3, Lambda, and EMR

This is a fully remote role, and you would be employed on a fixed-term contract basis for 12 months (the duration of the current project). My client is offering a starting salary of up to £120,000 depending on experience with a benefits package that includes 28 days of annual leave, private medical care, and a strong company pension scheme.

This is just a brief overview of the role. For the full information, simply apply to the role with your CV, and I will call you to discuss further. My client is looking to begin the interview process ASAP, so don't miss out, APPLY now!