Senior Big Data Engineer

Project description

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:

• Scalable cost-efficient infrastructure, using cloud PaaS components.
• Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
• Shared across Front Office, Finance and Risk, improving regulatory compliance.
• One-Platform / One-Experience - fast to train, easy to operate, retaining talent.

The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Responsibilities

• Development of big data technologies like Apache Spark and Azure Databricks
• Programming complex production systems in Scala, Java, or Python
• Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
• Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
• Experience with containerisation in development, build, and runtime environments including experience of Kubernetes

Salary - 140-150K/year

SKILLS

Must have

• Development of big data technologies like Apache Spark and Azure Databricks
• Programming complex production systems in Scala, Java, or Python
• Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
• Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
• Experience with containerisation in development, build, and runtime environments including experience of Kubernetes

Nice to have

• Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
• Python experience
• Testing and instrumentation practices, observability, and alerting tooling
• Understanding of information modelling, data structures, and algorithms
• Technical architecture and low-level design
• Agile development and planning practices
• Ability to collaborate effectively in a large global team and influence key architectural decisions