Data Engineer
Whitehall Resources require a Data Engineer to work with a key client on an initial 6 month contract.
Role Details:
* This role will involve 5 days per week on site in London for the 1st month, then reducing to hybrid 2-3 days on site per week.
* Outside IR35.
Requirements:
- Several years of relevant work experience
- Take end-to-end responsibility to build, optimize and support existing and new data products towards the defined target vision
- Be a champion of DevOps mindset and principles and able to manage CI/CD pipelines and terraform as well as Cloud infrastructure, specifically GCP (Google Cloud Platform)
- Evaluate and drive continuous improvement and reduce technical debt in the teams
- Design and implement efficient data models and data pipelines that support analytical requirements. Good understanding of different data modelling techniques and trade-offs
- Experience with Data Modelling
- Experience in data query languages (SQL or similar). Knowledge of ETL processes and tools
- Experience in data-centric and API programming (for automation) using one or more programming languages: Python, Java, or Scala
- Knowledge of NoSQL and RDBMS databases
- Experience in different data formats (Avro, Parquet)
- Collaborative and co-creative mindset with excellent communication skills
- Motivated to work in an environment that allows independent decision-making
- Experience with data visualization tools
- Experience with GCP tools – Cloud Function, Dataflow, Dataproc, and BigQuery
- Experience in data processing frameworks – Beam, Spark, Hive, Flink
- GCP data engineering certification is a merit
- Hands-on experience in analytical tools such as Power BI or similar visualization tools
- Understanding in creating intermediate-level DAX measures to enhance data models and visualizations
- Understanding of Microsoft Excel
All of our opportunities require that applicants are eligible to work in the specified country/location unless otherwise stated in the job description.
Whitehall Resources are an equal opportunities employer who value a diverse and inclusive working environment. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity or expression, sexual orientation, national origin, pregnancy, disability, age, veteran status, or other characteristics.