Enable job alerts via email!

SC Cleared Data Engineer

Opplæringskontoret for Offshore fag

London

Remote

GBP 100,000 - 125,000

18 days ago

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

An innovative firm is seeking a skilled data professional to join their remote team. This role requires a strong understanding of data concepts, particularly in JSON manipulation and data security principles. You'll be working with data pipelines using a custom Python/PySpark framework, contributing to the management of complex datasets while ensuring compliance with security standards. The ideal candidate will possess strong analytical and problem-solving skills, thrive in a dynamic Agile environment, and have experience with various data technologies. If you are passionate about data and eager to make an impact, this opportunity is perfect for you.

Strong understanding of data concepts and security principles.
Experience with Data Pipelines using Python/PySpark framework.

Manage complex JSON manipulation and data security principles.
Work in a dynamic Agile environment and support role.

Data Concepts Understanding

Problem Solving Skills

Analytical Skills

Data Security Principles

JSON Manipulation

Linux System Administration

Agile Methodologies

Azure Databricks

Apache Spark

PowerBI

JIRA

Jupyter Notebooks

RStudio

SC Cleared
Remote

Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc.

Responsibilities:

Strong understanding of complex JSON manipulation.
Experience working with Data Pipelines using a custom Python/PySpark framework.
Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc. including experience of handling sensitive datasets.
Strong problem solving and analytical skills, particularly able to demonstrate these intuitively.
Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc).
Fundamental Linux system administration knowledge - SSH keys and config, Bash CLI and scripting, Environment variables.
Experience using browser-based IDEs (Jupyter Notebooks, RStudio etc).
Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc).

Languages / Frameworks:

JSON
YAML
Python (as a programming language, not just able to write basic scripts; Pydantic experience would be a bonus).
SQL
PySpark
Delta Lake
Bash (both CLI usage and scripting)
Git
Markdown
Scala (bonus, not compulsory)
Azure SQL Server as a HIVE Metastore (bonus)

Technologies:

Azure Databricks
Apache Spark
Delta Tables
Data processing with Python
PowerBI (Integration / Data Ingestion)
JIRA

Please send in your latest CV.

Get your free, confidential resume review.

or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.

Similar jobs