Enable job alerts via email!

SC Cleared Data Engineer

TN United Kingdom

London

Remote

GBP 100,000 - 125,000

Yesterday

Be an early applicant

Boost your interview chances

Create a job specific, tailored resume for higher success rate.

An innovative firm is seeking a skilled data professional with a strong grasp of data concepts and security principles. This remote role emphasizes expertise in data pipelines, JSON manipulation, and Linux system administration. You'll thrive in a dynamic Agile environment, collaborating on projects using cutting-edge technologies like Azure Databricks and Apache Spark. If you're passionate about data and eager to tackle complex challenges, this is the perfect opportunity to make a significant impact in a forward-thinking company.

Strong understanding of data concepts and data security principles.
Experience with data pipelines and complex JSON manipulation.

Manage and handle various data types and structures effectively.
Demonstrate problem-solving and analytical skills in a support role.

Data Concepts

JSON Manipulation

Data Pipelines

Data Security Principles

Problem Solving Skills

Linux System Administration

Agile Methodologies

Azure Databricks

Apache Spark

PowerBI

JIRA

Git

SC Cleared
Remote

Responsibilities:

Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc.
Strong understanding of complex JSON manipulation.
Experience working with Data Pipelines using a custom Python/PySpark frameworks.
Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc including experience of handling sensitive datasets.
Strong problem solving and analytical skills, particularly able to demonstrate these intuitively (able to work a problem out, not follow a work instruction to resolve).
Experience working in a support role would be beneficial, particularly able to demonstrate incident triage and handling skills/knowledge (SLAs etc).
Fundamental linux system administration knowledge - ssh keys and config etc, Bash CLI and scripting, Environment variables.
Experience using browser based IDEs (Jupyter Notebooks, RStudio etc).
Experience working in a dynamic Agile environment (SAFE, scrum, sprints, JIRA etc).

Languages / Frameworks:

JSON
YAML
Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
SQL
PySpark
Delta Lake
Bash (both CLI usage and scripting)
Git
Markdown
Scala (bonus, not compulsory)
Azure SQL Server as a HIVE Metastore (bonus)

Technologies:

Azure Databricks
Apache Spark
Delta Tables
Data processing with Python
PowerBI (Integration / Data Ingestion)
JIRA

Please send in your latest CV.

Please note that if you are NOT a passport holder of the country for the vacancy you might need a work permit. Check our Blog for more information.

Bank or payment details should not be provided when applying for a job. Eurojobs.com is not responsible for any external website content. All applications should be made via the 'Apply now' button.

Created on 02/04/2025 by TN United Kingdom

Get your free, confidential resume review.

or drag and drop a PDF, DOC, DOCX, ODT, or PAGES file up to 5MB.

Similar jobs