Enable job alerts via email!
Data Engineer
Experis - ManpowerGroup
London
Remote
GBP 100,000 - 125,000
Boost your interview chances
Create a job specific, tailored resume for higher success rate.
Job summary
An innovative firm is seeking a skilled Data Engineer with a strong grasp of data concepts and security principles. In this dynamic role, you will work remotely to develop and manage data pipelines using a custom Python/PySpark framework. Your expertise in complex JSON manipulation and understanding of data categories will be crucial in handling sensitive datasets while ensuring compliance with data security standards. Join a forward-thinking team that values problem-solving and analytical skills, and contribute to impactful data-driven projects in a flexible work environment.
Qualifications
- Strong understanding of data concepts and security principles.
- Experience with Data Pipelines using Python/PySpark framework.
Responsibilities
- Manipulate complex JSON and manage data structures effectively.
- Ensure data security and compliance with GDPR for sensitive datasets.
Skills
Data Security principles
Problem-solving skills
Analytical skills
JSON manipulation
Data concepts understanding
Tools
Azure Databricks
Apache Spark
Delta Tables
PowerBI
JIRA
Git
Job description
Role: Data Engineer
Location: UK Remote
Duration: 6 Months
Day rate: £470 inside IR35
Active SC clearance required
Role Description:
- Strong understanding of data concepts - data types, data structures, schemas (both JSON and Spark), schema management etc.
- Strong understanding of complex JSON manipulation.
- Experience working with Data Pipelines using a custom Python/PySpark framework.
- Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
- Strong understanding of Data Security principles - data owners, access controls - row and column level, GDPR etc., including experience of handling sensitive datasets.
- Strong problem-solving and analytical skills, particularly able to demonstrate these intuitively.
Required skills:
- Languages / Frameworks: JSON, YAML, Python (as a programming language, not just able to write basic scripts; Pydantic experience would be a bonus), SQL, PySpark, Delta Lake, Bash (both CLI usage and scripting), Git, Markdown, Scala (bonus, not compulsory), Azure SQL Server as a HIVE Metastore (bonus).
Technologies: Azure Databricks, Apache Spark, Delta Tables, Data processing with Python, PowerBI (Integration / Data Ingestion), JIRA.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
Similar jobs
Lead Data Engineer
Only for registered members
London
Remote
GBP 105,000 - 115,000
SC Cleared Data Engineer
Only for registered members
London
Remote
GBP 100,000 - 125,000
Lead Data Engineer
Only for registered members
London
Remote
GBP 105,000 - 115,000
Snowflake & AWS Data Engineer
Only for registered members
London
Remote
GBP 100,000 - 125,000
Principal Data Engineer
Only for registered members
London
Hybrid
GBP 100,000 - 140,000
job faster
