Enable job alerts via email!
Data Engineer
Axiom Software Solutions Limited
United Kingdom
Remote
GBP 60,000 - 80,000
Full time
Boost your interview chances
Create a job specific, tailored resume for higher success rate.
Job summary
An innovative firm is seeking a skilled Data Engineer to join their team for a 6-month remote contract. The ideal candidate will possess a strong understanding of data concepts, data structures, and data security principles. You'll work with complex JSON manipulation and data pipelines using Python and PySpark. This role offers a unique opportunity to contribute to significant data projects while working fully remote. If you're passionate about data engineering and ready to tackle challenging problems, this position is perfect for you.
Qualifications
- Strong understanding of data concepts and data structures.
- Experience with Data Pipelines using Python/PySpark frameworks.
Skills
Tools
Job description
Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Data Engineer Skills and Technologies
- Data Engineering:
- Strong understanding of data concepts
- Data types, data structures, schemas (both JSON and Spark), schema management etc.
- Strong understanding of complex JSON manipulation
- Experience working with Data Pipelines using custom Python/PySpark frameworks
- Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
- Strong understanding of Data Security principles
- Data owners, access controls
- Row and column level, GDPR etc including experience of handling sensitive datasets
- Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
- Languages / Frameworks:
- JSON
- YAML
- Python (as a programming language, not just able to write basic scripts; Pydantic experience would be a bonus)
- SQL
- PySpark
- Delta Lake
- Bash (both CLI usage and scripting)
- Git
- Markdown
- Scala (bonus, not compulsory)
- Azure SQL Server as a HIVE Metastore (bonus)
- Azure Databricks
- Apache Spark
- Delta Tables
- Data processing with Python
- PowerBI (Integration / Data Ingestion)
- JIRA
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
job faster
