Senior ETL & Python Developer - Data Merger Project

Luxoft; London; On-site; GBP 60,000 - 100,000

Job description

Project description

Our client is an EU subsidiary of a Global Financial Bank working in multiple markets and asset classes. We are seeking a highly skilled Senior ETL & Python Developer to support a Data Merger Project for a leading bank. The ideal candidate will have extensive experience in ETL development, Python programming, and data migration strategies within a banking environment. This role involves designing and implementing ETL pipelines to facilitate the seamless integration of financial data from multiple sources into the bank's target data warehouse.

Responsibilities

1. ETL Development & Data Integration: Design, develop, and optimize ETL workflows and data pipelines to support the migration and consolidation of banking data. Extract, transform, and load (ETL) data from heterogeneous data sources (Oracle, SQL Server, flat files, APIs, cloud storage). Ensure data integrity, quality, and consistency throughout the migration process.
2. Python Development & Automation: Develop and maintain Python scripts for data extraction, transformation, validation, and automation. Implement data processing and transformation logic using Pandas, PySpark, or SQLAlchemy. Work with APIs to integrate external data sources where required.
3. Banking Data Merger & Migration: Participate in the data mapping, cleansing, and reconciliation process to ensure accurate data consolidation. Work closely with data analysts, business users, and stakeholders to define data transformation rules and validation checks. Troubleshoot and resolve data migration issues, performance bottlenecks, and discrepancies.
4. Database & Performance Optimization: Work with relational databases (Oracle, SQL Server, PostgreSQL) to optimize queries and improve data processing speed. Implement partitioning, indexing, and caching strategies for large-scale data processing. Ensure the security and compliance of banking data during migration.
5. Collaboration & Documentation: Collaborate with business analysts, data engineers, and IT teams to understand requirements and define ETL strategies. Document ETL processes, data transformation rules, and architecture for future reference. Support testing and validation phases by working closely with QA teams.

SKILLS

Must have:

1. 5+ years of experience in ETL development, data migration, and data integration.
2. Strong expertise in Python programming for data processing and automation.
3. Hands-on experience with ETL tools such as Informatica, Talend, Apache NiFi, or custom Python-based ETL solutions.
4. Solid understanding of banking and financial data structures, including transactions, customer records, regulatory reporting, and risk data.
5. Strong SQL skills, with experience in Oracle, SQL Server, or PostgreSQL.
6. Experience handling large-scale data processing, performance tuning, and debugging complex ETL workflows.
7. Familiarity with cloud-based ETL solutions (in particular Azure Fabric) is a plus.
8. Knowledge of data governance, lineage, and compliance frameworks in the banking sector.

Preferred Qualifications:

1. Bachelor's or Master's degree in Computer Science, Data Engineering, Finance, or a related field.
2. Certifications in Python, ETL tools, or cloud-based data solutions.

Nice to have:

• Background in SSIS / SSAS / SSRS
• Azure DevTest Labs, ARM templates
• Azure PurView
• Experience in big data technologies (Hadoop, Spark, Databricks) is a plus.