Databricks Platform Architect

Darwin is a Specialist Talent Delivery Partner for Databricks Projects. Over the past 6 years, we have supported some of the largest Databricks programs around the globe.

We are seeking a Freelance Platform Architect to lead the migration of enterprise data platforms from Oracle to Azure Databricks.

This role requires deep expertise in data architecture, cloud migration strategies, and performance optimization. The ideal candidate will have hands-on experience in transitioning on-premises Oracle databases to Databricks on Azure, ensuring a scalable, high-performance, and cost-efficient cloud data platform.

Responsibilities:

1. Architect and lead the migration strategy for moving large-scale Oracle databases and workloads to Databricks on Azure.
2. Design a modern data platform that optimizes data ingestion, transformation, and analytics using Azure Databricks, Delta Lake, and Spark.
3. Develop and implement ETL/ELT pipelines to efficiently migrate and transform Oracle data into Databricks while ensuring data integrity.
4. Optimize performance, security, and governance of the Databricks environment to meet enterprise requirements.
5. Collaborate with database administrators, data engineers, and business stakeholders to ensure a smooth migration process with minimal disruption.
6. Define best practices for cost optimization, workload orchestration, and infrastructure scaling in Azure.
7. Implement CI/CD pipelines and infrastructure-as-code (IaC) for automated deployments and infrastructure management.
8. Monitor and troubleshoot data processing, storage, and networking issues during and after migration.
9. Provide technical leadership and hands-on guidance to engineering teams.

Duration: 12 Months (Open to an extension)

Location: Remote (Potential visits to DE & NL locations)