Databricks Developer / ETL Engineer

Databricks Developer / ETL Engineer

This is with a large IT services firm for a major bank. Candidate must have legal work status for Canada. Client Location is Halifax Nova Scotia. Hybrid - In-Office 3 days per week. Perm/FT role, salary and benefits OR on contract - 6 months to start. Market rate.

Must have:

1. 7 - 12 years of total experience
2. Exceptional hands-on experience with Databricks platform. Extensive experience writing notebooks, clusters, Databricks SQL, PySpark coding etc.
3. Real working experience converting Microsoft SQL to Databricks SQL, CICD, Release processing
4. Strong experience in ADF (Azure data factory), Azure SQL, Synapse, Spark/Databricks
5. Excellent written and verbal communication, intellectual curiosity, a passion to understand and solve problems, consulting & customer service
6. Structured and conceptual mindset coupled with strong quantitative and analytical problem-solving aptitude
7. Exceptional interpersonal and collaboration skills within a team environment
8. Energetic – Willing to work hard and drive initiatives to success.
9. Strong team player, open minded to consider novel approaches to solving difficult problems.
10. Self-motivated – Driven to get results, takes initiative and needs minimum oversight.
11. Candidate must be local - Halifax area.

Nice-to-have:

1. PySpark
2. Parquet files
3. Experience in ADF (Azure data factory), Azure SQL, Synapse, Spark/Databricks
4. Big data and modern data lake
5. Data Warehousing concepts
6. Candidates should be flexible / willing to work across this delivery landscape which includes and not limited to Agile Applications Development, Support and Deployment
7. Capital Markets experience
8. Experience with providing technical contributions in a fast-paced team environment to accelerate our efforts on recommending products and deriving insights
9. Ability to set and drive the “big picture” strategy while also having the capability to roll-up sleeves and deep-dive into systems/ platforms to provide detailed technical guidance to the team