Databricks Engineer

Treliant, LLC; London; On-site; GBP 150,000 - 200,000

Job description

Overview

We are looking for Databricks Engineers from a consulting, investment banking or financial services backgrounds to add to our future Talent Pool community. If you wish to be considered for any future roles we have within this area, please share your CV with us.

Treliant is a global consulting firm serving banks, mortgage originators and servicers, FinTechs, and other companies providing financial services. We are led by practitioners from the industry and the regulatory community who bring deep domain knowledge to help our clients drive business change and address the most pressing compliance, regulatory, and operational challenges.

We provide data-driven, technology-enabled advisory and consulting, implementation, staffing and managed services solutions to the regulatory compliance, risk, financial crimes, and capital markets functions of our clients.

Founded in 2005, Treliant is headquartered in Washington, DC, with offices across the United States, London, Belfast, and Łódź, Poland. For more information visit www.treliant.com.

Responsibilities

While the scope of each project may be different, your duties & responsibilities may include:

• Design and implement Databricks-based solutions for managing, processing, and analyzing large datasets within the financial services sector.
• Collaborate with cross-functional teams (data scientists, analysts, business stakeholders) to develop and optimize data pipelines, workflows, and data models.
• Guide and support the migration of legacy systems to Databricks, ensuring seamless transitions from legacy to cloud-based environments.
• Ensure data integrity, security, and compliance with financial industry regulations.
• Build and optimize ETL processes using Databricks, Spark, and other data processing tools.
• Implement data governance best practices within the Databricks environment, including data quality, access controls, and audit logging.
• Develop real-time data solutions and integrate Databricks with other data platforms (e.g., data lakes, cloud storage, and data warehouses) to ensure seamless data flow.
• Optimize performance for large-scale data operations, focusing on scalability, efficiency, and cost-effectiveness.

Qualifications

• Strong educational background – Degree in a relevant field.
• 2+ years of experience working with Databricks in a production environment.
• Strong background in ETL/ELT pipeline design and implementation within Databricks.
• Proficiency in SQL, Python, and PySpark for data processing and analysis.
• Experience with streaming technologies such as Kafka for real-time data processing.
• Experience in data migration and integration for data warehouses, including cross-business unit delivery.
• Strong understanding of data governance, security, and compliance standards in financial services.
• Knowledge of reference data, including counterparty and business hierarchy data.
• Experience with financial products (e.g., cashflow forecasting, liquidity management, securities) and regulatory reporting in financial services.
• Excellent problem-solving, leadership, and communication skills for collaborating with teams and explaining technical concepts to non-technical stakeholders.

Benefits

If you want to be part of a dynamic team of professionals, we invite you to join the team at Treliant. We invest in people, and challenge you to advance your career while achieving your aspirations and goals. Here at Treliant, we pride ourselves on our collaborative team culture, where we embrace diversity of thought and innovation.

Career Development - We put an emphasis on personal and professional growth by providing all the training you’ll need to become a highly skilled Treliant consultant. Programs cover Finance, Regulatory, Technology, and Operational aspects of investment banking.

Clients - As a Treliant consultant, you will be working with some of the top clients in the financial services marketplace such as top tier Investment Banks. Our roles place you at the cutting edge of the projects on which you’ll be working, and giving you the opportunity to learn from, work with and build relationships with the very best within those companies.

Rewards - Treliant offers our permanent staff an excellent total rewards package, including competitive base salary, incentive schemes, flexible healthcare coverage and our company pension scheme.

Core Values - Whether you are a Client or an employee, Treliant wants the best for you. All our relationships are based on our Core Values: Deliver Excellence, Constantly Innovate, Treasure Diversity, Be Nimble, Listen First, and Develop our People.

Right to Work

Treliant is not in the position to provide sponsorship for this current position and so applicants must be able to work in the United Kingdom without requiring sponsorship.