Lead Software Engineer (Data Engineer)

Our Purpose

Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential.

Title and Summary

Lead Software Engineer (Data Engineer)

About Mastercard

Mastercard is a global technology company in the payments industry. Our mission is to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart, and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments, and businesses realize their greatest potential.

Mastercard's Enterprise Security Solutions organization develops and delivers world-class security products and services for customers across the globe. NuData Security, a Mastercard company, is an award-winning company that predicts fraudulent transactions by identifying good users from bad based on their online behavior.

About the Role
We are seeking a Lead Data Engineer to join our Data and Platform team. This is a pivotal role, responsible for guiding Data Engineer design, supporting multiple Data Analysts and Data Scientists, as well as assisting on various data-driven requests across the company. The position involves a wide variety of technical skills, from coding to infrastructure, from data analysis to database management. The ideal candidate will have experience building data platform/infrastructure, enterprise solutions, and extensive knowledge about building highly redundant, scalable, and efficient automated data ETL processes for large-scale data analysis.

Responsibilities

1. Own complex problems having dependency across services and facilitate cross-functional team interactions to drive resolution, including large-scale data extraction, transformation and analysis.
2. Write code to build and enhance applications/services and promote code-reviews, code scanning, and other standard development practices to deliver high-quality data modeling and artifacts to production.
3. Define, architect, design, and develop procedures and solutions at a service level to meet the business requirements/enhancements.
4. Responsible for maintaining the tooling and infrastructure that enables our Analysts and Data Scientists to work efficiently and effectively.
5. Drive prioritization decisions and trade-offs in working with product partners.
6. Promote strategies to improve our data modeling, quality, and architecture.
7. Automate and simplify all aspects of software delivery and development actively evangelizing the need to automate and simplify where needed.
8. Drive seamless integration across all connected services to meet end-user expectations.
9. Support production code to produce comprehensive and accurate data artifacts.
10. Drive blameless postmortems culture to identify root causes of incidents and implement learnings.
11. Introduce new technologies and architecture by following enterprise guidelines.
12. Advocate for engineering principles outside of current organization/platform.
13. Provide development and architecture guidance to team members.
14. Build relationships and effective partnerships across organizations.
15. Write and evaluate recommendations for job promotions based on an unbiased view of one's accomplishments.
16. Conduct technical interviews for hiring engineering staff and raising the performance bar.
17. Lead by example with hands-on approaches to demonstrate engineering excellence.
18. Encourage staff to share and seek knowledge within their Guild/Program to drive reuse of patterns/libraries/practices and enhance productivity.

Experiences

1. Has the ability to write secure code in three or more languages (e.g., Python, Java, JavaScript, PHP) and familiar with secure coding standards (e.g., OWASP, CWE, SEI CERT) and vulnerabilities.
2. Experience with cloud technologies, especially AWS Redshift, AWS Glue Jobs and Crawler, Lake Formation/CDK Policies, Step Functions, S3, SQS, SNS, and Sparks technology.
3. Has good understanding of map reduce paradigm.
4. Experienced with streaming data such as Kafka or AWS Kinesis.
5. Experienced with distributed computation engine such as Spark or Flink.
6. Experience with monitoring tools, such as DataDog, Splunk, AWS CloudWatch/Cloud Trails.
7. Experience with analysis tools, such as Athena or Tableau.
8. Understands internals of operating systems (Mac, Linux) to write interoperable and performant code.
9. Experienced with developing and maintaining data pipelines for the extraction, transformation, and/or loading of large-scale data.
10. Experienced with working with large data sets. You've implemented parallel processing and have dealt with the limitations and challenges of working with terabytes of data.
11. Able to perform debugging and troubleshooting to analyze core, memory, heap, thread dumps and remove coding errors.
12. Has skills to document and coach team on the development practices and coding guidelines (e.g., branching, peer reviews, library use, logging, scanning rules, test-driven development, error handling).
13. Has skills to undertake a technical review of code across applications and their dependencies to look for anti-patterns and promote continuous refactoring.
14. Understands system architecture to plan for platform and infrastructure capacity (e.g., database, compute, network, storage) and drives the dependency prioritization to reduce the delivery lead time.
15. Has skills to simplify deployment and eliminate software and infrastructure snowflakes using standardized platforms, ephemeral instances, and automation.
16. Has skills to orchestrate release workflows and pipelines to achieve CI and CD using industry-standard tools (e.g., Jenkins, Bamboo, AWS pipelines, others).
17. Able to configure rules and build automation for code with vulnerability scanning and software composition analysis using standard tools (e.g., Sonar, Checkmarx, Nexus, JFrog XRay, Veracode, others).
18. Has skills to define, organize, and report on test runs for major, minor, and hotfix releases (including unit, component level, system level, customer journeys, past customer issues, and regulatory controls).
19. Has skills to conduct various performance tests (e.g., load, spike, breakpoint, endurance) to understand application/service limits and behaviors.

Vancouver Pay Range
$122,000.00 - $195,000.00 CAD Annual

Mastercard is an inclusive equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. If you require accommodations or assistance to complete the online application process or during the recruitment process, please contact and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly.

Corporate Security Responsibility

All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:

• Abide by Mastercard's security policies and practices;
• Ensure the confidentiality and integrity of the information being accessed;
• Report any suspected information security violation or breach, and
• Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

Pay Ranges
Vancouver, Canada: $127,000 - $203,000 CAD