System Reliability Engineering Lead

Position Description:

We are Canada's largest independent information technology services firm, and after 40 years, we're still growing! Innovation, technology, and service delivery are our focus. Our goal is to ensure our clients remain ahead of the competition. We provide a full spectrum of managed services from IT and business process outsourcing to systems integration and consulting that are transforming our clients’ operations and helping them to succeed.

Do you enjoy working with a highly motivated and talented team to deliver mission critical developer tooling? We are currently expanding our System Reliability Engineering team that helps one of our key clients deploy, manage, troubleshoot, and enhance their developer tooling platform, servicing over developers.

Your Future Duties and Responsibilities:

As a System Reliability Engineer, you will be responsible for designing, implementing, and supporting a variety of developer productivity tools that include Ansible Tower, GitLab, Artifactory, and SonarQube. The technology stack used to manage the platform includes Ansible, Terraform, Python, Prometheus, Splunk, and ELK.

You will build automation solutions to provision and validate infrastructure and help debug and resolve problems. You will help to improve operational performance by focusing on user experience, effectively assessing and managing risk, and minimizing the impact of failures.

Required Qualifications to be Successful in This Role:

1. Keeping all components of the developer productivity platform up and running
2. Working closely with internal partners and platform users to ensure that all services meet security, SLA, and performance requirements
3. Writing, updating, and using documentation, including runbooks and playbooks
4. Automating infrastructure deployment, testing, application failover, failure mitigation, user self-service functions, and more
5. Debugging complex problems across the entire stack
6. Participating in various meetings with the Operations and Delivery teams
7. Leading Daily/Weekly Meetings to discuss the overall health of the systems
8. Leading Root Cause Analysis calls
9. Proposing and implementing Monitoring Improvements/Optimization and Automation Opportunities
10. Taking part in PI (Program Increment) Planning sessions

Key Skills and Attributes:

1. 10 years experience with software engineering, software development, or system operations
2. Experience working with Linux and can write shell scripts and understands Linux internals and performance tuning
3. Strong understanding of networking principles
4. Experience debugging large scale complex systems in production
5. Experience in building, implementing, and supporting highly available production systems
6. Experience automating infrastructure and deployments using Terraform, Ansible, and Python or equivalent technologies
7. Understanding of DevOps engineering, CI/CD, and software deployment
8. Working knowledge of developer tooling such as Artifactory, GitLab, SonarQube, and Ansible Tower
9. Experience with various monitoring and observability tools
10. Experience deploying and managing workloads on one of the major public cloud platforms, private clouds such as OpenStack
11. Experience deploying and managing workloads on one of the major container management platforms like Kubernetes, OpenShift, PCF or Rancher
12. A curiosity about how complex socio-technical systems operate and what happens during failure

It’s not expected that any single candidate would have experience across all these areas – we are looking for someone who is strong in a few areas and has interest and curiosity in others.