Lead Systems Engineer

The Lead Systems Engineer - Storage Technology is responsible for design, leads implementation, and provides Level 3 expert support for extra-large scale storage infrastructure, ensuring the highest levels of performance, scalability, and reliability. This role serves as a key subject matter expert, leading a team of engineers responsible for block, object, and file storage solutions, as well as backup services.

Responsibilities

1. Co-design, lead implementation and management of PBs-level block, object and file storage solutions as integral components of Cloud and HPC environments ensuring stability, performance and compliance with industry standards and best practices.
2. Define and oversee implementation of roadmap for all storage solutions and services across the company.
3. Collaborate with architecture and other engineering teams on storage and backup technology component evaluation and selection ensuring solutions are designed following best practices and are optimized from both functional and non-functional perspectives.
4. Lead regular capacity planning exercises to anticipate and accommodate the growing demands on the storage infrastructure, ensuring it meets current and future requirements.
5. Develop and oversee implementation of plans to enhance the reliability of the storage infrastructure, addressing potential points of failure and ensuring high availability of storage services.
6. Explore, analyze, and implement performance optimization strategies for the storage solutions, ensuring optimal resource utilization and performance.
7. Lead evaluation and integration of advanced storage technologies and methodologies, such as SDS to enhance features, performance, and efficiency.
8. Define and oversee execution of disaster recovery strategies ensuring data integrity, availability, and protection across all platforms and environments.
9. Design and enhance observability stack in collaboration with the IaaS operations team ensuring monitoring coverage and accuracy.
10. Provide L3 expert support including on-call shifts and being the final tier of resolution for L2 support teams through problem analysis and communication with vendor's technical support.
11. Lead and mentor a team of storage engineers and collaborate with other platform engineering teams on solution design and delivery.
12. Collaborate with security management teams to ensure that systems are safe and secure against cybersecurity threats.
13. Write and maintain relevant documentation ensuring completeness and quality.
14. Work closely with process management and operational teams and contribute to process development standardizing collaboration framework and improving collaboration efficiency.

Qualifications

1. Bachelor's or master's degree in computer science, engineering, software engineering or related field in technology.
2. 2+ years of experience leading a team of 3+ engineers holding accountability for quality and timely delivery of infrastructure projects.
3. 7+ years of experience with deep expertise in designing, implementing, and managing large-scale software-defined storage (SDS) solutions providing block, object or file storage services and backup capabilities.
4. In-depth hands-on experience in system implementation, management, and optimization of storage systems from leading vendors, including but not limited to HPE, Dell, NetApp, Hitachi, IBM, PureStorage, or VAST Data.
5. Deep knowledge of different storage protocols providing block, object and file storage interfaces such as iSCSI, S3, NFS, FC[oE], NVME over TCP, etc.
6. Proficient with Linux/Linux kernel and storage stack and capable of debugging related issues.
7. Advanced experience in managing object storage solutions based on SeaweedFS, MinIO, Cloudian HyperStore, Qumulo S3, Scality Ring or Dell ECS.
8. Experience with cloud native Backup solution for OpenStack (e.g., Freezer, Karbor, TriliO, Hystax, Raksha etc) is highly desirable.
9. Experience in designing and managing clustered/parallel file systems such as Lustre, GPFS, etc is highly desirable.
10. Familiarity with containerization technologies (Openshift, Docker, Kubernetes, etc) and container storage technologies [Rook, CSI, PVC, etc].
11. Experience with integration of identity management, access management, and authorization solutions (PKI, LDAP, OAUTH, OpenID).
12. In-depth knowledge of backup systems, disaster recovery principles, and data protection strategies.
13. Familiarity with load balancers technologies for object storage solutions.
14. Deep knowledge in data encryption, security practices, and hardening related to Storage and Backup systems.
15. Solid knowledge of Data center network design and related technologies [OSI model, TCP/IP stack, firewalling, routing, VLAN/VxLAN, etc]
16. Hands-on experience with monitoring and observability tools like Zabbix, Nagios, Prometheus, Grafana, ELK Stack (Elasticsearch, Logstash, Kibana).
17. Understanding of CI/CD principles, Infrastructure as Code (IaaC) approach and software defined infrastructure solutions.
18. Advanced level in programming and scripting using Python and/or Golang, bash.