Senior Software Engineer - Ceph

Boson AI is a startup building large language tools for everyone to use. Our founders (Alex Smola, Mu Li), and a team of Deep Learning, Optimization, NLP, AutoML, and Statistics scientists and engineers are working on high-quality generative AI models for language, audio, and entertainment.

About The Role

We are looking for a Senior Software Engineer with deep expertise in managing Ceph for our deep learning datacenter in Toronto. The ideal candidate needs to have strong problem-solving skills and an ability to learn new tools. Experience with Slurm, MAAS, Infiniband, NVIDIA deepops, Layer 3 networking, and related tools are a big plus. You should be comfortable performing some amount of hardware configuration.

You will have the opportunity to work with NVIDIA H100 and A100 GPUs, over 25PB of disk and over 5PB flash storage, Terabit networking, and hundreds of computers. You will be responsible for deploying and operating Ceph and its integration with a broad range of infrastructure technologies and hardware systems.

You MUST have prior Ceph experience in order to qualify for the job. If you don't, please don't spam the ATS.

A day in the life:

• Design, manage, and maintain large storage arrays
• Integrate them with Deep Learning infrastructure
• Support troubleshooting for MAAS, Slurm, and Kubernetes as needed
• Configure and automate on-premises Linux-based systems at scale using infrastructure-as-code practices
• Learn about new tools and deploy them

You might be a great fit if you have:

• Strong background in maintaining Ceph clusters
• Experience with high-performance computing is highly desirable
• Experience with on-premises Data Center operations and technologies
• Experience in managing a large hardware cluster
• Proficiency in at least one programming language (e.g. Python) and ability to write clean, maintainable code
• Experience with managing firmware/systems updates for systems, e.g. on SuperMicro

Salary: $150,000 - $250,000 a year

The ability to solve problems and to learn new techniques is key.