For companies:
For professionals:
For everyone:
For developers:
Responsibilities
About The Company Boson AI is a startup building large language tools for everyone to use. Our founders (Alex Smola, Mu Li), and a team of Deep Learning, Optimization, NLP, AutoML and Statistics scientists and engineers are working on high quality generative AI models for language, audio, and entertainment.About The Role We are looking for a Senior High Performance Computing Engineer to help us operate the GPUs, network and filesystem in our datacenter deployment in Toronto. The ideal candidate needs to have strong problem solving skills and an ability to learn new tools. Experience with Slurm, MAAS, Ceph, Infiniband, NVIDIA deepops, Ethernet networking and related tools are a big plus. You should be comfortable performing some amount of hardware configuration. You will have the opportunity to work with NVIDIA H100 and A100 GPUs, over 20PB of storage, Terabit networking and hundreds of computers. You will be responsible for deploying and operating a broad range of infrastructure technologies and hardware systems.A day in the lifeManage private large high-end GPU clustersResponsible for full lifecycle of physical systems including deployments of new hardware, operations, triage and troubleshootingConfigure and maintain network switches (Tomahawk Ethernet, Mellanox Infiniband)Configure and maintain MAAS, Ceph, Slurm and KubernetesConfigure and automate on-premises Linux-based systems at scale using infrastructure-as-code practicesConfigure and maintain network, e.g. Layer 3 networkingLearn about new tools and deploy themYou might be a great fit if you haveStrong background in high performance computingExperience with with on-premises Data Center operations and technologiesExperience in managing a large hardware clusterProficiency in at least one programming language (e.g. Python) and ability to write clean, maintainable codeExperience in designing, deploying, and maintaining production-grade machine learning systems at scaleFamiliarity with GPU utilization for machine learning workloads and optimization techniquesExperience with managing firmware / systems updates for systems, e.g. on SuperMicroSalary Range $150,000 - $250,000 a yearClosing The ability to solve problems and to learn new techniques is key.AI Disclosure We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
This job post is closed.