You have opted out of job matches in .
To undo this, go to the 'Skills and Interests' section of your preferences.
Shared by 
3 months ago
warning
Heads-up
Requirements and responsibilities
About the RoleThis is a globally remote opportunity. We're seeking exceptional generalist engineers who can work across the entire vLLM stack: from low-level GPU kernels to high-level distributed systems. This role is designed for self-directed, autonomous individuals who can identify the highest-leverage problems and solve them end-to-end without constant guidance.You'll work asynchronously with our San Francisco headquarters while maintaining full ownership of critical infrastructure. You might be optimizing CUDA kernels one week, designing distributed orchestration systems the next, and implementing new model architectures the week after. The work you do will directly impact how the world runs AI inference.Potential focus areas include:Inference Runtime: Push the boundaries of LLM and diffusion model serving. Work at the core of vLLM to optimize how models execute across diverse hardware and architectures.Kernel Engineering: Write the low-level kernels and optimizations that make vLLM the fastest inference engine in the world, running on hundreds of accelerator types.Performance & Scale: Build the distributed systems that power inference at global scale—design foundational layers enabling vLLM to serve models across thousands of accelerators with minimal latency.Cloud Orchestration: Build the operational backbone for cluster management, deployment automation, and production monitoring that enables teams worldwide to serve AI models without friction.What We're Looking ForWe're looking for engineers who thrive with autonomy. You should be able to take a vague problem statement and turn it into shipped code with minimal supervision. You communicate proactively, over-communicate context across time zones, and know when to ask for help versus when to push forward independently.Core Requirements:Bachelor's degree or equivalent experience in computer science, engineering, or similarDemonstrated ability to work autonomously and drive projects to completion without close supervisionExcellent asynchronous communication skills and ability to collaborate effectively across time zonesStrong track record of shipping high-impact work in complex technical environmentsDeep expertise in at least one of: systems programming, GPU/accelerator programming, distributed systems, or ML infrastructureTechnical Depth (strong in at least two):CUDA kernels or equivalent (Triton, TileLang, Pallas) with deep understanding of GPU architectureHigh-performance distributed systems in Rust, Go, or C++Python with PyTorch internals and LLM inference systems (vLLM, TensorRT-LLM, SGLang)Kubernetes, container orchestration, and infrastructure-as-code at scaleTransformer architectures, KV-cache memory management, and model servingPreferred Qualifications:Contributions to vLLM or other major open-source ML/systems projectsExperience with multiple accelerator platforms (NVIDIA, AMD, TPU, Intel)Knowledge of quantization techniques, ML-specific kernel optimization, or compiler technologiesTrack record of improving system reliability and performance at scaleWritten widely-shared technical blogs or impactful side projects in the ML infrastructure spaceLogisticsLocation: Fully remote, worldwide. We're timezone-flexible but expect regular overlap with Pacific Time for critical syncs.Compensation: We offer competitive compensations (salary + equity) compared to the local market conditions.Visa sponsorship: We sponsor visas on a case-by-case basis.Benefits: Inferact offers competitive benefits appropriate to your location, including health coverage where applicable.
Optionally, you can add more information later (benefits, pre-screening questions, etc.)