Job Description
About the Team
We’re building high-performance infrastructure to serve OpenAI’s frontier models at massive scale. As part of the inference team, you’ll be responsible for unlocking every last FLOP from our GPUs by designing kernels, tuning memory layouts, and optimizing model execution at the lowest levels of the stack.
About the Role
We are looking for a kernel-focused engineer to lead efforts in writing, porting, and optimizing GPU kernels used in inference workloads. This role requires deep familiarity with CUDA or equivalent kernel programming environments, and a strong intuition for performance tuning across modern GPU architectures.
In this role, you will:
Design, implement, and optimize CUDA kernels for inference-critical operations (e.g., fused matmuls, custom activation functions, memory layout transforms).
Analyze performance bottlenecks and optimize kernel executi...
Apply for this Job
Submit your application for the Software Engineer, Inference - CUDA / Kernels position at OpenAI.
Apply Now Save for Later