Senior ML Inference Systems Engineer at Runpod
Confirmed open
Optimize LLM inference serving at Runpod across GPU hardware and workloads. Measure throughput, token latency and cost, profile bottlenecks from scheduling to kernels, and ship reliable production configurations. Remote work is listed in the United States.
%22%20stroke%3D%22%23e2e8f0%22%20%2F%3E%0A%20%20%3Ctext%20x%3D%2240%22%20y%3D%2245%22%20text-anchor%3D%22middle%22%20font-family%3D%22ui-sans-serif%2C%20system-ui%2C%20-apple-system%22%20font-size%3D%2226%22%20font-weight%3D%22700%22%20fill%3D%22%230f172a%22%3ERU%3C%2Ftext%3E%0A%3C%2Fsvg%3E)
RunpodSearch jobs by company: Runpod
- Location
- Remote
- Employment
- FullTime
- Work arrangement
- remote
- Technologies
- Python
Save job — free account Saved jobs
Create a free application profile — Keep your skills and projects in a reusable profile. Private by default; you choose when to share. Apply for this job directly with the employer.
By continuing, you agree to processing needed to manage your account and profile. Privacy policy
Role overview
Optimize LLM inference serving at Runpod across GPU hardware and workloads. Measure throughput, token latency and cost, profile bottlenecks from scheduling to kernels, and ship reliable production configurations. Remote work is listed in the United States.
How to apply
Review the original posting and apply through the employer’s careers page.
View source and applyApply directlySource checked: 2026-11-08
Browse job categories
Related jobs
- Senior / Staff Backend Engineer, AI Inference at Cohere — Cohere
- People Systems Engineer at GitLab — GitLab
- Software Engineer, AI Inference Systems at Luma AI — Luma AI
- Cloud Infrastructure Security Engineer at Runpod — Runpod
- IT Systems Engineer, Mobile Client Platform Engineer at Anthropic — Anthropic
- Backend Engineer, Inference Services at Deepgram — Deepgram