Software Engineer, Model Runtime

Qualifications

Strong systems programming experience in C++, Rust, Python or comparable performance-oriented languages; experience building or optimizing runtimes, distributed systems, compilers, kernels, or model-serving infrastructure; understanding of modern LLM inference, batching, KV-cache, and model parallelism; ability to reason quantitatively about latency, throughput, and hardware performance; experience profiling and debugging across hardware-software stacks.

Eligibility

Candidates may need to meet certain legal status requirements as provided in U.S. export control laws and regulations.

Key Tech and Skills