Senior ML Software Engineer, Data Plane

Amazon
Full-time Tel Aviv, Israel other-general
Posted:
June 03, 2026
Location:
Tel Aviv, Israel, Israel

Job Description

Description
The MLIL DataPlane team is looking for a Senior Software Development Engineer to own the design and implementation of our inference data plane. We build the software that makes large models run efficiently on custom hardware - spanning model execution, memory management, data movement, and serving integration.
Our work covers the full inference path: integrating serving engines with custom hardware, developing high-performance compute kernels, enabling efficient data movement, and driving models from early validation through production. We operate at frontier scale with large distributed models.
This is a ground-up effort with rapidly evolving hardware and software. We need a senior IC who can write and optimize low-level code for custom hardware, validate model architectures end-to-end, build test and profiling infrastructure, and drive performance across the stack.

Key job responsibilities
- Develop and optimize compute kernels for a custom ML acceler...

Apply for this Job

Submit your application for the Senior ML Software Engineer, Data Plane position at Amazon.

Apply Now Save for Later

Job Overview

Job Type: Full-time
Location: Tel Aviv, Israel
Posted: June 03, 2026
Deadline: June 08, 2026