Principal AI Automation Engineer

**Principal Engineer – AI Quality & Evaluation Architecture**
**Role Overview**
Vocera (Stryker) is seeking a Principal Engineer to own end-to-end AI quality across the lifecycle — data, models, prompts, evaluation, deployment, and monitoring. This role will define and scale reliable, measurable, production-grade AI systems across speech, NLP, and GenAI in healthcare.

**Key Responsibilities**
**AI Quality Ownership**

+ Own AI quality across the full lifecycle
+ Define SLAs, KPIs, release gates, and production readiness decisions

**Evaluation & Reliability**

+ Build evaluation frameworks for ASR (WER, latency), NLP (intent/entity), and LLMs/RAG (hallucination, safety, groundedness)
+ Develop benchmarking, regression pipelines, and golden datasets
+ Drive adversarial testing, edge case handling, and failure analysis

**AI Testing Platform**

+ Architect scalable evaluation platforms (offline, regression, A/B, shadow te...