AgentOps (Artificial Intelligence Engineer)

Job Description
About you
You are an engineer passionate about building reliable, observable, and secure AI systems at scale. You enjoy working at the intersection of product metrics, evaluation frameworks, and production-grade infrastructure. You are comfortable translating abstract KPIs into measurable signals, designing deployment safeguards, and ensuring AI systems behave safely, efficiently, and consistently in real-world environments.
You thrive in fast-paced, cloud-native environments, value automation and rigor, and enjoy collaborating with product, engineering, and AI teams to continuously improve system quality.
You bring to Applaudo the following competencies:
Bachelor's Degree in Computer Science, Software Engineering, Computer Engineering, or related field — or equivalent professional experience.
Strong experience with AI/ML evaluation, including metric definition, evaluation pipelines, golden datasets, and automated judge systems.
Proficiency in obser...